2024-03-26T06:01:21.060 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-26T06:01:21.060 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi/7622744 --owner scheduled_rishabh@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} -- /home/teuthworker/archive/rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi/7622744/orig.config.yaml 2024-03-26T06:01:21.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T06:01:21.181 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi/7622744 branch: rishabh-2024mar8-2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: null first_in_suite: false job_id: '7622744' kernel: client: branch: testing flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2024mar8-2 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 7e98f5f6b535defc7fa715b456904ffc0500aa9f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7e98f5f6b535defc7fa715b456904ffc0500aa9f kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2024mar8-2 sha1: 7e98f5f6b535defc7fa715b456904ffc0500aa9f owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1249 sha1: 7e98f5f6b535defc7fa715b456904ffc0500aa9f sleep_before_teardown: 0 subset: 481/512 suite: fs suite_branch: rishabh-2024mar8-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7e98f5f6b535defc7fa715b456904ffc0500aa9f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3015ah+uS/GErHoW8pWDjsu0nZqjp03VNveGmFnF7o/acjBvnzYr0lW/QVToeCMrmQfqfDhbXR+2Ok4F5BV3o= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHhmeHk6Fn3xkDkzVCnMhzCOWRt2U88GoUWBUTHmSPtekX/MihhFYoOL1xZGXkZEM94XjMHYy2QkVdFllqy8atw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-26_05:47:39 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-26T06:01:21.181 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa; will attempt to use it 2024-03-26T06:01:21.182 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks 2024-03-26T06:01:21.182 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-26T06:01:21.184 INFO:teuthology.task.internal:Checking packages... 2024-03-26T06:01:21.208 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7e98f5f6b535defc7fa715b456904ffc0500aa9f' 2024-03-26T06:01:21.208 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-26T06:01:21.208 INFO:teuthology.packaging:ref: None 2024-03-26T06:01:21.208 INFO:teuthology.packaging:tag: None 2024-03-26T06:01:21.208 INFO:teuthology.packaging:branch: rishabh-2024mar8-2 2024-03-26T06:01:21.208 INFO:teuthology.packaging:sha1: 7e98f5f6b535defc7fa715b456904ffc0500aa9f 2024-03-26T06:01:21.208 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2024mar8-2 2024-03-26T06:01:21.429 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1964.g7e98f5f6 2024-03-26T06:01:21.431 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-26T06:01:21.438 INFO:teuthology.task.internal:no buildpackages task found 2024-03-26T06:01:21.438 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-26T06:01:21.446 INFO:teuthology.task.internal:Saving configuration 2024-03-26T06:01:21.463 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-26T06:01:21.470 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-26T06:01:21.494 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi/7622744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 05:56:07.128011', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3015ah+uS/GErHoW8pWDjsu0nZqjp03VNveGmFnF7o/acjBvnzYr0lW/QVToeCMrmQfqfDhbXR+2Ok4F5BV3o='} 2024-03-26T06:01:21.518 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi/7622744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 05:56:07.129776', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHhmeHk6Fn3xkDkzVCnMhzCOWRt2U88GoUWBUTHmSPtekX/MihhFYoOL1xZGXkZEM94XjMHYy2QkVdFllqy8atw='} 2024-03-26T06:01:21.518 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-26T06:01:21.525 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-26T06:01:21.526 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-26T06:01:21.526 INFO:teuthology.run_tasks:Running task console_log... 2024-03-26T06:01:21.605 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faee76d00d0>, signals=[15]) 2024-03-26T06:01:21.606 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-26T06:01:21.612 INFO:teuthology.task.internal:Opening connections... 2024-03-26T06:01:21.613 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T06:01:21.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:01:21.723 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T06:01:21.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:01:21.817 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-26T06:01:21.824 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-03-26T06:01:21.841 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-03-26T06:01:21.842 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-03-26T06:01:21.898 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T06:01:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T06:01:21.900 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T06:01:21.900 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-03-26T06:01:21.920 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-03-26T06:01:21.937 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-03-26T06:01:21.938 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-03-26T06:01:21.998 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-03-26T06:01:21.998 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-03-26T06:01:21.998 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-03-26T06:01:21.998 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T06:01:21.999 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T06:01:21.999 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-03-26T06:01:22.021 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-26T06:01:22.029 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-26T06:01:22.035 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-26T06:01:22.036 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-03-26T06:01:22.038 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-03-26T06:01:22.057 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-26T06:01:22.063 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-26T06:01:22.064 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-03-26T06:01:22.095 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-03-26T06:01:22.125 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-26T06:01:22.177 INFO:teuthology.run_tasks:Running task kernel... 2024-03-26T06:01:22.193 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-03-26T06:01:22.193 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-03-26T06:01:22.193 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-26T06:01:22.194 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-26T06:01:22.194 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-26T06:01:22.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T06:01:22.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-26T06:01:22.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T06:01:22.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-26T06:01:22.535 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-26T06:01:22.535 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-26T06:01:22.535 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-03-26T06:01:22.546 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-26T06:01:22.546 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-26T06:01:22.547 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-03-26T06:01:22.552 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-361.el9.x86_64 2024-03-26T06:01:22.553 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-26T06:01:22.553 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-26T06:01:22.553 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum upgrade -y linux-firmware 2024-03-26T06:01:22.564 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-361.el9.x86_64 2024-03-26T06:01:22.564 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-26T06:01:22.564 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-26T06:01:22.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum upgrade -y linux-firmware 2024-03-26T06:01:24.676 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-26T06:01:24.801 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-26T06:01:26.101 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.0 MB 00:00 2024-03-26T06:01:26.268 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2024-03-26T06:01:29.025 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.0 MB 00:02 2024-03-26T06:01:31.843 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-03-26T06:01:32.366 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.0 MB 00:05 2024-03-26T06:01:34.234 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-03-26T06:01:35.985 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-03-26T06:01:37.886 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 16 kB 00:00 2024-03-26T06:01:38.568 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 6.1 MB 00:00 2024-03-26T06:01:40.436 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 16 kB 00:00 2024-03-26T06:01:42.540 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 4.6 MB/s | 21 MB 00:04 2024-03-26T06:01:42.812 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 21 MB 00:02 2024-03-26T06:01:47.646 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-03-26T06:01:48.054 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 5.0 kB/s | 1.7 kB 00:00 2024-03-26T06:01:50.124 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 1 Package 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 375 M 2024-03-26T06:01:50.134 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-26T06:01:50.365 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 1 Package 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 375 M 2024-03-26T06:01:50.375 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-03-26T06:02:02.579 INFO:teuthology.orchestra.run.smithi063.stdout:linux-firmware-20240219-143.el9.noarch.rpm 30 MB/s | 375 MB 00:12 2024-03-26T06:02:02.580 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-26T06:02:02.581 INFO:teuthology.orchestra.run.smithi063.stdout:Total 30 MB/s | 375 MB 00:12 2024-03-26T06:02:02.581 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-26T06:02:02.710 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-26T06:02:02.710 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-26T06:02:03.229 INFO:teuthology.orchestra.run.smithi204.stdout:linux-firmware-20240219-143.el9.noarch.rpm 29 MB/s | 375 MB 00:12 2024-03-26T06:02:03.230 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-03-26T06:02:03.230 INFO:teuthology.orchestra.run.smithi204.stdout:Total 29 MB/s | 375 MB 00:12 2024-03-26T06:02:03.231 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-03-26T06:02:03.321 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-03-26T06:02:03.321 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-03-26T06:02:05.199 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-26T06:02:05.200 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-26T06:02:05.746 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-03-26T06:02:05.746 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-03-26T06:02:11.813 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-26T06:02:12.020 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-26T06:02:12.105 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-26T06:02:12.241 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-03-26T06:02:12.498 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-26T06:02:12.580 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-26T06:02:13.235 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-26T06:02:13.235 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-26T06:02:13.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-26T06:02:13.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:02:13.654 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-03-26T06:02:13.654 INFO:teuthology.orchestra.run.smithi063.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-26T06:02:13.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:02:13.654 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-26T06:02:13.874 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-26T06:02:13.875 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-26T06:02:13.936 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-26T06:02:13.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-26T06:02:14.155 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-26T06:02:14.155 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-26T06:02:14.157 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi063.front.sepia.ceph.com to complete... 2024-03-26T06:02:14.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-26T06:02:14.270 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:02:14.271 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-03-26T06:02:14.271 INFO:teuthology.orchestra.run.smithi204.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-26T06:02:14.272 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:02:14.272 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-03-26T06:02:14.548 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-26T06:02:14.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-26T06:02:14.766 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-26T06:02:14.766 DEBUG:teuthology.orchestra.run.smithi204:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-26T06:02:14.769 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi204.front.sepia.ceph.com to complete... 2024-03-26T06:03:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26 06:03:11 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-26T06:03:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:FINISHED --2024-03-26 06:03:11-- 2024-03-26T06:03:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:Total wall clock time: 57s 2024-03-26T06:03:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:Downloaded: 1 files, 321M in 57s (5.66 MB/s) 2024-03-26T06:03:11.451 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-26T06:03:11.451 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-26T06:03:13.488 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying... ######################################## 2024-03-26T06:03:13.557 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing... ######################################## 2024-03-26T06:03:13.641 INFO:teuthology.orchestra.run.smithi063.stdout:Updating / installing... 2024-03-26T06:03:21.459 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-26T06:03:24.228 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26 06:03:24 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-26T06:03:24.229 INFO:teuthology.orchestra.run.smithi204.stderr:FINISHED --2024-03-26 06:03:24-- 2024-03-26T06:03:24.229 INFO:teuthology.orchestra.run.smithi204.stderr:Total wall clock time: 1m 9s 2024-03-26T06:03:24.229 INFO:teuthology.orchestra.run.smithi204.stderr:Downloaded: 1 files, 321M in 1m 9s (4.66 MB/s) 2024-03-26T06:03:24.232 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-26T06:03:24.232 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-26T06:03:26.201 INFO:teuthology.orchestra.run.smithi204.stdout:Verifying... ######################################## 2024-03-26T06:03:26.252 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing... ######################################## 2024-03-26T06:03:26.331 INFO:teuthology.orchestra.run.smithi204.stdout:Updating / installing... 2024-03-26T06:03:33.950 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-26T06:03:35.277 INFO:teuthology.orchestra.run.smithi063.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-26T06:03:48.680 INFO:teuthology.orchestra.run.smithi204.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-26T06:03:58.386 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-26T06:03:58.387 DEBUG:teuthology.orchestra.run.smithi063:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-26T06:03:58.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-26T06:03:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-26T06:03:58.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-26T06:03:58.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-26T06:03:58.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-26T06:03:58.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-26T06:03:58.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-26T06:03:58.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-26T06:03:58.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-26T06:03:58.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-26T06:03:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-26T06:03:58.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-26T06:03:58.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-26T06:03:58.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-26T06:03:58.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-26T06:03:58.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-26T06:03:58.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-26T06:03:58.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-26T06:03:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-26T06:03:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-26T06:03:58.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-26T06:03:58.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-26T06:03:58.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-26T06:03:58.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-26T06:03:58.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-26T06:03:58.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-26T06:03:58.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-26T06:03:58.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-26T06:03:58.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-26T06:03:58.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-26T06:03:58.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-26T06:03:58.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-26T06:03:58.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-26T06:03:58.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-26T06:03:58.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-26T06:03:58.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-26T06:03:58.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-26T06:03:58.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-26T06:03:58.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-26T06:03:58.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-26T06:03:58.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-26T06:03:58.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-26T06:03:58.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-26T06:03:58.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-26T06:03:58.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-26T06:03:58.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-26T06:03:58.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-26T06:03:58.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-26T06:03:58.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-26T06:03:58.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-26T06:03:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-26T06:03:58.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-26T06:03:58.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-26T06:03:58.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-26T06:03:58.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-26T06:03:58.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-26T06:03:58.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-26T06:03:58.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-26T06:03:58.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-26T06:03:58.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-26T06:03:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-26T06:03:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-26T06:03:58.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-26T06:03:58.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-26T06:03:58.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-26T06:03:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-26T06:03:58.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-26T06:03:58.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-26T06:03:58.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-26T06:03:58.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-26T06:03:58.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-26T06:03:58.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-26T06:03:58.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-26T06:03:58.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-26T06:03:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-26T06:03:58.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-26T06:03:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-26T06:03:58.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-26T06:03:58.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-26T06:03:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-26T06:03:58.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-26T06:03:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-26T06:03:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-26T06:03:58.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-26T06:03:58.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-26T06:03:58.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-26T06:03:58.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-26T06:03:58.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-26T06:03:58.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-26T06:03:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-26T06:03:58.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-26T06:03:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-26T06:03:58.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-26T06:03:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-26T06:03:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-26T06:03:58.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-26T06:03:58.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-26T06:03:58.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-26T06:03:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-26T06:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-26T06:03:58.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-26T06:03:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-26T06:03:58.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-26T06:03:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-26T06:03:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-26T06:03:58.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-26T06:03:58.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-26T06:03:58.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-26T06:03:58.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-26T06:03:58.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-26T06:03:58.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-26T06:03:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-26T06:03:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-26T06:03:58.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-26T06:03:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-26T06:03:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-26T06:03:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-26T06:03:58.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-26T06:03:58.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-26T06:03:58.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-26T06:03:58.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-26T06:03:58.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-26T06:03:58.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-26T06:03:58.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-26T06:03:58.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-26T06:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-26T06:03:58.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-26T06:03:58.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-26T06:03:58.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-26T06:03:58.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-26T06:03:58.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-26T06:03:58.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-26T06:03:58.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-26T06:03:58.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-26T06:03:58.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-26T06:03:58.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-26T06:03:58.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-26T06:03:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-26T06:03:58.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-26T06:03:58.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-26T06:03:58.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-26T06:03:58.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-26T06:03:58.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-26T06:03:58.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-26T06:03:58.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-26T06:03:58.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-26T06:03:58.594 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-26T06:03:58.594 DEBUG:teuthology.orchestra.run.smithi063:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-26T06:03:58.618 INFO:teuthology.orchestra.run.smithi063.stdout:postinstall scriptlet (using /bin/sh): 2024-03-26T06:03:58.618 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-26T06:03:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-26T06:03:58.618 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2024-03-26T06:03:58.618 INFO:teuthology.orchestra.run.smithi063.stdout:for file in vmlinuz System.map config; do 2024-03-26T06:03:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-26T06:03:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-26T06:03:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: fi 2024-03-26T06:03:58.618 INFO:teuthology.orchestra.run.smithi063.stdout:done 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-26T06:03:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2024-03-26T06:03:58.620 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-03-26T06:03:58.712 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-03-26T06:03:58.712 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 68.el9 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8264254 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-26T06:03:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-03-26T06:03:58.714 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-03-26T06:03:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:03:58.714 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-26T06:03:58.714 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-26T06:03:58.714 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-26T06:03:58.714 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-03-26T06:03:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:03:58.714 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-03-26T06:03:58.715 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-26T06:03:58.715 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 6.8.0-g1df0c7e8a235 2024-03-26T06:03:58.715 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-26T06:03:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-03-26T06:04:00.674 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-26T06:04:00.714 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-03-26T06:04:00.721 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-03-26T06:04:00.737 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.HpEF5kothw 2024-03-26T06:04:00.737 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HpEF5kothw 2024-03-26T06:04:00.832 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.HpEF5kothw 2024-03-26T06:04:00.931 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.HpEF5kothw is 6KB 2024-03-26T06:04:00.980 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.HpEF5kothw 2024-03-26T06:04:00.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-03-26T06:04:01.062 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-26T06:04:01.063 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-26T06:04:01.063 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-26T06:04:01.063 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-26T06:04:01.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-26T06:04:01.225 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-03-26T06:04:11.293 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-26T06:04:11.293 DEBUG:teuthology.orchestra.run.smithi204:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-26T06:04:11.374 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-26T06:04:11.375 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-26T06:04:11.376 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-26T06:04:11.377 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-26T06:04:11.378 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-26T06:04:11.379 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-26T06:04:11.380 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-26T06:04:11.381 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-26T06:04:11.382 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-26T06:04:11.383 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-26T06:04:11.384 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-26T06:04:11.385 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-26T06:04:11.386 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-26T06:04:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-26T06:04:11.388 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-26T06:04:11.389 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-26T06:04:11.390 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-26T06:04:11.391 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-26T06:04:11.392 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-26T06:04:11.393 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-26T06:04:11.394 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-26T06:04:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-26T06:04:11.396 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-26T06:04:11.397 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-26T06:04:11.398 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-26T06:04:11.399 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-26T06:04:11.400 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-26T06:04:11.401 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-26T06:04:11.402 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-26T06:04:11.403 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-26T06:04:11.404 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-26T06:04:11.405 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-26T06:04:11.406 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-26T06:04:11.407 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-26T06:04:11.408 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-26T06:04:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-26T06:04:11.410 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-26T06:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-26T06:04:11.412 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-26T06:04:11.413 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-26T06:04:11.414 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-26T06:04:11.415 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-26T06:04:11.416 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-26T06:04:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-26T06:04:11.418 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-26T06:04:11.419 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-26T06:04:11.420 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-26T06:04:11.421 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-26T06:04:11.422 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-26T06:04:11.422 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-26T06:04:11.422 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-26T06:04:11.422 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-26T06:04:11.422 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-26T06:04:11.423 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-26T06:04:11.423 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-26T06:04:11.423 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-26T06:04:11.423 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-26T06:04:11.424 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-26T06:04:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-26T06:04:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-26T06:04:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-26T06:04:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-26T06:04:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-26T06:04:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-26T06:04:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-26T06:04:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-26T06:04:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-26T06:04:11.426 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-26T06:04:11.427 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-26T06:04:11.428 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-26T06:04:11.429 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-26T06:04:11.430 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-26T06:04:11.431 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-26T06:04:11.432 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-26T06:04:11.433 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-26T06:04:11.434 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-26T06:04:11.435 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-26T06:04:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-26T06:04:11.437 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-26T06:04:11.438 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-26T06:04:11.439 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-26T06:04:11.440 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-26T06:04:11.441 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-26T06:04:11.442 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-26T06:04:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-26T06:04:11.444 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-26T06:04:11.445 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-26T06:04:11.446 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-26T06:04:11.447 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-26T06:04:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-26T06:04:11.449 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-26T06:04:11.450 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-26T06:04:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-26T06:04:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-26T06:04:11.453 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-26T06:04:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-26T06:04:11.455 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-26T06:04:11.456 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-26T06:04:11.457 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-26T06:04:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-26T06:04:11.459 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-26T06:04:11.460 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-26T06:04:11.461 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-26T06:04:11.462 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-26T06:04:11.463 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-26T06:04:11.464 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-26T06:04:11.465 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-26T06:04:11.466 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-26T06:04:11.467 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-26T06:04:11.468 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-26T06:04:11.469 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-26T06:04:11.470 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-26T06:04:11.471 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-26T06:04:11.472 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-26T06:04:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-26T06:04:11.474 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-26T06:04:11.475 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-26T06:04:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-26T06:04:11.477 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-26T06:04:11.478 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-26T06:04:11.479 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-26T06:04:11.480 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-26T06:04:11.481 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-26T06:04:11.482 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-26T06:04:11.483 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-26T06:04:11.484 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-26T06:04:11.485 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-26T06:04:11.486 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-26T06:04:11.487 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-26T06:04:11.488 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-26T06:04:11.489 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-26T06:04:11.490 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-26T06:04:11.491 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-26T06:04:11.492 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-26T06:04:11.493 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-26T06:04:11.494 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-26T06:04:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-26T06:04:11.496 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-26T06:04:11.497 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-26T06:04:11.498 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-26T06:04:11.499 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-26T06:04:11.500 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-26T06:04:11.501 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-26T06:04:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-26T06:04:11.503 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-26T06:04:11.504 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-26T06:04:11.505 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-26T06:04:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-26T06:04:11.507 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-26T06:04:11.508 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-26T06:04:11.509 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-26T06:04:11.510 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-26T06:04:11.511 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-26T06:04:11.512 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-26T06:04:11.513 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-26T06:04:11.514 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-26T06:04:11.514 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-26T06:04:11.514 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-26T06:04:11.514 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-26T06:04:11.514 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-26T06:04:11.514 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-26T06:04:11.514 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-26T06:04:11.514 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-26T06:04:11.517 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-26T06:04:11.517 DEBUG:teuthology.orchestra.run.smithi204:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout:postinstall scriptlet (using /bin/sh): 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout:fi 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout:for file in vmlinuz System.map config; do 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout: fi 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout:done 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-26T06:04:11.540 INFO:teuthology.orchestra.run.smithi204.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-26T06:04:11.541 INFO:teuthology.orchestra.run.smithi204.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-26T06:04:11.541 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-26T06:04:11.541 INFO:teuthology.orchestra.run.smithi204.stdout:fi 2024-03-26T06:04:11.541 INFO:teuthology.orchestra.run.smithi204.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-26T06:04:11.541 INFO:teuthology.orchestra.run.smithi204.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-26T06:04:11.541 INFO:teuthology.orchestra.run.smithi204.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-26T06:04:11.541 INFO:teuthology.orchestra.run.smithi204.stdout:fi 2024-03-26T06:04:11.542 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -qi grub2-tools 2024-03-26T06:04:11.617 INFO:teuthology.orchestra.run.smithi204.stdout:Name : grub2-tools 2024-03-26T06:04:11.617 INFO:teuthology.orchestra.run.smithi204.stdout:Epoch : 1 2024-03-26T06:04:11.617 INFO:teuthology.orchestra.run.smithi204.stdout:Version : 2.06 2024-03-26T06:04:11.617 INFO:teuthology.orchestra.run.smithi204.stdout:Release : 68.el9 2024-03-26T06:04:11.617 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: x86_64 2024-03-26T06:04:11.617 INFO:teuthology.orchestra.run.smithi204.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-26T06:04:11.617 INFO:teuthology.orchestra.run.smithi204.stdout:Group : Unspecified 2024-03-26T06:04:11.617 INFO:teuthology.orchestra.run.smithi204.stdout:Size : 8264254 2024-03-26T06:04:11.617 INFO:teuthology.orchestra.run.smithi204.stdout:License : GPLv3+ 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:Packager : builder@centos.org 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:Vendor : CentOS 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:Summary : Support tools for GRUB. 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:Description : 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:hardware devices. 2024-03-26T06:04:11.618 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:04:11.619 INFO:teuthology.orchestra.run.smithi204.stdout:This subpackage provides tools for support of all platforms. 2024-03-26T06:04:11.622 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-26T06:04:11.622 INFO:teuthology.task.kernel:Updating grub on smithi204 to boot 6.8.0-g1df0c7e8a235 2024-03-26T06:04:11.622 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-26T06:04:12.214 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-03-26T06:04:13.635 INFO:teuthology.orchestra.run.smithi204.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-26T06:04:13.671 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-03-26T06:04:13.674 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-03-26T06:04:13.688 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.R8rRuaNyq3 2024-03-26T06:04:13.688 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.R8rRuaNyq3 2024-03-26T06:04:13.758 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.R8rRuaNyq3 2024-03-26T06:04:13.901 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.R8rRuaNyq3 is 6KB 2024-03-26T06:04:13.948 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.R8rRuaNyq3 2024-03-26T06:04:13.962 DEBUG:teuthology.orchestra.run.smithi204:> sudo /bin/ls /boot/loader/entries || true 2024-03-26T06:04:14.028 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-26T06:04:14.028 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-26T06:04:14.028 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-26T06:04:14.028 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-26T06:04:14.029 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-26T06:04:14.171 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-03-26T06:04:31.242 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-26T06:04:31.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T06:04:31.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:04:44.186 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-26T06:04:44.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T06:04:44.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:05:05.695 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-03-26T06:05:14.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T06:05:14.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:05:18.754 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-03-26T06:05:27.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T06:05:27.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:05:33.086 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-03-26T06:05:45.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T06:05:45.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:05:48.158 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-03-26T06:06:03.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T06:06:03.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:06:03.587 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-03-26T06:06:04.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T06:06:04.154 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g1df0c7e8a235"... 2024-03-26T06:06:04.154 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-03-26T06:06:04.192 INFO:teuthology.orchestra.run.smithi063.stdout:6.8.0-g1df0c7e8a235 2024-03-26T06:06:04.192 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-26T06:06:04.192 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-26T06:06:04.192 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-26T06:06:05.193 DEBUG:teuthology.parallel:result is None 2024-03-26T06:06:27.766 DEBUG:teuthology.orchestra.remote:timed out 2024-03-26T06:06:39.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T06:06:39.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:06:40.200 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-26T06:06:40.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T06:06:40.821 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-g1df0c7e8a235"... 2024-03-26T06:06:40.821 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-03-26T06:06:40.875 INFO:teuthology.orchestra.run.smithi204.stdout:6.8.0-g1df0c7e8a235 2024-03-26T06:06:40.875 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-26T06:06:40.875 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-26T06:06:40.876 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-26T06:06:41.877 DEBUG:teuthology.parallel:result is None 2024-03-26T06:06:41.877 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-26T06:06:41.890 INFO:teuthology.task.internal:Creating test directory... 2024-03-26T06:06:41.890 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-26T06:06:41.898 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-26T06:06:41.952 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-26T06:06:41.959 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-26T06:06:42.008 INFO:teuthology.task.internal:Creating archive directory... 2024-03-26T06:06:42.009 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-26T06:06:42.015 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-26T06:06:42.089 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-26T06:06:42.096 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-26T06:06:42.096 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-26T06:06:42.103 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-26T06:06:42.230 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T06:06:42.284 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T06:06:42.300 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T06:06:42.368 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T06:06:42.373 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-26T06:06:42.381 INFO:teuthology.task.internal:Configuring sudo... 2024-03-26T06:06:42.381 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-26T06:06:42.388 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-26T06:06:42.488 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-26T06:06:42.498 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-26T06:06:42.498 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-26T06:06:42.504 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-26T06:06:42.557 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T06:06:42.645 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T06:06:42.758 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T06:06:42.847 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T06:06:42.953 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:06:42.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-26T06:06:43.046 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T06:06:43.132 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T06:06:43.244 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T06:06:43.326 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T06:06:43.420 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:06:43.420 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-26T06:06:43.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-03-26T06:06:43.520 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-03-26T06:06:43.637 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T06:06:43.656 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T06:06:44.066 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-26T06:06:44.074 INFO:teuthology.task.internal:Starting timer... 2024-03-26T06:06:44.074 INFO:teuthology.run_tasks:Running task pcp... 2024-03-26T06:06:44.085 INFO:teuthology.run_tasks:Running task selinux... 2024-03-26T06:06:44.094 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-26T06:06:44.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-03-26T06:06:44.219 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-03-26T06:06:44.225 DEBUG:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2024-03-26T06:06:44.347 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: 2024-03-26T06:06:44.351 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-26T06:06:44.351 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-03-26T06:06:44.421 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-03-26T06:06:44.422 DEBUG:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2024-03-26T06:06:44.482 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2024-03-26T06:06:44.483 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2024-03-26T06:06:44.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-26T06:06:44.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T06:06:44.571 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-26T06:06:44.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T06:06:44.657 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-26T06:06:44.657 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-03-26T06:06:44.742 DEBUG:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2024-03-26T06:06:44.830 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-26T06:06:44.841 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-26T06:06:44.846 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-26T06:06:44.969 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-26T06:06:44.985 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-26T06:06:44.987 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-26T06:13:10.407 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-03-26T06:13:10.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T06:13:10.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:13:10.558 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-03-26T06:13:10.719 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T06:13:10.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T06:13:10.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T06:13:10.860 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-26T06:13:11.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T06:13:11.009 INFO:teuthology.run_tasks:Running task clock... 2024-03-26T06:13:11.022 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-26T06:13:11.022 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-26T06:13:11.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T06:13:11.030 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-26T06:13:11.030 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T06:13:11.128 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-26T06:13:11.130 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-26T06:13:11.181 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-26T06:13:11.185 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-26T06:13:11.272 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2024-03-26T06:13:11.287 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-03-26T06:13:11.315 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2024-03-26T06:13:11.332 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-03-26T06:13:11.366 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-26T06:13:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-26T06:13:11.416 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-26T06:13:11.449 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-26T06:13:11.543 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-03-26T06:13:11.552 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T06:13:11.553 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-03-26T06:13:11.553 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T06:13:11.553 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T06:13:11.553 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T06:13:11.553 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T06:13:11.587 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-03-26T06:13:11.598 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T06:13:11.598 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-03-26T06:13:11.598 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T06:13:11.598 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T06:13:11.599 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T06:13:11.599 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T06:13:11.601 INFO:teuthology.run_tasks:Running task install... 2024-03-26T06:13:11.609 DEBUG:teuthology.task.install:project ceph 2024-03-26T06:13:11.609 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f'}} 2024-03-26T06:13:11.609 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f'} 2024-03-26T06:13:11.610 INFO:teuthology.task.install:Using flavor: default 2024-03-26T06:13:11.616 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-26T06:13:11.616 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-26T06:13:11.616 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f', 'tag': None, 'wait_for_package': False} 2024-03-26T06:13:11.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7e98f5f6b535defc7fa715b456904ffc0500aa9f 2024-03-26T06:13:11.619 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f', 'tag': None, 'wait_for_package': False} 2024-03-26T06:13:11.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7e98f5f6b535defc7fa715b456904ffc0500aa9f 2024-03-26T06:13:11.844 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-2024mar8-2/7e98f5f6b535defc7fa715b456904ffc0500aa9f/centos/9/flavors/default/ 2024-03-26T06:13:11.844 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1964.g7e98f5f6 2024-03-26T06:13:11.852 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-2024mar8-2/7e98f5f6b535defc7fa715b456904ffc0500aa9f/centos/9/flavors/default/ 2024-03-26T06:13:11.852 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1964.g7e98f5f6 2024-03-26T06:13:11.955 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/rishabh-2024mar8-2/7e98f5f6b535defc7fa715b456904ffc0500aa9f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/rishabh-2024mar8-2/7e98f5f6b535defc7fa715b456904ffc0500aa9f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/rishabh-2024mar8-2/7e98f5f6b535defc7fa715b456904ffc0500aa9f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-26T06:13:11.955 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:13:11.955 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-26T06:13:12.063 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-26T06:13:12.063 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7e98f5f6b535defc7fa715b456904ffc0500aa9f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-26T06:13:12.134 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/rishabh-2024mar8-2/7e98f5f6b535defc7fa715b456904ffc0500aa9f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/rishabh-2024mar8-2/7e98f5f6b535defc7fa715b456904ffc0500aa9f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/rishabh-2024mar8-2/7e98f5f6b535defc7fa715b456904ffc0500aa9f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-26T06:13:12.134 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:13:12.134 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-26T06:13:12.207 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-26T06:13:12.229 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-26T06:13:12.229 DEBUG:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7e98f5f6b535defc7fa715b456904ffc0500aa9f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-26T06:13:12.348 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-26T06:13:12.368 DEBUG:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-26T06:13:12.442 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-03-26T06:13:12.446 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-03-26T06:13:12.503 DEBUG:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-26T06:13:12.593 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2024-03-26T06:13:12.597 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum clean all 2024-03-26T06:13:12.798 INFO:teuthology.orchestra.run.smithi063.stdout:74 files removed 2024-03-26T06:13:12.837 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-26T06:13:12.965 INFO:teuthology.orchestra.run.smithi204.stdout:74 files removed 2024-03-26T06:13:13.006 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-26T06:13:13.835 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 170 kB/s | 82 kB 00:00 2024-03-26T06:13:14.052 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 152 kB/s | 82 kB 00:00 2024-03-26T06:13:14.368 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 23 kB/s | 10 kB 00:00 2024-03-26T06:13:14.570 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 24 kB/s | 10 kB 00:00 2024-03-26T06:13:14.969 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2024-03-26T06:13:15.029 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-03-26T06:13:15.650 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-26T06:13:15.681 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-26T06:13:17.275 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2024-03-26T06:13:17.306 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2024-03-26T06:13:18.204 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-03-26T06:13:18.561 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.0 MB 00:00 2024-03-26T06:13:22.087 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 8.2 MB/s | 19 MB 00:02 2024-03-26T06:13:28.205 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.1 MB 00:02 2024-03-26T06:13:29.872 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-03-26T06:13:33.512 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 19 MB 00:14 2024-03-26T06:13:36.771 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 3.1 MB/s | 21 MB 00:06 2024-03-26T06:13:38.305 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.1 MB 00:00 2024-03-26T06:13:40.006 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-03-26T06:13:41.633 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-03-26T06:13:42.740 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-03-26T06:13:45.440 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-26T06:13:45.442 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-26T06:13:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-26T06:13:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-26T06:13:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-26T06:13:45.466 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-26T06:13:45.469 INFO:teuthology.orchestra.run.smithi063.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-26T06:13:45.472 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-26T06:13:45.474 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-26T06:13:45.571 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-26T06:13:45.593 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2024-03-26T06:13:45.593 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-26T06:13:45.593 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2024-03-26T06:13:45.593 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 6.6 k 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 5.4 M 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 889 k 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 145 k 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 1.5 M 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 139 k 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 1.8 M 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 7.4 M 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 49 k 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 9.8 M 2024-03-26T06:13:45.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 47 M 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 264 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 749 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 219 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 27 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 18 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 31 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 745 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 127 k 2024-03-26T06:13:45.595 INFO:teuthology.orchestra.run.smithi063.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 162 k 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 321 k 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 298 k 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 99 k 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 86 k 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 3.1 M 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 170 k 2024-03-26T06:13:45.596 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-26T06:13:45.597 INFO:teuthology.orchestra.run.smithi063.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 3.4 M 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 3.1 M 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-26T06:13:45.598 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 20 M 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 34 k 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 2.1 M 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 248 k 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 4.7 M 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 17 M 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 16 k 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 25 k 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-26T06:13:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 163 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 503 k 2024-03-26T06:13:45.600 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 5.1 M 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-26T06:13:45.601 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 45 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 131 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-26T06:13:45.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-26T06:13:45.603 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-26T06:13:45.604 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-26T06:13:45.605 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-26T06:13:45.606 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout:Install 150 Packages 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 24 Packages 2024-03-26T06:13:45.607 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:13:45.608 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 223 M 2024-03-26T06:13:45.608 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-26T06:13:46.434 INFO:teuthology.orchestra.run.smithi063.stdout:(1/174): ceph-19.0.0-1964.g7e98f5f6.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-03-26T06:13:46.634 INFO:teuthology.orchestra.run.smithi063.stdout:(2/174): ceph-fuse-19.0.0-1964.g7e98f5f6.el9.x8 4.4 MB/s | 889 kB 00:00 2024-03-26T06:13:46.709 INFO:teuthology.orchestra.run.smithi063.stdout:(3/174): ceph-immutable-object-cache-19.0.0-196 1.9 MB/s | 145 kB 00:00 2024-03-26T06:13:46.910 INFO:teuthology.orchestra.run.smithi063.stdout:(4/174): ceph-base-19.0.0-1964.g7e98f5f6.el9.x8 7.1 MB/s | 5.4 MB 00:00 2024-03-26T06:13:47.010 INFO:teuthology.orchestra.run.smithi063.stdout:(5/174): ceph-mds-19.0.0-1964.g7e98f5f6.el9.x86 7.1 MB/s | 2.1 MB 00:00 2024-03-26T06:13:47.085 INFO:teuthology.orchestra.run.smithi063.stdout:(6/174): ceph-mgr-19.0.0-1964.g7e98f5f6.el9.x86 8.6 MB/s | 1.5 MB 00:00 2024-03-26T06:13:47.560 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-03-26T06:13:47.619 INFO:teuthology.orchestra.run.smithi063.stdout:(7/174): ceph-mon-19.0.0-1964.g7e98f5f6.el9.x86 7.7 MB/s | 4.7 MB 00:00 2024-03-26T06:13:48.719 INFO:teuthology.orchestra.run.smithi063.stdout:(8/174): ceph-common-19.0.0-1964.g7e98f5f6.el9. 7.8 MB/s | 20 MB 00:02 2024-03-26T06:13:48.770 INFO:teuthology.orchestra.run.smithi063.stdout:(9/174): ceph-selinux-19.0.0-1964.g7e98f5f6.el9 513 kB/s | 25 kB 00:00 2024-03-26T06:13:49.037 INFO:teuthology.orchestra.run.smithi063.stdout:(10/174): ceph-osd-19.0.0-1964.g7e98f5f6.el9.x8 8.6 MB/s | 17 MB 00:01 2024-03-26T06:13:49.104 INFO:teuthology.orchestra.run.smithi063.stdout:(11/174): cephfs-mirror-19.0.0-1964.g7e98f5f6.e 3.3 MB/s | 219 kB 00:00 2024-03-26T06:13:49.262 INFO:teuthology.orchestra.run.smithi063.stdout:(12/174): ceph-radosgw-19.0.0-1964.g7e98f5f6.el 6.0 MB/s | 9.8 MB 00:01 2024-03-26T06:13:49.287 INFO:teuthology.orchestra.run.smithi063.stdout:(13/174): cephfs-shell-19.0.0-1964.g7e98f5f6.el 148 kB/s | 27 kB 00:00 2024-03-26T06:13:49.313 INFO:teuthology.orchestra.run.smithi063.stdout:(14/174): libcephfs-devel-19.0.0-1964.g7e98f5f6 633 kB/s | 31 kB 00:00 2024-03-26T06:13:49.371 INFO:teuthology.orchestra.run.smithi063.stdout:(15/174): libcephsqlite-19.0.0-1964.g7e98f5f6.e 2.8 MB/s | 163 kB 00:00 2024-03-26T06:13:49.438 INFO:teuthology.orchestra.run.smithi063.stdout:(16/174): libcephfs2-19.0.0-1964.g7e98f5f6.el9. 4.9 MB/s | 745 kB 00:00 2024-03-26T06:13:49.472 INFO:teuthology.orchestra.run.smithi063.stdout:(17/174): librados-devel-19.0.0-1964.g7e98f5f6. 1.2 MB/s | 127 kB 00:00 2024-03-26T06:13:49.514 INFO:teuthology.orchestra.run.smithi063.stdout:(18/174): libradosstriper1-19.0.0-1964.g7e98f5f 6.5 MB/s | 503 kB 00:00 2024-03-26T06:13:49.573 INFO:teuthology.orchestra.run.smithi063.stdout:(19/174): python3-ceph-argparse-19.0.0-1964.g7e 787 kB/s | 45 kB 00:00 2024-03-26T06:13:49.648 INFO:teuthology.orchestra.run.smithi063.stdout:(20/174): python3-ceph-common-19.0.0-1964.g7e98 1.7 MB/s | 131 kB 00:00 2024-03-26T06:13:49.731 INFO:teuthology.orchestra.run.smithi063.stdout:(21/174): python3-cephfs-19.0.0-1964.g7e98f5f6. 1.9 MB/s | 162 kB 00:00 2024-03-26T06:13:49.824 INFO:teuthology.orchestra.run.smithi063.stdout:(22/174): python3-rados-19.0.0-1964.g7e98f5f6.e 3.5 MB/s | 321 kB 00:00 2024-03-26T06:13:49.916 INFO:teuthology.orchestra.run.smithi063.stdout:(23/174): python3-rbd-19.0.0-1964.g7e98f5f6.el9 3.2 MB/s | 298 kB 00:00 2024-03-26T06:13:50.024 INFO:teuthology.orchestra.run.smithi063.stdout:(24/174): librgw2-19.0.0-1964.g7e98f5f6.el9.x86 9.3 MB/s | 5.1 MB 00:00 2024-03-26T06:13:50.058 INFO:teuthology.orchestra.run.smithi063.stdout:(25/174): python3-rgw-19.0.0-1964.g7e98f5f6.el9 706 kB/s | 99 kB 00:00 2024-03-26T06:13:50.091 INFO:teuthology.orchestra.run.smithi063.stdout:(26/174): rbd-fuse-19.0.0-1964.g7e98f5f6.el9.x8 1.3 MB/s | 86 kB 00:00 2024-03-26T06:13:50.175 INFO:teuthology.orchestra.run.smithi063.stdout:(27/174): rbd-nbd-19.0.0-1964.g7e98f5f6.el9.x86 2.0 MB/s | 170 kB 00:00 2024-03-26T06:13:50.180 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-26T06:13:50.181 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-26T06:13:50.202 INFO:teuthology.orchestra.run.smithi204.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-26T06:13:50.203 INFO:teuthology.orchestra.run.smithi204.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-26T06:13:50.204 INFO:teuthology.orchestra.run.smithi204.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-26T06:13:50.205 INFO:teuthology.orchestra.run.smithi204.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-26T06:13:50.208 INFO:teuthology.orchestra.run.smithi204.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-26T06:13:50.211 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-26T06:13:50.212 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-26T06:13:50.250 INFO:teuthology.orchestra.run.smithi063.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1964.g 457 kB/s | 34 kB 00:00 2024-03-26T06:13:50.303 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-03-26T06:13:50.326 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 6.6 k 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 5.4 M 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 889 k 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 145 k 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 1.5 M 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 139 k 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 1.8 M 2024-03-26T06:13:50.327 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 7.4 M 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 49 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 9.8 M 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 47 M 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 264 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 749 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 219 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-shell x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 27 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 18 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 31 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 745 k 2024-03-26T06:13:50.328 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 127 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 162 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 321 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 298 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 99 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 86 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 3.1 M 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 170 k 2024-03-26T06:13:50.329 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-26T06:13:50.330 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 3.4 M 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 3.1 M 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-26T06:13:50.331 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 20 M 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 34 k 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 2.1 M 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 248 k 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 4.7 M 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 17 M 2024-03-26T06:13:50.332 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1964.g7e98f5f6.el9 ceph-noarch 16 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 25 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 163 k 2024-03-26T06:13:50.333 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 503 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 5.1 M 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-26T06:13:50.334 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-26T06:13:50.335 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-26T06:13:50.335 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-26T06:13:50.335 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-26T06:13:50.335 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-26T06:13:50.335 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-26T06:13:50.335 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-26T06:13:50.335 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-26T06:13:50.335 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-26T06:13:50.335 INFO:teuthology.orchestra.run.smithi204.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 45 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:19.0.0-1964.g7e98f5f6.el9 ceph 131 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-26T06:13:50.336 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-26T06:13:50.337 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-26T06:13:50.338 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-26T06:13:50.339 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-26T06:13:50.340 INFO:teuthology.orchestra.run.smithi204.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout:Install 150 Packages 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 24 Packages 2024-03-26T06:13:50.341 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:13:50.342 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 223 M 2024-03-26T06:13:50.342 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-03-26T06:13:50.359 INFO:teuthology.orchestra.run.smithi063.stdout:(29/174): rbd-mirror-19.0.0-1964.g7e98f5f6.el9. 10 MB/s | 3.1 MB 00:00 2024-03-26T06:13:50.393 INFO:teuthology.orchestra.run.smithi063.stdout:(30/174): ceph-mgr-cephadm-19.0.0-1964.g7e98f5f 982 kB/s | 139 kB 00:00 2024-03-26T06:13:50.627 INFO:teuthology.orchestra.run.smithi063.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1964.g7e98f 6.7 MB/s | 1.8 MB 00:00 2024-03-26T06:13:50.727 INFO:teuthology.orchestra.run.smithi063.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1964.g7e 2.4 MB/s | 248 kB 00:00 2024-03-26T06:13:50.802 INFO:teuthology.orchestra.run.smithi063.stdout:(33/174): ceph-mgr-rook-19.0.0-1964.g7e98f5f6.e 663 kB/s | 49 kB 00:00 2024-03-26T06:13:50.877 INFO:teuthology.orchestra.run.smithi063.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1964.g7 222 kB/s | 16 kB 00:00 2024-03-26T06:13:50.961 INFO:teuthology.orchestra.run.smithi063.stdout:(35/174): ceph-volume-19.0.0-1964.g7e98f5f6.el9 3.1 MB/s | 264 kB 00:00 2024-03-26T06:13:51.136 INFO:teuthology.orchestra.run.smithi063.stdout:(36/174): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-03-26T06:13:51.187 INFO:teuthology.orchestra.run.smithi063.stdout:(37/174): cephadm-19.0.0-1964.g7e98f5f6.el9.noa 3.3 MB/s | 749 kB 00:00 2024-03-26T06:13:51.212 INFO:teuthology.orchestra.run.smithi063.stdout:(38/174): cephfs-top-19.0.0-1964.g7e98f5f6.el9. 244 kB/s | 18 kB 00:00 2024-03-26T06:13:51.468 INFO:teuthology.orchestra.run.smithi204.stdout:(1/174): ceph-19.0.0-1964.g7e98f5f6.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-03-26T06:13:51.613 INFO:teuthology.orchestra.run.smithi063.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 662 kB 00:00 2024-03-26T06:13:51.679 INFO:teuthology.orchestra.run.smithi063.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-03-26T06:13:51.713 INFO:teuthology.orchestra.run.smithi063.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 920 kB 00:00 2024-03-26T06:13:51.743 INFO:teuthology.orchestra.run.smithi204.stdout:(2/174): ceph-fuse-19.0.0-1964.g7e98f5f6.el9.x8 3.2 MB/s | 889 kB 00:00 2024-03-26T06:13:51.755 INFO:teuthology.orchestra.run.smithi063.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2024-03-26T06:13:51.780 INFO:teuthology.orchestra.run.smithi063.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 480 kB/s | 32 kB 00:00 2024-03-26T06:13:51.801 INFO:teuthology.orchestra.run.smithi204.stdout:(3/174): ceph-immutable-object-cache-19.0.0-196 2.5 MB/s | 145 kB 00:00 2024-03-26T06:13:51.889 INFO:teuthology.orchestra.run.smithi063.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 159 kB/s | 17 kB 00:00 2024-03-26T06:13:52.006 INFO:teuthology.orchestra.run.smithi063.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-03-26T06:13:52.031 INFO:teuthology.orchestra.run.smithi063.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 77 kB/s | 10 kB 00:00 2024-03-26T06:13:52.081 INFO:teuthology.orchestra.run.smithi063.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-03-26T06:13:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 592 kB/s | 44 kB 00:00 2024-03-26T06:13:52.143 INFO:teuthology.orchestra.run.smithi204.stdout:(4/174): ceph-base-19.0.0-1964.g7e98f5f6.el9.x8 5.9 MB/s | 5.4 MB 00:00 2024-03-26T06:13:52.157 INFO:teuthology.orchestra.run.smithi063.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 8.8 MB/s | 661 kB 00:00 2024-03-26T06:13:52.199 INFO:teuthology.orchestra.run.smithi063.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 578 kB 00:00 2024-03-26T06:13:52.224 INFO:teuthology.orchestra.run.smithi063.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 759 kB/s | 46 kB 00:00 2024-03-26T06:13:52.266 INFO:teuthology.orchestra.run.smithi063.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-03-26T06:13:52.277 INFO:teuthology.orchestra.run.smithi204.stdout:(5/174): ceph-mds-19.0.0-1964.g7e98f5f6.el9.x86 4.5 MB/s | 2.1 MB 00:00 2024-03-26T06:13:52.291 INFO:teuthology.orchestra.run.smithi063.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2024-03-26T06:13:52.325 INFO:teuthology.orchestra.run.smithi063.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.8 MB/s | 217 kB 00:00 2024-03-26T06:13:52.342 INFO:teuthology.orchestra.run.smithi063.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 689 kB/s | 34 kB 00:00 2024-03-26T06:13:52.369 INFO:teuthology.orchestra.run.smithi204.stdout:(6/174): ceph-mgr-19.0.0-1964.g7e98f5f6.el9.x86 6.6 MB/s | 1.5 MB 00:00 2024-03-26T06:13:52.851 INFO:teuthology.orchestra.run.smithi063.stdout:(56/174): ceph-test-19.0.0-1964.g7e98f5f6.el9.x 12 MB/s | 47 MB 00:04 2024-03-26T06:13:52.861 INFO:teuthology.orchestra.run.smithi204.stdout:(7/174): ceph-mon-19.0.0-1964.g7e98f5f6.el9.x86 8.0 MB/s | 4.7 MB 00:00 2024-03-26T06:13:52.992 INFO:teuthology.orchestra.run.smithi063.stdout:(57/174): protobuf-3.14.0-13.el9.x86_64.rpm 1.6 MB/s | 1.0 MB 00:00 2024-03-26T06:13:53.085 INFO:teuthology.orchestra.run.smithi063.stdout:(58/174): openblas-openmp-0.3.21-2.el9.x86_64.r 6.2 MB/s | 4.7 MB 00:00 2024-03-26T06:13:53.102 INFO:teuthology.orchestra.run.smithi063.stdout:(59/174): python3-attrs-20.3.0-7.el9.noarch.rpm 329 kB/s | 78 kB 00:00 2024-03-26T06:13:53.369 INFO:teuthology.orchestra.run.smithi063.stdout:(60/174): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2024-03-26T06:13:53.394 INFO:teuthology.orchestra.run.smithi063.stdout:(61/174): python3-jsonpointer-2.0-4.el9.noarch. 65 kB/s | 18 kB 00:00 2024-03-26T06:13:53.419 INFO:teuthology.orchestra.run.smithi063.stdout:(62/174): python3-jsonpatch-1.21-16.el9.noarch. 81 kB/s | 24 kB 00:00 2024-03-26T06:13:53.444 INFO:teuthology.orchestra.run.smithi063.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 648 kB/s | 32 kB 00:00 2024-03-26T06:13:53.469 INFO:teuthology.orchestra.run.smithi063.stdout:(64/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-26T06:13:53.637 INFO:teuthology.orchestra.run.smithi204.stdout:(8/174): ceph-osd-19.0.0-1964.g7e98f5f6.el9.x86 13 MB/s | 17 MB 00:01 2024-03-26T06:13:53.678 INFO:teuthology.orchestra.run.smithi204.stdout:(9/174): ceph-selinux-19.0.0-1964.g7e98f5f6.el9 620 kB/s | 25 kB 00:00 2024-03-26T06:13:53.753 INFO:teuthology.orchestra.run.smithi063.stdout:(65/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 4.8 MB 00:00 2024-03-26T06:13:53.787 INFO:teuthology.orchestra.run.smithi063.stdout:(66/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 640 kB/s | 217 kB 00:00 2024-03-26T06:13:53.812 INFO:teuthology.orchestra.run.smithi063.stdout:(67/174): python3-oauthlib-3.1.1-5.el9.noarch.r 521 kB/s | 174 kB 00:00 2024-03-26T06:13:53.837 INFO:teuthology.orchestra.run.smithi063.stdout:(68/174): python3-packaging-20.9-5.el9.noarch.r 865 kB/s | 69 kB 00:00 2024-03-26T06:13:53.862 INFO:teuthology.orchestra.run.smithi204.stdout:(10/174): ceph-radosgw-19.0.0-1964.g7e98f5f6.el 9.8 MB/s | 9.8 MB 00:00 2024-03-26T06:13:53.871 INFO:teuthology.orchestra.run.smithi063.stdout:(69/174): python3-prettytable-0.7.2-27.el9.noar 725 kB/s | 41 kB 00:00 2024-03-26T06:13:53.904 INFO:teuthology.orchestra.run.smithi063.stdout:(70/174): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 238 kB 00:00 2024-03-26T06:13:53.929 INFO:teuthology.orchestra.run.smithi204.stdout:(11/174): cephfs-mirror-19.0.0-1964.g7e98f5f6.e 3.3 MB/s | 219 kB 00:00 2024-03-26T06:13:53.929 INFO:teuthology.orchestra.run.smithi063.stdout:(71/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 132 kB 00:00 2024-03-26T06:13:53.963 INFO:teuthology.orchestra.run.smithi063.stdout:(72/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2024-03-26T06:13:53.979 INFO:teuthology.orchestra.run.smithi204.stdout:(12/174): cephfs-shell-19.0.0-1964.g7e98f5f6.el 546 kB/s | 27 kB 00:00 2024-03-26T06:13:53.997 INFO:teuthology.orchestra.run.smithi063.stdout:(73/174): python3-requests-oauthlib-1.3.0-12.el 671 kB/s | 43 kB 00:00 2024-03-26T06:13:54.022 INFO:teuthology.orchestra.run.smithi063.stdout:(74/174): python3-pytz-2021.1-5.el9.noarch.rpm 530 kB/s | 47 kB 00:00 2024-03-26T06:13:54.046 INFO:teuthology.orchestra.run.smithi204.stdout:(13/174): libcephfs-devel-19.0.0-1964.g7e98f5f6 473 kB/s | 31 kB 00:00 2024-03-26T06:13:54.163 INFO:teuthology.orchestra.run.smithi204.stdout:(14/174): libcephfs2-19.0.0-1964.g7e98f5f6.el9. 6.3 MB/s | 745 kB 00:00 2024-03-26T06:13:54.222 INFO:teuthology.orchestra.run.smithi204.stdout:(15/174): libcephsqlite-19.0.0-1964.g7e98f5f6.e 2.7 MB/s | 163 kB 00:00 2024-03-26T06:13:54.297 INFO:teuthology.orchestra.run.smithi204.stdout:(16/174): librados-devel-19.0.0-1964.g7e98f5f6. 1.7 MB/s | 127 kB 00:00 2024-03-26T06:13:54.406 INFO:teuthology.orchestra.run.smithi204.stdout:(17/174): libradosstriper1-19.0.0-1964.g7e98f5f 4.6 MB/s | 503 kB 00:00 2024-03-26T06:13:54.556 INFO:teuthology.orchestra.run.smithi063.stdout:(75/174): python3-toml-0.10.2-6.el9.noarch.rpm 69 kB/s | 39 kB 00:00 2024-03-26T06:13:54.781 INFO:teuthology.orchestra.run.smithi063.stdout:(76/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-03-26T06:13:54.806 INFO:teuthology.orchestra.run.smithi063.stdout:(77/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 53 kB/s | 41 kB 00:00 2024-03-26T06:13:54.840 INFO:teuthology.orchestra.run.smithi063.stdout:(78/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2024-03-26T06:13:54.865 INFO:teuthology.orchestra.run.smithi063.stdout:(79/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-03-26T06:13:54.890 INFO:teuthology.orchestra.run.smithi063.stdout:(80/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 785 kB/s | 63 kB 00:00 2024-03-26T06:13:54.916 INFO:teuthology.orchestra.run.smithi063.stdout:(81/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 592 kB/s | 44 kB 00:00 2024-03-26T06:13:54.923 INFO:teuthology.orchestra.run.smithi204.stdout:(18/174): librgw2-19.0.0-1964.g7e98f5f6.el9.x86 9.9 MB/s | 5.1 MB 00:00 2024-03-26T06:13:54.966 INFO:teuthology.orchestra.run.smithi063.stdout:(82/174): fuse-2.9.9-15.el9.x86_64.rpm 790 kB/s | 79 kB 00:00 2024-03-26T06:13:54.973 INFO:teuthology.orchestra.run.smithi204.stdout:(19/174): python3-ceph-argparse-19.0.0-1964.g7e 919 kB/s | 45 kB 00:00 2024-03-26T06:13:55.007 INFO:teuthology.orchestra.run.smithi063.stdout:(83/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 241 kB 00:00 2024-03-26T06:13:55.032 INFO:teuthology.orchestra.run.smithi204.stdout:(20/174): python3-ceph-common-19.0.0-1964.g7e98 2.2 MB/s | 131 kB 00:00 2024-03-26T06:13:55.050 INFO:teuthology.orchestra.run.smithi063.stdout:(84/174): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.1 MB 00:00 2024-03-26T06:13:55.075 INFO:teuthology.orchestra.run.smithi063.stdout:(85/174): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2024-03-26T06:13:55.100 INFO:teuthology.orchestra.run.smithi063.stdout:(86/174): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2024-03-26T06:13:55.107 INFO:teuthology.orchestra.run.smithi204.stdout:(21/174): python3-cephfs-19.0.0-1964.g7e98f5f6. 2.1 MB/s | 162 kB 00:00 2024-03-26T06:13:55.134 INFO:teuthology.orchestra.run.smithi063.stdout:(87/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 187 kB 00:00 2024-03-26T06:13:55.225 INFO:teuthology.orchestra.run.smithi204.stdout:(22/174): python3-rados-19.0.0-1964.g7e98f5f6.e 2.7 MB/s | 321 kB 00:00 2024-03-26T06:13:55.300 INFO:teuthology.orchestra.run.smithi204.stdout:(23/174): python3-rbd-19.0.0-1964.g7e98f5f6.el9 3.9 MB/s | 298 kB 00:00 2024-03-26T06:13:55.367 INFO:teuthology.orchestra.run.smithi204.stdout:(24/174): python3-rgw-19.0.0-1964.g7e98f5f6.el9 1.5 MB/s | 99 kB 00:00 2024-03-26T06:13:55.442 INFO:teuthology.orchestra.run.smithi204.stdout:(25/174): rbd-fuse-19.0.0-1964.g7e98f5f6.el9.x8 1.1 MB/s | 86 kB 00:00 2024-03-26T06:13:55.776 INFO:teuthology.orchestra.run.smithi063.stdout:(88/174): jq-1.6-16.el9.x86_64.rpm 278 kB/s | 187 kB 00:00 2024-03-26T06:13:55.809 INFO:teuthology.orchestra.run.smithi204.stdout:(26/174): rbd-mirror-19.0.0-1964.g7e98f5f6.el9. 8.4 MB/s | 3.1 MB 00:00 2024-03-26T06:13:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:(89/174): libquadmath-11.4.1-3.el9.x86_64.rpm 286 kB/s | 195 kB 00:00 2024-03-26T06:13:55.859 INFO:teuthology.orchestra.run.smithi204.stdout:(27/174): rbd-nbd-19.0.0-1964.g7e98f5f6.el9.x86 3.4 MB/s | 170 kB 00:00 2024-03-26T06:13:55.902 INFO:teuthology.orchestra.run.smithi063.stdout:(90/174): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-03-26T06:13:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:(91/174): elfutils-libelf-devel-0.190-2.el9.x86 216 kB/s | 21 kB 00:00 2024-03-26T06:13:55.944 INFO:teuthology.orchestra.run.smithi063.stdout:(92/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 617 kB/s | 25 kB 00:00 2024-03-26T06:13:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:(93/174): libgfortran-11.4.1-3.el9.x86_64.rpm 818 kB/s | 803 kB 00:00 2024-03-26T06:13:56.136 INFO:teuthology.orchestra.run.smithi063.stdout:(94/174): postgresql-13.14-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-03-26T06:13:56.178 INFO:teuthology.orchestra.run.smithi063.stdout:(95/174): postgresql-private-libs-13.14-1.el9.x 3.2 MB/s | 133 kB 00:00 2024-03-26T06:13:56.303 INFO:teuthology.orchestra.run.smithi063.stdout:(96/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 11 MB/s | 4.1 MB 00:00 2024-03-26T06:13:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:(97/174): postgresql-contrib-13.14-1.el9.x86_64 3.3 MB/s | 911 kB 00:00 2024-03-26T06:13:56.387 INFO:teuthology.orchestra.run.smithi063.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-03-26T06:13:56.401 INFO:teuthology.orchestra.run.smithi204.stdout:(28/174): ceph-test-19.0.0-1964.g7e98f5f6.el9.x 17 MB/s | 47 MB 00:02 2024-03-26T06:13:56.418 INFO:teuthology.orchestra.run.smithi204.stdout:(29/174): ceph-grafana-dashboards-19.0.0-1964.g 61 kB/s | 34 kB 00:00 2024-03-26T06:13:56.421 INFO:teuthology.orchestra.run.smithi063.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-03-26T06:13:56.446 INFO:teuthology.orchestra.run.smithi063.stdout:(100/174): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-03-26T06:13:56.452 INFO:teuthology.orchestra.run.smithi204.stdout:(30/174): ceph-mgr-cephadm-19.0.0-1964.g7e98f5f 2.8 MB/s | 139 kB 00:00 2024-03-26T06:13:56.471 INFO:teuthology.orchestra.run.smithi063.stdout:(101/174): qatlib-service-24.02.0-1.el9.x86_64. 726 kB/s | 36 kB 00:00 2024-03-26T06:13:56.496 INFO:teuthology.orchestra.run.smithi063.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 960 kB/s | 47 kB 00:00 2024-03-26T06:13:56.522 INFO:teuthology.orchestra.run.smithi063.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.9 MB/s | 94 kB 00:00 2024-03-26T06:13:56.564 INFO:teuthology.orchestra.run.smithi063.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 337 kB/s | 22 kB 00:00 2024-03-26T06:13:56.594 INFO:teuthology.orchestra.run.smithi204.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1964.g7e98f 10 MB/s | 1.8 MB 00:00 2024-03-26T06:13:56.622 INFO:teuthology.orchestra.run.smithi063.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 8.5 MB/s | 863 kB 00:00 2024-03-26T06:13:56.678 INFO:teuthology.orchestra.run.smithi204.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1964.g7e 2.9 MB/s | 248 kB 00:00 2024-03-26T06:13:56.744 INFO:teuthology.orchestra.run.smithi204.stdout:(33/174): ceph-mgr-rook-19.0.0-1964.g7e98f5f6.e 750 kB/s | 49 kB 00:00 2024-03-26T06:13:56.748 INFO:teuthology.orchestra.run.smithi063.stdout:(106/174): postgresql-server-13.14-1.el9.x86_64 10 MB/s | 5.8 MB 00:00 2024-03-26T06:13:56.903 INFO:teuthology.orchestra.run.smithi204.stdout:(34/174): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-03-26T06:13:56.928 INFO:teuthology.orchestra.run.smithi204.stdout:(35/174): ceph-prometheus-alerts-19.0.0-1964.g7 90 kB/s | 16 kB 00:00 2024-03-26T06:13:56.987 INFO:teuthology.orchestra.run.smithi204.stdout:(36/174): ceph-volume-19.0.0-1964.g7e98f5f6.el9 4.5 MB/s | 264 kB 00:00 2024-03-26T06:13:57.029 INFO:teuthology.orchestra.run.smithi204.stdout:(37/174): cephadm-19.0.0-1964.g7e98f5f6.el9.noa 7.4 MB/s | 749 kB 00:00 2024-03-26T06:13:57.046 INFO:teuthology.orchestra.run.smithi204.stdout:(38/174): cephfs-top-19.0.0-1964.g7e98f5f6.el9. 314 kB/s | 18 kB 00:00 2024-03-26T06:13:57.373 INFO:teuthology.orchestra.run.smithi063.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 38 kB/s | 19 kB 00:00 2024-03-26T06:13:57.430 INFO:teuthology.orchestra.run.smithi204.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 662 kB 00:00 2024-03-26T06:13:57.513 INFO:teuthology.orchestra.run.smithi204.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 1.9 MB/s | 920 kB 00:00 2024-03-26T06:13:57.539 INFO:teuthology.orchestra.run.smithi204.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 106 kB 00:00 2024-03-26T06:13:57.597 INFO:teuthology.orchestra.run.smithi204.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2024-03-26T06:13:57.607 INFO:teuthology.orchestra.run.smithi063.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 314 kB/s | 309 kB 00:00 2024-03-26T06:13:57.614 INFO:teuthology.orchestra.run.smithi204.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 424 kB/s | 32 kB 00:00 2024-03-26T06:13:57.657 INFO:teuthology.orchestra.run.smithi063.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 502 kB/s | 548 kB 00:01 2024-03-26T06:13:57.731 INFO:teuthology.orchestra.run.smithi204.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 147 kB/s | 17 kB 00:00 2024-03-26T06:13:57.765 INFO:teuthology.orchestra.run.smithi063.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 164 kB/s | 26 kB 00:00 2024-03-26T06:13:57.807 INFO:teuthology.orchestra.run.smithi063.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 325 kB/s | 49 kB 00:00 2024-03-26T06:13:57.882 INFO:teuthology.orchestra.run.smithi204.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-03-26T06:13:57.907 INFO:teuthology.orchestra.run.smithi204.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 59 kB/s | 10 kB 00:00 2024-03-26T06:13:57.941 INFO:teuthology.orchestra.run.smithi063.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 386 kB/s | 67 kB 00:00 2024-03-26T06:13:57.975 INFO:teuthology.orchestra.run.smithi063.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 908 kB/s | 151 kB 00:00 2024-03-26T06:13:57.982 INFO:teuthology.orchestra.run.smithi204.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 44 kB 00:00 2024-03-26T06:13:58.007 INFO:teuthology.orchestra.run.smithi204.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 159 kB 00:00 2024-03-26T06:13:58.066 INFO:teuthology.orchestra.run.smithi204.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.9 MB/s | 661 kB 00:00 2024-03-26T06:13:58.125 INFO:teuthology.orchestra.run.smithi204.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 578 kB 00:00 2024-03-26T06:13:58.158 INFO:teuthology.orchestra.run.smithi204.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 538 kB/s | 46 kB 00:00 2024-03-26T06:13:58.183 INFO:teuthology.orchestra.run.smithi063.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-03-26T06:13:58.192 INFO:teuthology.orchestra.run.smithi204.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-03-26T06:13:58.225 INFO:teuthology.orchestra.run.smithi204.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-26T06:13:58.259 INFO:teuthology.orchestra.run.smithi204.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2024-03-26T06:13:58.284 INFO:teuthology.orchestra.run.smithi204.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 606 kB/s | 34 kB 00:00 2024-03-26T06:13:58.292 INFO:teuthology.orchestra.run.smithi063.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 838 kB 00:00 2024-03-26T06:13:58.317 INFO:teuthology.orchestra.run.smithi063.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 326 kB/s | 43 kB 00:00 2024-03-26T06:13:58.443 INFO:teuthology.orchestra.run.smithi063.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 215 kB/s | 32 kB 00:00 2024-03-26T06:13:58.468 INFO:teuthology.orchestra.run.smithi063.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 100 kB/s | 15 kB 00:00 2024-03-26T06:13:58.493 INFO:teuthology.orchestra.run.smithi204.stdout:(56/174): protobuf-3.14.0-13.el9.x86_64.rpm 4.9 MB/s | 1.0 MB 00:00 2024-03-26T06:13:58.602 INFO:teuthology.orchestra.run.smithi204.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-03-26T06:13:58.610 INFO:teuthology.orchestra.run.smithi063.stdout:(119/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-03-26T06:13:58.627 INFO:teuthology.orchestra.run.smithi204.stdout:(58/174): python3-attrs-20.3.0-7.el9.noarch.rpm 593 kB/s | 78 kB 00:00 2024-03-26T06:13:58.643 INFO:teuthology.orchestra.run.smithi063.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 860 kB/s | 172 kB 00:00 2024-03-26T06:13:58.685 INFO:teuthology.orchestra.run.smithi063.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 1.6 MB/s | 358 kB 00:00 2024-03-26T06:13:58.803 INFO:teuthology.orchestra.run.smithi063.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 223 kB/s | 35 kB 00:00 2024-03-26T06:13:58.836 INFO:teuthology.orchestra.run.smithi063.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 1.3 MB/s | 203 kB 00:00 2024-03-26T06:13:58.911 INFO:teuthology.orchestra.run.smithi204.stdout:(59/174): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2024-03-26T06:13:58.936 INFO:teuthology.orchestra.run.smithi204.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 79 kB/s | 24 kB 00:00 2024-03-26T06:13:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-03-26T06:13:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:(61/174): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 144 kB 00:00 2024-03-26T06:13:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:(62/174): python3-jsonpointer-2.0-4.el9.noarch. 275 kB/s | 18 kB 00:00 2024-03-26T06:13:59.028 INFO:teuthology.orchestra.run.smithi063.stdout:(125/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 727 kB/s | 303 kB 00:00 2024-03-26T06:13:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 643 kB/s | 32 kB 00:00 2024-03-26T06:13:59.095 INFO:teuthology.orchestra.run.smithi063.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2024-03-26T06:13:59.162 INFO:teuthology.orchestra.run.smithi063.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 5.7 MB/s | 2.0 MB 00:00 2024-03-26T06:13:59.214 INFO:teuthology.orchestra.run.smithi063.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 96 kB/s | 18 kB 00:00 2024-03-26T06:13:59.238 INFO:teuthology.orchestra.run.smithi063.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 163 kB/s | 23 kB 00:00 2024-03-26T06:13:59.245 INFO:teuthology.orchestra.run.smithi204.stdout:(64/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-03-26T06:13:59.279 INFO:teuthology.orchestra.run.smithi204.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 884 kB/s | 217 kB 00:00 2024-03-26T06:13:59.280 INFO:teuthology.orchestra.run.smithi063.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2024-03-26T06:13:59.314 INFO:teuthology.orchestra.run.smithi204.stdout:(66/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2024-03-26T06:13:59.330 INFO:teuthology.orchestra.run.smithi063.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 170 kB/s | 20 kB 00:00 2024-03-26T06:13:59.338 INFO:teuthology.orchestra.run.smithi204.stdout:(67/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-03-26T06:13:59.371 INFO:teuthology.orchestra.run.smithi204.stdout:(68/174): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 41 kB 00:00 2024-03-26T06:13:59.413 INFO:teuthology.orchestra.run.smithi204.stdout:(69/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-26T06:13:59.414 INFO:teuthology.orchestra.run.smithi063.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 348 kB/s | 46 kB 00:00 2024-03-26T06:13:59.447 INFO:teuthology.orchestra.run.smithi204.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-26T06:13:59.472 INFO:teuthology.orchestra.run.smithi063.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2024-03-26T06:13:59.481 INFO:teuthology.orchestra.run.smithi204.stdout:(71/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-03-26T06:13:59.498 INFO:teuthology.orchestra.run.smithi063.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 473 kB/s | 79 kB 00:00 2024-03-26T06:13:59.506 INFO:teuthology.orchestra.run.smithi204.stdout:(72/174): python3-pytz-2021.1-5.el9.noarch.rpm 814 kB/s | 47 kB 00:00 2024-03-26T06:13:59.531 INFO:teuthology.orchestra.run.smithi204.stdout:(73/174): python3-requests-oauthlib-1.3.0-12.el 864 kB/s | 43 kB 00:00 2024-03-26T06:13:59.548 INFO:teuthology.orchestra.run.smithi063.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 432 kB/s | 58 kB 00:00 2024-03-26T06:13:59.657 INFO:teuthology.orchestra.run.smithi063.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-03-26T06:13:59.682 INFO:teuthology.orchestra.run.smithi063.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 89 kB/s | 16 kB 00:00 2024-03-26T06:13:59.707 INFO:teuthology.orchestra.run.smithi063.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 567 kB/s | 90 kB 00:00 2024-03-26T06:13:59.799 INFO:teuthology.orchestra.run.smithi063.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 199 kB/s | 28 kB 00:00 2024-03-26T06:13:59.824 INFO:teuthology.orchestra.run.smithi063.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 217 kB/s | 31 kB 00:00 2024-03-26T06:13:59.858 INFO:teuthology.orchestra.run.smithi063.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-03-26T06:13:59.873 INFO:teuthology.orchestra.run.smithi204.stdout:(74/174): python3-toml-0.10.2-6.el9.noarch.rpm 113 kB/s | 39 kB 00:00 2024-03-26T06:13:59.925 INFO:teuthology.orchestra.run.smithi063.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 474 kB/s | 59 kB 00:00 2024-03-26T06:13:59.950 INFO:teuthology.orchestra.run.smithi063.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 286 kB/s | 36 kB 00:00 2024-03-26T06:13:59.984 INFO:teuthology.orchestra.run.smithi063.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 407 kB/s | 51 kB 00:00 2024-03-26T06:14:00.076 INFO:teuthology.orchestra.run.smithi063.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-03-26T06:14:00.101 INFO:teuthology.orchestra.run.smithi063.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 598 kB/s | 90 kB 00:00 2024-03-26T06:14:00.143 INFO:teuthology.orchestra.run.smithi063.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-03-26T06:14:00.193 INFO:teuthology.orchestra.run.smithi063.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 172 kB/s | 20 kB 00:00 2024-03-26T06:14:00.224 INFO:teuthology.orchestra.run.smithi204.stdout:(75/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-03-26T06:14:00.227 INFO:teuthology.orchestra.run.smithi063.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-03-26T06:14:00.241 INFO:teuthology.orchestra.run.smithi204.stdout:(76/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 116 kB/s | 41 kB 00:00 2024-03-26T06:14:00.299 INFO:teuthology.orchestra.run.smithi204.stdout:(77/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 300 kB 00:00 2024-03-26T06:14:00.316 INFO:teuthology.orchestra.run.smithi204.stdout:(78/174): uuid-1.6.2-55.el9.x86_64.rpm 755 kB/s | 56 kB 00:00 2024-03-26T06:14:00.358 INFO:teuthology.orchestra.run.smithi204.stdout:(79/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-03-26T06:14:00.375 INFO:teuthology.orchestra.run.smithi204.stdout:(80/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 760 kB/s | 44 kB 00:00 2024-03-26T06:14:00.377 INFO:teuthology.orchestra.run.smithi063.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-03-26T06:14:00.417 INFO:teuthology.orchestra.run.smithi204.stdout:(81/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-26T06:14:00.451 INFO:teuthology.orchestra.run.smithi204.stdout:(82/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2024-03-26T06:14:00.453 INFO:teuthology.orchestra.run.smithi063.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.4 MB/s | 321 kB 00:00 2024-03-26T06:14:00.518 INFO:teuthology.orchestra.run.smithi204.stdout:(83/174): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-03-26T06:14:00.543 INFO:teuthology.orchestra.run.smithi204.stdout:(84/174): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-03-26T06:14:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:(85/174): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-03-26T06:14:00.570 INFO:teuthology.orchestra.run.smithi063.stdout:(152/174): librados2-19.0.0-1964.g7e98f5f6.el9. 9.0 MB/s | 3.4 MB 00:00 2024-03-26T06:14:00.602 INFO:teuthology.orchestra.run.smithi204.stdout:(86/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-03-26T06:14:00.737 INFO:teuthology.orchestra.run.smithi063.stdout:(153/174): librbd1-19.0.0-1964.g7e98f5f6.el9.x8 6.2 MB/s | 3.1 MB 00:00 2024-03-26T06:14:01.137 INFO:teuthology.orchestra.run.smithi063.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 105 kB/s | 42 kB 00:00 2024-03-26T06:14:01.302 INFO:teuthology.orchestra.run.smithi204.stdout:(87/174): jq-1.6-16.el9.x86_64.rpm 256 kB/s | 187 kB 00:00 2024-03-26T06:14:01.404 INFO:teuthology.orchestra.run.smithi063.stdout:(155/174): NetworkManager-1.47.2-1.el9.x86_64.r 2.4 MB/s | 2.3 MB 00:00 2024-03-26T06:14:01.463 INFO:teuthology.orchestra.run.smithi063.stdout:(156/174): NetworkManager-libnm-1.47.2-1.el9.x8 2.1 MB/s | 1.8 MB 00:00 2024-03-26T06:14:01.521 INFO:teuthology.orchestra.run.smithi063.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 612 kB/s | 71 kB 00:00 2024-03-26T06:14:01.588 INFO:teuthology.orchestra.run.smithi063.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 292 kB/s | 36 kB 00:00 2024-03-26T06:14:01.655 INFO:teuthology.orchestra.run.smithi063.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.4 MB/s | 192 kB 00:00 2024-03-26T06:14:01.722 INFO:teuthology.orchestra.run.smithi063.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-03-26T06:14:01.781 INFO:teuthology.orchestra.run.smithi063.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 185 kB/s | 23 kB 00:00 2024-03-26T06:14:01.848 INFO:teuthology.orchestra.run.smithi063.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 866 kB/s | 108 kB 00:00 2024-03-26T06:14:01.907 INFO:teuthology.orchestra.run.smithi063.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 155 kB 00:00 2024-03-26T06:14:01.949 INFO:teuthology.orchestra.run.smithi063.stdout:(164/174): NetworkManager-tui-1.47.2-1.el9.x86_ 306 kB/s | 248 kB 00:00 2024-03-26T06:14:01.974 INFO:teuthology.orchestra.run.smithi063.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-03-26T06:14:02.041 INFO:teuthology.orchestra.run.smithi063.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 479 kB/s | 64 kB 00:00 2024-03-26T06:14:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 230 kB/s | 29 kB 00:00 2024-03-26T06:14:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 7.3 MB/s | 1.2 MB 00:00 2024-03-26T06:14:02.283 INFO:teuthology.orchestra.run.smithi063.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 3.2 MB/s | 465 kB 00:00 2024-03-26T06:14:02.400 INFO:teuthology.orchestra.run.smithi063.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 6.0 MB/s | 2.2 MB 00:00 2024-03-26T06:14:02.425 INFO:teuthology.orchestra.run.smithi063.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 220 kB/s | 31 kB 00:00 2024-03-26T06:14:02.517 INFO:teuthology.orchestra.run.smithi063.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 817 kB/s | 74 kB 00:00 2024-03-26T06:14:02.615 INFO:teuthology.orchestra.run.smithi063.stdout:(173/174): util-linux-2.37.4-18.el9.x86_64.rpm 4.2 MB/s | 2.3 MB 00:00 2024-03-26T06:14:02.676 INFO:teuthology.orchestra.run.smithi063.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 3.9 MB/s | 1.1 MB 00:00 2024-03-26T06:14:02.691 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-26T06:14:02.691 INFO:teuthology.orchestra.run.smithi063.stdout:Total 13 MB/s | 223 MB 00:17 2024-03-26T06:14:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:(88/174): libquadmath-11.4.1-3.el9.x86_64.rpm 84 kB/s | 195 kB 00:02 2024-03-26T06:14:04.211 INFO:teuthology.orchestra.run.smithi204.stdout:(89/174): python3-requests-2.25.1-8.el9.noarch. 214 kB/s | 125 kB 00:00 2024-03-26T06:14:04.319 INFO:teuthology.orchestra.run.smithi204.stdout:(90/174): elfutils-libelf-devel-0.190-2.el9.x86 200 kB/s | 21 kB 00:00 2024-03-26T06:14:04.395 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-26T06:14:04.411 INFO:teuthology.orchestra.run.smithi204.stdout:(91/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 280 kB/s | 25 kB 00:00 2024-03-26T06:14:04.807 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-26T06:14:04.807 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-26T06:14:04.945 INFO:teuthology.orchestra.run.smithi204.stdout:(92/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 7.8 MB/s | 4.1 MB 00:00 2024-03-26T06:14:05.129 INFO:teuthology.orchestra.run.smithi204.stdout:(93/174): postgresql-13.14-1.el9.x86_64.rpm 8.7 MB/s | 1.6 MB 00:00 2024-03-26T06:14:05.287 INFO:teuthology.orchestra.run.smithi204.stdout:(94/174): postgresql-contrib-13.14-1.el9.x86_64 5.7 MB/s | 911 kB 00:00 2024-03-26T06:14:05.362 INFO:teuthology.orchestra.run.smithi204.stdout:(95/174): postgresql-private-libs-13.14-1.el9.x 1.8 MB/s | 133 kB 00:00 2024-03-26T06:14:05.746 INFO:teuthology.orchestra.run.smithi204.stdout:(96/174): postgresql-server-13.14-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-03-26T06:14:05.822 INFO:teuthology.orchestra.run.smithi204.stdout:(97/174): libgfortran-11.4.1-3.el9.x86_64.rpm 154 kB/s | 803 kB 00:05 2024-03-26T06:14:06.080 INFO:teuthology.orchestra.run.smithi204.stdout:(98/174): ceph-common-19.0.0-1964.g7e98f5f6.el9 1.3 MB/s | 20 MB 00:14 2024-03-26T06:14:06.114 INFO:teuthology.orchestra.run.smithi204.stdout:(99/174): python3-devel-3.9.17-2.el9.x86_64.rpm 670 kB/s | 245 kB 00:00 2024-03-26T06:14:06.164 INFO:teuthology.orchestra.run.smithi204.stdout:(100/174): qatlib-service-24.02.0-1.el9.x86_64. 728 kB/s | 36 kB 00:00 2024-03-26T06:14:06.197 INFO:teuthology.orchestra.run.smithi204.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 662 kB/s | 248 kB 00:00 2024-03-26T06:14:06.223 INFO:teuthology.orchestra.run.smithi204.stdout:(102/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-03-26T06:14:06.257 INFO:teuthology.orchestra.run.smithi204.stdout:(103/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 519 kB/s | 47 kB 00:00 2024-03-26T06:14:06.290 INFO:teuthology.orchestra.run.smithi204.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-03-26T06:14:06.349 INFO:teuthology.orchestra.run.smithi204.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-03-26T06:14:07.245 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-26T06:14:07.246 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-26T06:14:07.366 INFO:teuthology.orchestra.run.smithi204.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 304 kB/s | 309 kB 00:01 2024-03-26T06:14:07.499 INFO:teuthology.orchestra.run.smithi204.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 147 kB/s | 19 kB 00:00 2024-03-26T06:14:07.616 INFO:teuthology.orchestra.run.smithi204.stdout:(108/174): protobuf-compiler-3.14.0-13.el9.x86_ 635 kB/s | 863 kB 00:01 2024-03-26T06:14:07.758 INFO:teuthology.orchestra.run.smithi204.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 374 kB/s | 548 kB 00:01 2024-03-26T06:14:07.959 INFO:teuthology.orchestra.run.smithi204.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 371 kB/s | 49 kB 00:00 2024-03-26T06:14:08.101 INFO:teuthology.orchestra.run.smithi204.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 491 kB/s | 67 kB 00:00 2024-03-26T06:14:08.318 INFO:teuthology.orchestra.run.smithi204.stdout:(112/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 37 kB/s | 26 kB 00:00 2024-03-26T06:14:08.434 INFO:teuthology.orchestra.run.smithi204.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 454 kB/s | 151 kB 00:00 2024-03-26T06:14:09.243 INFO:teuthology.orchestra.run.smithi204.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 679 kB/s | 548 kB 00:00 2024-03-26T06:14:09.352 INFO:teuthology.orchestra.run.smithi204.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 403 kB/s | 43 kB 00:00 2024-03-26T06:14:09.485 INFO:teuthology.orchestra.run.smithi204.stdout:(116/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 718 kB/s | 838 kB 00:01 2024-03-26T06:14:09.512 INFO:teuthology.orchestra.run.smithi204.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 201 kB/s | 32 kB 00:00 2024-03-26T06:14:09.588 INFO:teuthology.orchestra.run.smithi204.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 147 kB/s | 15 kB 00:00 2024-03-26T06:14:09.796 INFO:teuthology.orchestra.run.smithi204.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 607 kB/s | 172 kB 00:00 2024-03-26T06:14:10.130 INFO:teuthology.orchestra.run.smithi204.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 662 kB/s | 358 kB 00:00 2024-03-26T06:14:10.256 INFO:teuthology.orchestra.run.smithi204.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 283 kB/s | 35 kB 00:00 2024-03-26T06:14:10.281 INFO:teuthology.orchestra.run.smithi204.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 626 kB/s | 303 kB 00:00 2024-03-26T06:14:10.540 INFO:teuthology.orchestra.run.smithi204.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 716 kB/s | 203 kB 00:00 2024-03-26T06:14:10.851 INFO:teuthology.orchestra.run.smithi204.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 469 kB/s | 144 kB 00:00 2024-03-26T06:14:10.974 INFO:teuthology.orchestra.run.smithi204.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2024-03-26T06:14:11.099 INFO:teuthology.orchestra.run.smithi204.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 142 kB/s | 18 kB 00:00 2024-03-26T06:14:11.208 INFO:teuthology.orchestra.run.smithi204.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 214 kB/s | 23 kB 00:00 2024-03-26T06:14:11.317 INFO:teuthology.orchestra.run.smithi204.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 180 kB/s | 19 kB 00:00 2024-03-26T06:14:11.425 INFO:teuthology.orchestra.run.smithi204.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-03-26T06:14:12.859 INFO:teuthology.orchestra.run.smithi204.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 729 kB/s | 1.0 MB 00:01 2024-03-26T06:14:13.001 INFO:teuthology.orchestra.run.smithi204.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 330 kB/s | 46 kB 00:00 2024-03-26T06:14:13.118 INFO:teuthology.orchestra.run.smithi204.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 679 kB/s | 79 kB 00:00 2024-03-26T06:14:13.177 INFO:teuthology.orchestra.run.smithi204.stdout:(133/174): python3-grpcio-1.46.7-10.el9.x86_64. 721 kB/s | 2.0 MB 00:02 2024-03-26T06:14:13.252 INFO:teuthology.orchestra.run.smithi204.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 435 kB/s | 58 kB 00:00 2024-03-26T06:14:13.360 INFO:teuthology.orchestra.run.smithi204.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2024-03-26T06:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 695 kB/s | 272 kB 00:00 2024-03-26T06:14:13.594 INFO:teuthology.orchestra.run.smithi204.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 386 kB/s | 90 kB 00:00 2024-03-26T06:14:13.695 INFO:teuthology.orchestra.run.smithi204.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 226 kB/s | 28 kB 00:00 2024-03-26T06:14:13.728 INFO:teuthology.orchestra.run.smithi204.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 231 kB/s | 31 kB 00:00 2024-03-26T06:14:13.845 INFO:teuthology.orchestra.run.smithi204.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 509 kB/s | 59 kB 00:00 2024-03-26T06:14:13.962 INFO:teuthology.orchestra.run.smithi204.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 308 kB/s | 36 kB 00:00 2024-03-26T06:14:13.987 INFO:teuthology.orchestra.run.smithi204.stdout:(142/174): python3-routes-2.5.1-5.el9.noarch.rp 646 kB/s | 188 kB 00:00 2024-03-26T06:14:14.105 INFO:teuthology.orchestra.run.smithi204.stdout:(143/174): libarrow-9.0.0-10.el9.x86_64.rpm 685 kB/s | 4.4 MB 00:06 2024-03-26T06:14:14.130 INFO:teuthology.orchestra.run.smithi204.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 306 kB/s | 51 kB 00:00 2024-03-26T06:14:14.305 INFO:teuthology.orchestra.run.smithi204.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 449 kB/s | 90 kB 00:00 2024-03-26T06:14:14.330 INFO:teuthology.orchestra.run.smithi204.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 671 kB/s | 230 kB 00:00 2024-03-26T06:14:14.447 INFO:teuthology.orchestra.run.smithi204.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 141 kB/s | 20 kB 00:00 2024-03-26T06:14:14.673 INFO:teuthology.orchestra.run.smithi204.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 561 kB/s | 192 kB 00:00 2024-03-26T06:14:14.807 INFO:teuthology.orchestra.run.smithi204.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 632 kB/s | 427 kB 00:00 2024-03-26T06:14:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-26T06:14:14.982 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-26T06:14:14.998 INFO:teuthology.orchestra.run.smithi204.stdout:(150/174): librados2-19.0.0-1964.g7e98f5f6.el9. 10 MB/s | 3.4 MB 00:00 2024-03-26T06:14:15.049 INFO:teuthology.orchestra.run.smithi204.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2024-03-26T06:14:15.053 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-26T06:14:15.091 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-26T06:14:15.136 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-26T06:14:15.182 INFO:teuthology.orchestra.run.smithi204.stdout:(152/174): librbd1-19.0.0-1964.g7e98f5f6.el9.x8 8.4 MB/s | 3.1 MB 00:00 2024-03-26T06:14:15.223 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-26T06:14:15.343 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-26T06:14:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-26T06:14:15.468 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-26T06:14:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-26T06:14:16.073 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-26T06:14:16.112 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 10/198 2024-03-26T06:14:16.281 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 10/198 2024-03-26T06:14:16.314 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 11/198 2024-03-26T06:14:16.437 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 11/198 2024-03-26T06:14:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:19.0.0-1964.g7e98f5f6.el9.x86_64 12/198 2024-03-26T06:14:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-26T06:14:16.691 INFO:teuthology.orchestra.run.smithi204.stdout:(153/174): thrift-0.15.0-2.el9.x86_64.rpm 722 kB/s | 1.6 MB 00:02 2024-03-26T06:14:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-26T06:14:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-26T06:14:16.935 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:19.0.0-1964.g7e98f5f6.el9.x86_64 16/198 2024-03-26T06:14:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1964.g7e98f5f6.el9.x86_64 16/198 2024-03-26T06:14:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:19.0.0-1964.g7e98f5f6.el9.x86 17/198 2024-03-26T06:14:17.253 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1964.g7e98f5f6.el9.x86 17/198 2024-03-26T06:14:17.298 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-26T06:14:17.338 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-26T06:14:17.402 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-26T06:14:17.729 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-26T06:14:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-26T06:14:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-26T06:14:17.950 INFO:teuthology.orchestra.run.smithi204.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 33 kB/s | 42 kB 00:01 2024-03-26T06:14:18.136 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-26T06:14:18.345 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-26T06:14:18.441 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-26T06:14:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-26T06:14:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-26T06:14:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-26T06:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-26T06:14:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-26T06:14:19.754 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-26T06:14:19.796 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-26T06:14:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-26T06:14:20.036 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-26T06:14:20.107 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-26T06:14:20.164 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-26T06:14:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-26T06:14:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-26T06:14:20.404 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-26T06:14:20.450 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-26T06:14:20.497 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-26T06:14:20.621 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-26T06:14:20.695 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:19.0.0-1964.g7e98f5f6.el9. 39/198 2024-03-26T06:14:20.761 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:19.0.0-1964.g7e98f5f6.el 40/198 2024-03-26T06:14:20.808 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:19.0.0-1964.g7e98f5f6.el9.x86_6 41/198 2024-03-26T06:14:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-26T06:14:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-26T06:14:21.119 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-26T06:14:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-26T06:14:21.371 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-26T06:14:22.008 INFO:teuthology.orchestra.run.smithi204.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 61 kB/s | 248 kB 00:04 2024-03-26T06:14:22.085 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-26T06:14:22.190 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-26T06:14:22.315 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-26T06:14:22.394 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-26T06:14:22.425 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-26T06:14:22.468 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-26T06:14:22.536 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-26T06:14:22.592 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_6 53/198 2024-03-26T06:14:22.634 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-26T06:14:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-26T06:14:23.363 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-26T06:14:23.449 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-26T06:14:23.513 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-26T06:14:23.723 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-26T06:14:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-26T06:14:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-26T06:14:23.990 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-26T06:14:24.028 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-26T06:14:24.069 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-26T06:14:24.142 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-26T06:14:24.193 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-26T06:14:24.257 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-26T06:14:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-26T06:14:24.537 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-26T06:14:24.597 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-26T06:14:24.636 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-26T06:14:24.694 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-26T06:14:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-26T06:14:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-26T06:14:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-26T06:14:24.996 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-26T06:14:25.034 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-26T06:14:25.222 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-26T06:14:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-26T06:14:25.548 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-26T06:14:25.599 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-26T06:14:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-26T06:14:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-26T06:14:25.966 INFO:teuthology.orchestra.run.smithi204.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 18 kB/s | 71 kB 00:03 2024-03-26T06:14:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-26T06:14:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-26T06:14:26.227 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-26T06:14:26.309 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-26T06:14:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-26T06:14:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-26T06:14:26.425 INFO:teuthology.orchestra.run.smithi204.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 80 kB/s | 36 kB 00:00 2024-03-26T06:14:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-26T06:14:26.479 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-26T06:14:26.546 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-26T06:14:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-26T06:14:26.651 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-26T06:14:26.826 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-26T06:14:26.879 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-26T06:14:26.922 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-26T06:14:26.992 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-26T06:14:27.034 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-26T06:14:27.187 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-26T06:14:27.313 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-26T06:14:27.363 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-26T06:14:27.407 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-26T06:14:27.408 INFO:teuthology.orchestra.run.smithi204.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 196 kB/s | 192 kB 00:00 2024-03-26T06:14:27.469 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-26T06:14:27.620 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-26T06:14:27.690 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-26T06:14:27.874 INFO:teuthology.orchestra.run.smithi204.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 550 kB/s | 256 kB 00:00 2024-03-26T06:14:27.959 INFO:teuthology.orchestra.run.smithi204.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 274 kB/s | 23 kB 00:00 2024-03-26T06:14:28.117 INFO:teuthology.orchestra.run.smithi204.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 686 kB/s | 108 kB 00:00 2024-03-26T06:14:28.259 INFO:teuthology.orchestra.run.smithi204.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 155 kB 00:00 2024-03-26T06:14:28.446 INFO:teuthology.orchestra.run.smithi204.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 729 kB/s | 136 kB 00:00 2024-03-26T06:14:28.538 INFO:teuthology.orchestra.run.smithi204.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 702 kB/s | 64 kB 00:00 2024-03-26T06:14:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 347 kB/s | 29 kB 00:00 2024-03-26T06:14:28.695 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-26T06:14:28.756 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-26T06:14:28.798 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-26T06:14:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-26T06:14:28.997 INFO:teuthology.orchestra.run.smithi204.stdout:(166/174): NetworkManager-libnm-1.47.2-1.el9.x8 136 kB/s | 1.8 MB 00:13 2024-03-26T06:14:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-26T06:14:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-26T06:14:29.304 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-26T06:14:29.335 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-26T06:14:29.339 INFO:teuthology.orchestra.run.smithi204.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2024-03-26T06:14:29.440 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-26T06:14:29.573 INFO:teuthology.orchestra.run.smithi204.stdout:(168/174): NetworkManager-1.47.2-1.el9.x86_64.r 163 kB/s | 2.3 MB 00:14 2024-03-26T06:14:30.198 INFO:teuthology.orchestra.run.smithi204.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 2.7 MB/s | 2.3 MB 00:00 2024-03-26T06:14:30.231 INFO:teuthology.orchestra.run.smithi204.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 707 kB/s | 465 kB 00:00 2024-03-26T06:14:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-26T06:14:30.282 INFO:teuthology.orchestra.run.smithi204.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 373 kB/s | 31 kB 00:00 2024-03-26T06:14:30.351 INFO:teuthology.orchestra.run.smithi204.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 74 kB 00:00 2024-03-26T06:14:30.410 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-26T06:14:30.543 INFO:teuthology.orchestra.run.smithi204.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 3.5 MB/s | 1.1 MB 00:00 2024-03-26T06:14:31.518 INFO:teuthology.orchestra.run.smithi204.stdout:(174/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 876 kB/s | 2.2 MB 00:02 2024-03-26T06:14:31.528 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-03-26T06:14:31.529 INFO:teuthology.orchestra.run.smithi204.stdout:Total 5.4 MB/s | 223 MB 00:41 2024-03-26T06:14:32.003 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-26T06:14:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-26T06:14:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-26T06:14:32.166 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-26T06:14:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-26T06:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-26T06:14:32.671 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 124/198 2024-03-26T06:14:32.795 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 124/198 2024-03-26T06:14:32.829 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 125/198 2024-03-26T06:14:32.889 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-26T06:14:33.170 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-03-26T06:14:33.442 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-26T06:14:33.507 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 128/198 2024-03-26T06:14:33.552 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-03-26T06:14:33.552 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-03-26T06:14:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 128/198 2024-03-26T06:14:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 129/198 2024-03-26T06:14:36.005 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-03-26T06:14:36.005 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-03-26T06:14:36.294 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 130/198 2024-03-26T06:14:36.339 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 130/198 2024-03-26T06:14:37.020 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 130/198 2024-03-26T06:14:37.134 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:19.0.0-1964.g7e98f5f6.el9.x86_64 131/198 2024-03-26T06:14:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:19.0.0-1964.g7e98f5f6.el9.x86_64 131/198 2024-03-26T06:14:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-26T06:14:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-26T06:14:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:37.452 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:19.0.0-1964.g7e98f5f6.el9.x86_64 132/198 2024-03-26T06:14:43.322 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-03-26T06:14:43.475 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-26T06:14:43.540 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-26T06:14:43.603 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-26T06:14:43.647 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-26T06:14:43.767 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-26T06:14:43.893 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-26T06:14:43.985 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-26T06:14:44.027 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-26T06:14:44.158 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-26T06:14:44.622 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-26T06:14:44.701 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 10/198 2024-03-26T06:14:44.854 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 10/198 2024-03-26T06:14:44.910 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 11/198 2024-03-26T06:14:45.036 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 11/198 2024-03-26T06:14:45.084 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:19.0.0-1964.g7e98f5f6.el9.x86_64 12/198 2024-03-26T06:14:45.187 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-26T06:14:45.522 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-26T06:14:45.581 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-26T06:14:45.606 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephsqlite-2:19.0.0-1964.g7e98f5f6.el9.x86_64 16/198 2024-03-26T06:14:45.740 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1964.g7e98f5f6.el9.x86_64 16/198 2024-03-26T06:14:45.783 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:19.0.0-1964.g7e98f5f6.el9.x86 17/198 2024-03-26T06:14:45.873 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1964.g7e98f5f6.el9.x86 17/198 2024-03-26T06:14:45.944 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-26T06:14:45.977 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-26T06:14:46.039 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-26T06:14:46.374 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-26T06:14:46.419 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-26T06:14:46.468 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-26T06:14:46.804 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-26T06:14:46.985 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-26T06:14:47.098 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-26T06:14:47.285 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-26T06:14:47.346 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-26T06:14:47.688 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-26T06:14:47.872 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-26T06:14:48.003 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-26T06:14:48.043 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-26T06:14:48.079 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-26T06:14:48.139 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-26T06:14:48.250 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-26T06:14:48.318 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-26T06:14:48.368 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-26T06:14:48.458 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-26T06:14:48.507 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-26T06:14:48.577 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-26T06:14:48.621 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-26T06:14:48.653 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-26T06:14:48.766 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-26T06:14:48.806 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:19.0.0-1964.g7e98f5f6.el9. 39/198 2024-03-26T06:14:48.882 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:19.0.0-1964.g7e98f5f6.el 40/198 2024-03-26T06:14:48.923 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:19.0.0-1964.g7e98f5f6.el9.x86_6 41/198 2024-03-26T06:14:49.046 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-26T06:14:49.111 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-26T06:14:49.220 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-26T06:14:49.405 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-26T06:14:49.470 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-26T06:14:50.172 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-26T06:14:50.633 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-26T06:14:50.633 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-26T06:14:50.633 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-26T06:14:50.633 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-26T06:14:50.633 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-26T06:14:50.633 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-26T06:14:50.634 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_6 53/198 2024-03-26T06:14:50.658 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-26T06:14:50.787 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1964.g7e98f5f6.el9.x86_64 132/198 2024-03-26T06:14:50.787 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-03-26T06:14:50.787 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-03-26T06:14:50.787 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-03-26T06:14:50.787 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-03-26T06:14:50.787 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-03-26T06:14:50.787 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-03-26T06:14:50.787 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-03-26T06:14:50.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:51.015 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:19.0.0-1964.g7e98f5f6.el9.noarch 133/198 2024-03-26T06:14:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:19.0.0-1964.g7e98f5f6.el9.noarch 133/198 2024-03-26T06:14:51.061 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:14:51.061 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-26T06:14:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:51.062 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-26T06:14:51.288 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-26T06:14:51.365 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-26T06:14:51.425 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-26T06:14:51.633 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-26T06:14:51.687 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-26T06:14:51.766 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-26T06:14:51.892 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-26T06:14:51.945 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-26T06:14:51.987 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-26T06:14:52.057 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-26T06:14:52.102 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-26T06:14:52.165 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-26T06:14:52.233 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-26T06:14:52.431 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-26T06:14:52.483 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-26T06:14:52.528 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-26T06:14:52.577 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-26T06:14:52.706 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-26T06:14:52.744 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-26T06:14:52.749 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 134/198 2024-03-26T06:14:52.789 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-26T06:14:52.847 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 134/198 2024-03-26T06:14:52.847 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:14:52.847 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-26T06:14:52.847 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T06:14:52.847 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T06:14:52.847 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:52.852 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-26T06:14:52.885 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-26T06:14:53.043 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-26T06:14:53.091 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:19.0.0-1964.g7e98f5f6.el9.x86_64 135/198 2024-03-26T06:14:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:19.0.0-1964.g7e98f5f6.el9.x86_64 135/198 2024-03-26T06:14:53.170 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:14:53.170 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-26T06:14:53.170 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T06:14:53.170 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T06:14:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:53.219 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-26T06:14:53.354 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-26T06:14:53.408 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-26T06:14:53.470 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-26T06:14:53.543 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-26T06:14:53.684 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:19.0.0-1964.g7e98f5f6.el9.x86_64 136/198 2024-03-26T06:14:53.765 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:19.0.0-1964.g7e98f5f6.el9.x86_64 136/198 2024-03-26T06:14:53.765 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:14:53.765 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-26T06:14:53.766 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T06:14:53.766 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T06:14:53.766 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:53.784 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-26T06:14:53.846 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-26T06:14:53.894 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-26T06:14:54.028 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-26T06:14:54.076 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-26T06:14:54.116 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-26T06:14:54.147 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-26T06:14:54.187 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-26T06:14:54.232 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-26T06:14:54.290 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-26T06:14:54.341 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-26T06:14:54.391 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-26T06:14:54.524 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 138/198 2024-03-26T06:14:54.547 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-26T06:14:54.562 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 138/198 2024-03-26T06:14:54.614 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1964.g7e98f5f6.e 139/198 2024-03-26T06:14:54.717 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1964.g7e98f5f6. 140/198 2024-03-26T06:14:54.758 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1964.g7e98f5f6.el9.noa 141/198 2024-03-26T06:14:54.877 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-26T06:14:54.929 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-26T06:14:54.996 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-26T06:14:55.036 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-26T06:14:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1964.g7e98f5f6.el9.noa 141/198 2024-03-26T06:14:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1964.g7e98f5f6.el9.n 142/198 2024-03-26T06:14:55.182 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-26T06:14:55.301 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-26T06:14:55.356 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-26T06:14:55.400 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-26T06:14:55.457 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-26T06:14:55.597 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-26T06:14:55.666 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-26T06:14:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1964.g7e98f5f6.el9.n 142/198 2024-03-26T06:14:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1964.g7e9 143/198 2024-03-26T06:14:56.508 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1964.g7e9 143/198 2024-03-26T06:14:56.626 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-26T06:14:56.691 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-26T06:14:56.698 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1964.g7e98f5f6.el 144/198 2024-03-26T06:14:56.724 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-26T06:14:56.737 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:19.0.0-1964.g7e98f5f6.el9.x86_64 145/198 2024-03-26T06:14:56.784 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-26T06:14:56.834 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1964.g7e98f5f6.el9.x86_64 145/198 2024-03-26T06:14:56.835 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:14:56.835 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-26T06:14:56.835 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T06:14:56.835 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T06:14:56.835 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:19.0.0-1964.g7e98f5f6.el9.noarch 146/198 2024-03-26T06:14:56.902 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-26T06:14:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1964.g7e98f5f6.el9.noarch 146/198 2024-03-26T06:14:56.950 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-26T06:14:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:19.0.0-1964.g7e98f5f6.el9.x86_64 147/198 2024-03-26T06:14:57.186 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-26T06:14:57.214 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-26T06:14:57.310 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-26T06:14:58.047 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-26T06:14:58.111 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-26T06:14:58.112 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 149/198 2024-03-26T06:14:58.211 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 149/198 2024-03-26T06:14:58.211 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:14:58.211 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-26T06:14:58.211 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T06:14:58.211 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T06:14:58.211 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-26T06:14:58.266 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1964.g7e98f 150/198 2024-03-26T06:14:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1964.g7e98f 150/198 2024-03-26T06:14:58.365 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:14:58.365 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-26T06:14:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 151/198 2024-03-26T06:14:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 151/198 2024-03-26T06:14:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:14:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-26T06:14:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-26T06:14:58.531 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-26T06:14:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:58.917 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 152/198 2024-03-26T06:14:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 152/198 2024-03-26T06:14:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:14:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-26T06:14:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T06:14:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T06:14:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:14:59.772 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-26T06:14:59.860 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-26T06:14:59.898 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-26T06:14:59.929 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-26T06:14:59.969 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-26T06:15:00.350 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-26T06:15:00.384 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 124/198 2024-03-26T06:15:00.505 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 124/198 2024-03-26T06:15:00.541 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 125/198 2024-03-26T06:15:00.595 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-26T06:15:01.129 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-26T06:15:01.163 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 128/198 2024-03-26T06:15:01.237 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 128/198 2024-03-26T06:15:01.265 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 129/198 2024-03-26T06:15:03.816 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 130/198 2024-03-26T06:15:03.854 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 130/198 2024-03-26T06:15:04.082 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:19.0.0-1964.g7e98f5f6.el9.x86_64 153/198 2024-03-26T06:15:04.129 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 154/198 2024-03-26T06:15:04.163 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 155/198 2024-03-26T06:15:04.201 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-26T06:15:04.473 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 130/198 2024-03-26T06:15:04.503 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-shell-2:19.0.0-1964.g7e98f5f6.el9.x86_64 157/198 2024-03-26T06:15:04.515 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:19.0.0-1964.g7e98f5f6.el9.x86_64 131/198 2024-03-26T06:15:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-26T06:15:04.664 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:19.0.0-1964.g7e98f5f6.el9.x86_64 131/198 2024-03-26T06:15:04.664 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-26T06:15:04.665 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-26T06:15:04.665 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:04.681 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 159/198 2024-03-26T06:15:04.708 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:19.0.0-1964.g7e98f5f6.el9.x86_64 132/198 2024-03-26T06:15:04.743 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-26T06:15:04.813 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-26T06:15:04.867 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-26T06:15:04.903 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_ 163/198 2024-03-26T06:15:04.981 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-26T06:15:05.032 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-26T06:15:05.119 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-26T06:15:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-26T06:15:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-26T06:15:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-26T06:15:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-26T06:15:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-26T06:15:07.779 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-top-2:19.0.0-1964.g7e98f5f6.el9.noarch 170/198 2024-03-26T06:15:07.874 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-26T06:15:07.950 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-26T06:15:08.094 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-26T06:15:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-26T06:15:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-26T06:15:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-26T06:15:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-26T06:15:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-26T06:15:08.416 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-26T06:15:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-26T06:15:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-26T06:15:08.620 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-26T06:15:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-26T06:15:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-26T06:15:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-26T06:15:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-26T06:15:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-26T06:15:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-26T06:15:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-26T06:15:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-26T06:15:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-26T06:15:09.113 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-26T06:15:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-26T06:15:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-26T06:15:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-26T06:15:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-26T06:15:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-26T06:15:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-26T06:15:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-26T06:15:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-26T06:15:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-26T06:15:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-26T06:15:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-26T06:15:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-26T06:15:10.260 INFO:teuthology.orchestra.run.smithi063.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-26T06:15:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:15.321 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:19.0.0-1964.g7e98f5f6.el9.x86_64 1/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 3/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 4/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1964.g7e98f 5/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:19.0.0-1964.g7e98f5f6.el9.x86_64 6/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:19.0.0-1964.g7e98f5f6.el9.x86_64 7/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:19.0.0-1964.g7e98f5f6.el9.x86_64 8/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 9/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 10/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:19.0.0-1964.g7e98f5f6.el9.x86_64 11/198 2024-03-26T06:15:15.322 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:19.0.0-1964.g7e98f5f6.el9.x86_64 12/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 13/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-shell-2:19.0.0-1964.g7e98f5f6.el9.x86_64 14/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_ 15/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 16/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:19.0.0-1964.g7e98f5f6.el9.x86_64 17/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_6 18/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:19.0.0-1964.g7e98f5f6.el9.x86 19/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 20/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1964.g7e98f5f6.el 21/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:19.0.0-1964.g7e98f5f6.el9. 22/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:19.0.0-1964.g7e98f5f6.el9.x86_6 23/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:19.0.0-1964.g7e98f5f6.el9.x86_64 24/198 2024-03-26T06:15:15.323 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 25/198 2024-03-26T06:15:15.324 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 26/198 2024-03-26T06:15:15.324 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 27/198 2024-03-26T06:15:15.324 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 28/198 2024-03-26T06:15:15.324 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 29/198 2024-03-26T06:15:15.345 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1964.g7e98f5f6. 30/198 2024-03-26T06:15:15.345 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1964.g7e98f5f6.el9.noa 31/198 2024-03-26T06:15:15.345 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1964.g7e98f5f6.el9.n 32/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1964.g7e9 33/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1964.g7e98f5f6.el 34/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1964.g7e98f5f6.el9.noarch 35/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1964.g7e98f5f6.e 36/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:19.0.0-1964.g7e98f5f6.el9.noarch 37/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 38/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-top-2:19.0.0-1964.g7e98f5f6.el9.noarch 39/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-26T06:15:15.346 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-26T06:15:15.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-26T06:15:15.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-26T06:15:15.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-26T06:15:15.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-26T06:15:15.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-26T06:15:15.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-26T06:15:15.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-26T06:15:15.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-26T06:15:15.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-26T06:15:15.348 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-26T06:15:15.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-26T06:15:15.350 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-26T06:15:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-26T06:15:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-26T06:15:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-26T06:15:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-26T06:15:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-26T06:15:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-26T06:15:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-26T06:15:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-26T06:15:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-26T06:15:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-26T06:15:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-26T06:15:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-26T06:15:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-26T06:15:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-26T06:15:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-26T06:15:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-26T06:15:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-26T06:15:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-26T06:15:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-26T06:15:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-26T06:15:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-26T06:15:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-26T06:15:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-26T06:15:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-26T06:15:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-26T06:15:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 151/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 153/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-26T06:15:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-26T06:15:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-26T06:15:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-26T06:15:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-26T06:15:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-26T06:15:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-26T06:15:17.855 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1964.g7e98f5f6.el9.x86_64 132/198 2024-03-26T06:15:17.855 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2024-03-26T06:15:17.855 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2024-03-26T06:15:17.855 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2024-03-26T06:15:17.855 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2024-03-26T06:15:17.855 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2024-03-26T06:15:17.855 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /root 2024-03-26T06:15:17.855 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2024-03-26T06:15:17.855 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:17.864 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-26T06:15:17.864 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:17.864 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-03-26T06:15:17.864 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-26T06:15:17.864 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: acl-2.3.1-4.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-26T06:15:17.865 INFO:teuthology.orchestra.run.smithi063.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-26T06:15:17.866 INFO:teuthology.orchestra.run.smithi063.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: automake-1.16.2-8.el9.noarch 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: bison-3.7.4-5.el9.x86_64 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.867 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.868 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: flex-2.6.4-9.el9.x86_64 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-26T06:15:17.869 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-26T06:15:17.870 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-26T06:15:17.870 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-26T06:15:17.870 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-26T06:15:17.870 INFO:teuthology.orchestra.run.smithi063.stdout: jq-1.6-16.el9.x86_64 2024-03-26T06:15:17.870 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-26T06:15:17.870 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-26T06:15:17.870 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-26T06:15:17.870 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.870 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-26T06:15:17.871 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: lua-5.4.4-4.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-13.14-1.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-26T06:15:17.872 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-26T06:15:17.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-26T06:15:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-03-26T06:15:17.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-26T06:15:17.876 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-26T06:15:17.877 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-3.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-26T06:15:17.878 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-26T06:15:17.879 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-26T06:15:17.879 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:17.879 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-26T06:15:18.091 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-volume-2:19.0.0-1964.g7e98f5f6.el9.noarch 133/198 2024-03-26T06:15:18.137 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-volume-2:19.0.0-1964.g7e98f5f6.el9.noarch 133/198 2024-03-26T06:15:18.137 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:15:18.138 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-26T06:15:18.138 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:18.553 DEBUG:teuthology.parallel:result is None 2024-03-26T06:15:19.802 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 134/198 2024-03-26T06:15:19.905 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 134/198 2024-03-26T06:15:19.905 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:15:19.905 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-26T06:15:19.905 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T06:15:19.905 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T06:15:19.905 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:20.143 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:19.0.0-1964.g7e98f5f6.el9.x86_64 135/198 2024-03-26T06:15:20.237 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:19.0.0-1964.g7e98f5f6.el9.x86_64 135/198 2024-03-26T06:15:20.237 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:15:20.237 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-26T06:15:20.237 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T06:15:20.237 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T06:15:20.238 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:20.728 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:19.0.0-1964.g7e98f5f6.el9.x86_64 136/198 2024-03-26T06:15:20.821 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:19.0.0-1964.g7e98f5f6.el9.x86_64 136/198 2024-03-26T06:15:20.821 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:15:20.821 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-26T06:15:20.821 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T06:15:20.821 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T06:15:20.821 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:20.938 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-26T06:15:21.518 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 138/198 2024-03-26T06:15:21.556 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 138/198 2024-03-26T06:15:21.607 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1964.g7e98f5f6.e 139/198 2024-03-26T06:15:21.707 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1964.g7e98f5f6. 140/198 2024-03-26T06:15:21.735 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1964.g7e98f5f6.el9.noa 141/198 2024-03-26T06:15:22.068 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1964.g7e98f5f6.el9.noa 141/198 2024-03-26T06:15:22.104 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1964.g7e98f5f6.el9.n 142/198 2024-03-26T06:15:23.233 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1964.g7e98f5f6.el9.n 142/198 2024-03-26T06:15:23.272 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1964.g7e9 143/198 2024-03-26T06:15:23.417 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1964.g7e9 143/198 2024-03-26T06:15:23.585 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1964.g7e98f5f6.el 144/198 2024-03-26T06:15:23.624 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:19.0.0-1964.g7e98f5f6.el9.x86_64 145/198 2024-03-26T06:15:23.692 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1964.g7e98f5f6.el9.x86_64 145/198 2024-03-26T06:15:23.692 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:15:23.692 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-26T06:15:23.692 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T06:15:23.692 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T06:15:23.692 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:23.749 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:19.0.0-1964.g7e98f5f6.el9.noarch 146/198 2024-03-26T06:15:23.788 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1964.g7e98f5f6.el9.noarch 146/198 2024-03-26T06:15:23.869 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:19.0.0-1964.g7e98f5f6.el9.x86_64 147/198 2024-03-26T06:15:24.854 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-26T06:15:24.893 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 149/198 2024-03-26T06:15:24.987 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 149/198 2024-03-26T06:15:24.987 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:15:24.987 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-26T06:15:24.987 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T06:15:24.987 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T06:15:24.987 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:25.044 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1964.g7e98f 150/198 2024-03-26T06:15:25.140 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1964.g7e98f 150/198 2024-03-26T06:15:25.141 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:15:25.141 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-26T06:15:25.141 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:25.220 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 151/198 2024-03-26T06:15:25.322 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 151/198 2024-03-26T06:15:25.322 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:15:25.323 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-26T06:15:25.323 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-26T06:15:25.323 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-26T06:15:25.323 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:25.729 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 152/198 2024-03-26T06:15:25.797 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 152/198 2024-03-26T06:15:25.797 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T06:15:25.797 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-26T06:15:25.797 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T06:15:25.797 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T06:15:25.797 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:30.594 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:19.0.0-1964.g7e98f5f6.el9.x86_64 153/198 2024-03-26T06:15:30.646 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 154/198 2024-03-26T06:15:30.683 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 155/198 2024-03-26T06:15:30.721 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-26T06:15:30.977 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-shell-2:19.0.0-1964.g7e98f5f6.el9.x86_64 157/198 2024-03-26T06:15:31.112 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-26T06:15:31.159 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 159/198 2024-03-26T06:15:31.211 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-26T06:15:31.267 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-26T06:15:31.312 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-26T06:15:31.346 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_ 163/198 2024-03-26T06:15:31.392 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-26T06:15:31.454 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-26T06:15:31.561 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-26T06:15:31.665 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-26T06:15:31.694 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-26T06:15:32.560 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-26T06:15:32.608 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-26T06:15:32.663 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-26T06:15:34.026 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-top-2:19.0.0-1964.g7e98f5f6.el9.noarch 170/198 2024-03-26T06:15:34.122 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-26T06:15:34.179 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-26T06:15:34.323 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-26T06:15:34.366 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-26T06:15:34.399 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-26T06:15:34.434 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-26T06:15:34.476 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-26T06:15:34.476 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-26T06:15:34.647 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-26T06:15:34.688 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-26T06:15:34.689 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-26T06:15:34.801 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-26T06:15:34.854 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-26T06:15:34.909 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-26T06:15:34.967 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-26T06:15:34.999 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-26T06:15:35.068 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-26T06:15:35.147 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-26T06:15:35.204 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-26T06:15:35.237 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-26T06:15:35.271 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-26T06:15:35.305 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-26T06:15:35.338 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-26T06:15:35.374 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-26T06:15:35.375 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-26T06:15:35.704 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-26T06:15:35.705 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-26T06:15:35.827 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-26T06:15:35.866 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-26T06:15:35.928 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-26T06:15:35.961 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-26T06:15:36.001 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-26T06:15:36.120 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-26T06:15:36.371 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-26T06:15:36.372 INFO:teuthology.orchestra.run.smithi204.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-26T06:15:36.372 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:41.305 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:19.0.0-1964.g7e98f5f6.el9.x86_64 1/198 2024-03-26T06:15:41.305 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2/198 2024-03-26T06:15:41.305 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 3/198 2024-03-26T06:15:41.305 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 4/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1964.g7e98f 5/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:19.0.0-1964.g7e98f5f6.el9.x86_64 6/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:19.0.0-1964.g7e98f5f6.el9.x86_64 7/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:19.0.0-1964.g7e98f5f6.el9.x86_64 8/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 9/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 10/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:19.0.0-1964.g7e98f5f6.el9.x86_64 11/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:19.0.0-1964.g7e98f5f6.el9.x86_64 12/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 13/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-shell-2:19.0.0-1964.g7e98f5f6.el9.x86_64 14/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_ 15/198 2024-03-26T06:15:41.306 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 16/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephsqlite-2:19.0.0-1964.g7e98f5f6.el9.x86_64 17/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_6 18/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:19.0.0-1964.g7e98f5f6.el9.x86 19/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 20/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1964.g7e98f5f6.el 21/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:19.0.0-1964.g7e98f5f6.el9. 22/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:19.0.0-1964.g7e98f5f6.el9.x86_6 23/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:19.0.0-1964.g7e98f5f6.el9.x86_64 24/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 25/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 26/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 27/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 28/198 2024-03-26T06:15:41.307 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 29/198 2024-03-26T06:15:41.325 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1964.g7e98f5f6. 30/198 2024-03-26T06:15:41.325 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1964.g7e98f5f6.el9.noa 31/198 2024-03-26T06:15:41.325 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1964.g7e98f5f6.el9.n 32/198 2024-03-26T06:15:41.325 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1964.g7e9 33/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1964.g7e98f5f6.el 34/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1964.g7e98f5f6.el9.noarch 35/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1964.g7e98f5f6.e 36/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-volume-2:19.0.0-1964.g7e98f5f6.el9.noarch 37/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 38/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-top-2:19.0.0-1964.g7e98f5f6.el9.noarch 39/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-26T06:15:41.326 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-26T06:15:41.327 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-26T06:15:41.327 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-26T06:15:41.329 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-26T06:15:41.329 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-26T06:15:41.329 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-26T06:15:41.329 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-26T06:15:41.330 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-26T06:15:41.331 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-26T06:15:41.332 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-26T06:15:41.333 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-26T06:15:41.334 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-26T06:15:41.335 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-26T06:15:41.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-26T06:15:41.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 151/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 153/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-26T06:15:41.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-26T06:15:41.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-26T06:15:41.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-26T06:15:41.341 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-26T06:15:41.341 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-26T06:15:41.341 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-26T06:15:41.341 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-26T06:15:41.341 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-26T06:15:41.341 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-26T06:15:41.341 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-26T06:15:41.341 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-26T06:15:41.341 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout: acl-2.3.1-4.el9.x86_64 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-26T06:15:43.843 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-26T06:15:43.844 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: automake-1.16.2-8.el9.noarch 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: bison-3.7.4-5.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.845 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-shell-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top-2:19.0.0-1964.g7e98f5f6.el9.noarch 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: flex-2.6.4-9.el9.x86_64 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-26T06:15:43.847 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: jq-1.6-16.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-26T06:15:43.848 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: lua-5.4.4-4.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-26T06:15:43.849 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-26T06:15:43.850 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-26T06:15:43.850 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-26T06:15:43.850 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-26T06:15:43.850 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-26T06:15:43.850 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-13.14-1.el9.x86_64 2024-03-26T06:15:43.850 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-26T06:15:43.850 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-26T06:15:43.850 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-26T06:15:43.850 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-26T06:15:43.851 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-26T06:15:43.852 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-26T06:15:43.853 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply-3.11-14.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-26T06:15:43.854 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-26T06:15:43.855 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:19.0.0-1964.g7e98f5f6.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: re2-1:20211101-3.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-26T06:15:43.856 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-26T06:15:43.857 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-26T06:15:43.857 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:43.857 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-03-26T06:15:44.517 DEBUG:teuthology.parallel:result is None 2024-03-26T06:15:44.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7e98f5f6b535defc7fa715b456904ffc0500aa9f 2024-03-26T06:15:44.666 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-26T06:15:44.740 INFO:teuthology.orchestra.run.smithi063.stdout:19.0.0-1964.g7e98f5f6.el9 2024-03-26T06:15:44.740 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1964.g7e98f5f6.el9 2024-03-26T06:15:44.741 INFO:teuthology.task.install:The correct ceph version 19.0.0-1964.g7e98f5f6 is installed. 2024-03-26T06:15:44.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7e98f5f6b535defc7fa715b456904ffc0500aa9f 2024-03-26T06:15:44.884 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-26T06:15:44.941 INFO:teuthology.orchestra.run.smithi204.stdout:19.0.0-1964.g7e98f5f6.el9 2024-03-26T06:15:44.941 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1964.g7e98f5f6.el9 2024-03-26T06:15:44.941 INFO:teuthology.task.install:The correct ceph version 19.0.0-1964.g7e98f5f6 is installed. 2024-03-26T06:15:44.943 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-26T06:15:44.943 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:44.943 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-26T06:15:45.056 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:15:45.056 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-26T06:15:45.136 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-26T06:15:45.136 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:45.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-03-26T06:15:45.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-26T06:15:45.344 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:15:45.345 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-03-26T06:15:45.418 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-26T06:15:45.532 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-26T06:15:45.533 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:45.533 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-26T06:15:45.634 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-26T06:15:45.778 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:15:45.779 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-26T06:15:45.854 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-26T06:15:45.964 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-26T06:15:45.964 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:45.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-03-26T06:15:46.073 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-26T06:15:46.176 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:15:46.177 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-03-26T06:15:46.248 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-26T06:15:46.359 INFO:teuthology.run_tasks:Running task ceph... 2024-03-26T06:15:46.446 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-26T06:15:46.446 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-03-26T06:15:46.454 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-03-26T06:15:46.547 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-26T06:15:46.547 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-26T06:15:46.554 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-26T06:15:46.650 INFO:tasks.ceph:Creating extra log directories... 2024-03-26T06:15:46.650 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-26T06:15:46.655 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-26T06:15:46.755 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-26T06:15:46.755 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-26T06:15:46.755 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-26T06:15:46.755 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:46.755 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-26T06:15:46.809 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-26T06:15:47.086 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-26T06:15:47.189 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:15:47.189 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-26T06:15:47.230 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-26T06:15:47.431 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-26T06:15:47.509 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-26T06:15:47.509 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-26T06:15:47.510 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi/7622744', 'branch': 'rishabh-2024mar8-2', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7622744', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2024mar8-2'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2024mar8-2', 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1249, 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f', 'sleep_before_teardown': 0, 'subset': '481/512', 'suite': 'fs', 'suite_branch': 'rishabh-2024mar8-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3015ah+uS/GErHoW8pWDjsu0nZqjp03VNveGmFnF7o/acjBvnzYr0lW/QVToeCMrmQfqfDhbXR+2Ok4F5BV3o=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHhmeHk6Fn3xkDkzVCnMhzCOWRt2U88GoUWBUTHmSPtekX/MihhFYoOL1xZGXkZEM94XjMHYy2QkVdFllqy8atw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '7e98f5f6b535defc7fa715b456904ffc0500aa9f', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-26_05:47:39', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-26T06:15:47.510 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-26T06:15:47.519 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-26T06:15:47.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-03-26T06:15:47.583 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-03-26T06:15:47.680 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:47.681 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-03-26T06:15:47.741 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-26T06:15:47.741 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-03-26T06:15:47.797 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-26T06:15:47.797 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T06:15:47.797 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 632 Links: 1 2024-03-26T06:15:47.797 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T06:15:47.797 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T06:15:47.798 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-03-26 06:15:10.753595787 +0000 2024-03-26T06:15:47.798 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-03-26 06:12:24.162163599 +0000 2024-03-26T06:15:47.798 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-03-26 06:12:24.162163599 +0000 2024-03-26T06:15:47.798 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-03-26 06:12:24.162163599 +0000 2024-03-26T06:15:47.798 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-26T06:15:47.896 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-03-26T06:15:47.896 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-03-26T06:15:47.896 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000362013 s, 1.4 MB/s 2024-03-26T06:15:47.900 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-26T06:15:47.957 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-03-26T06:15:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-26T06:15:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T06:15:48.005 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-26T06:15:48.005 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T06:15:48.005 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T06:15:48.005 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-03-26 06:15:10.755595766 +0000 2024-03-26T06:15:48.005 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-03-26 06:12:24.749157676 +0000 2024-03-26T06:15:48.005 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-03-26 06:12:24.749157676 +0000 2024-03-26T06:15:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-03-26 06:12:24.749157676 +0000 2024-03-26T06:15:48.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-26T06:15:48.086 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-03-26T06:15:48.087 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-03-26T06:15:48.087 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000466971 s, 1.1 MB/s 2024-03-26T06:15:48.091 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-26T06:15:48.146 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-03-26T06:15:48.196 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-26T06:15:48.196 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T06:15:48.197 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-26T06:15:48.197 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T06:15:48.197 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T06:15:48.197 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-03-26 06:15:10.755595766 +0000 2024-03-26T06:15:48.197 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-03-26 06:12:25.353151581 +0000 2024-03-26T06:15:48.197 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-03-26 06:12:25.353151581 +0000 2024-03-26T06:15:48.197 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-03-26 06:12:25.353151581 +0000 2024-03-26T06:15:48.197 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-26T06:15:48.287 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-03-26T06:15:48.287 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-03-26T06:15:48.288 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.00030676 s, 1.7 MB/s 2024-03-26T06:15:48.291 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-26T06:15:48.354 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-03-26T06:15:48.409 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-26T06:15:48.409 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T06:15:48.409 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-03-26T06:15:48.409 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T06:15:48.409 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T06:15:48.409 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-03-26 06:15:10.756595756 +0000 2024-03-26T06:15:48.409 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-03-26 06:12:25.943145628 +0000 2024-03-26T06:15:48.409 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-03-26 06:12:25.943145628 +0000 2024-03-26T06:15:48.410 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-03-26 06:12:25.943145628 +0000 2024-03-26T06:15:48.410 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-26T06:15:48.507 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-03-26T06:15:48.508 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-03-26T06:15:48.508 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000309362 s, 1.7 MB/s 2024-03-26T06:15:48.512 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-26T06:15:48.569 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-26T06:15:48.570 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:15:48.570 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2024-03-26T06:15:48.627 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-26T06:15:48.628 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2024-03-26T06:15:48.677 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-26T06:15:48.678 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T06:15:48.678 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-03-26T06:15:48.678 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T06:15:48.678 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T06:15:48.678 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-26 06:15:36.786797757 +0000 2024-03-26T06:15:48.678 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-26 06:12:13.007524730 +0000 2024-03-26T06:15:48.678 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-26 06:12:13.007524730 +0000 2024-03-26T06:15:48.678 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-03-26 06:12:13.007524730 +0000 2024-03-26T06:15:48.678 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-26T06:15:48.758 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-26T06:15:48.758 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-26T06:15:48.758 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000367398 s, 1.4 MB/s 2024-03-26T06:15:48.762 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-26T06:15:48.816 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2024-03-26T06:15:48.863 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-26T06:15:48.863 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T06:15:48.863 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-26T06:15:48.864 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T06:15:48.864 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T06:15:48.864 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-26 06:15:36.787797743 +0000 2024-03-26T06:15:48.864 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-26 06:12:13.585516564 +0000 2024-03-26T06:15:48.864 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-26 06:12:13.585516564 +0000 2024-03-26T06:15:48.864 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-03-26 06:12:13.585516564 +0000 2024-03-26T06:15:48.864 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-26T06:15:48.949 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-26T06:15:48.949 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-26T06:15:48.949 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000340583 s, 1.5 MB/s 2024-03-26T06:15:48.952 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-26T06:15:49.004 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2024-03-26T06:15:49.054 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-26T06:15:49.054 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T06:15:49.054 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-26T06:15:49.054 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T06:15:49.054 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T06:15:49.054 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-26 06:15:36.788797729 +0000 2024-03-26T06:15:49.054 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-26 06:12:14.136508780 +0000 2024-03-26T06:15:49.054 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-26 06:12:14.136508780 +0000 2024-03-26T06:15:49.055 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-03-26 06:12:14.136508780 +0000 2024-03-26T06:15:49.055 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-26T06:15:49.134 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-26T06:15:49.134 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-26T06:15:49.134 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000420862 s, 1.2 MB/s 2024-03-26T06:15:49.138 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-26T06:15:49.191 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2024-03-26T06:15:49.235 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-26T06:15:49.235 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T06:15:49.235 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-03-26T06:15:49.235 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T06:15:49.235 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T06:15:49.235 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-26 06:15:36.789797714 +0000 2024-03-26T06:15:49.235 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-26 06:12:14.714500615 +0000 2024-03-26T06:15:49.235 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-26 06:12:14.714500615 +0000 2024-03-26T06:15:49.235 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-03-26 06:12:14.714500615 +0000 2024-03-26T06:15:49.236 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-26T06:15:49.368 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-26T06:15:49.368 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-26T06:15:49.368 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.00033175 s, 1.5 MB/s 2024-03-26T06:15:49.373 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-26T06:15:49.426 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-26T06:15:49.426 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-26T06:15:49.427 INFO:tasks.ceph:Generating config... 2024-03-26T06:15:49.451 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-26T06:15:49.452 INFO:tasks.ceph:[client] debug client = 20 2024-03-26T06:15:49.452 INFO:tasks.ceph:[client] debug ms = 1 2024-03-26T06:15:49.452 INFO:tasks.ceph:[client] pid file = 2024-03-26T06:15:49.452 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-26T06:15:49.452 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-26T06:15:49.452 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-26T06:15:49.452 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-26T06:15:49.452 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-26T06:15:49.452 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-26T06:15:49.452 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-26T06:15:49.452 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-26T06:15:49.452 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-26T06:15:49.452 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-26T06:15:49.453 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-26T06:15:49.453 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-26T06:15:49.453 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-26T06:15:49.453 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-26T06:15:49.453 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-26T06:15:49.453 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-26T06:15:49.453 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-26T06:15:49.453 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-26T06:15:49.453 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-26T06:15:49.453 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-26T06:15:49.453 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-26T06:15:49.453 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-26T06:15:49.453 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-26T06:15:49.453 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-26T06:15:49.454 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-26T06:15:49.454 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-26T06:15:49.454 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-26T06:15:49.454 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-26T06:15:49.454 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-26T06:15:49.454 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-26T06:15:49.454 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-26T06:15:49.454 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-26T06:15:49.454 INFO:tasks.ceph:Setting up mon.a... 2024-03-26T06:15:49.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-26T06:15:49.610 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2024-03-26T06:15:49.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-26T06:15:49.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-26T06:15:49.855 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '172.21.15.204'), ('mon.c', '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]')] 2024-03-26T06:15:49.855 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-26T06:15:49.856 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:49.856 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-26T06:15:49.911 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --add b 172.21.15.204 --addv c '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:15:50.070 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:15:50.070 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 82863fce-9065-4f8e-a61f-944fd870ef74 2024-03-26T06:15:50.070 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 82863fce-9065-4f8e-a61f-944fd870ef74 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2024-03-26T06:15:50.070963+0000 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-03-26T06:15:50.070963+0000 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 17 (quincy) 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] mon.c 2024-03-26T06:15:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-26T06:15:50.074 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-26T06:15:50.125 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 82863fce-9065-4f8e-a61f-944fd870ef74... 2024-03-26T06:15:50.126 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-26T06:15:50.131 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-26T06:15:50.303 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-03-26T06:15:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-03-26T06:15:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-03-26T06:15:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on skipped message = False 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 82863fce-9065-4f8e-a61f-944fd870ef74 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-03-26T06:15:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-03-26T06:15:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-26T06:15:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-03-26T06:15:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-03-26T06:15:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2024-03-26T06:15:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: rados mon op timeout = 900 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: rados osd op timeout = 900 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-03-26T06:15:50.313 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds balancer = 20 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2024-03-26T06:15:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: rados mon op timeout = 900 2024-03-26T06:15:50.315 INFO:teuthology.orchestra.run.smithi063.stdout: rados osd op timeout = 900 2024-03-26T06:15:50.315 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-03-26T06:15:50.315 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-03-26T06:15:50.315 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-26T06:15:50.315 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-03-26T06:15:50.315 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.315 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-03-26T06:15:50.315 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.315 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.316 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-26T06:15:50.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.63,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on skipped message = False 2024-03-26T06:15:50.318 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 82863fce-9065-4f8e-a61f-944fd870ef74 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-03-26T06:15:50.319 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 20 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 20 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 10 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-03-26T06:15:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-03-26T06:15:50.322 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-03-26T06:15:50.322 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.322 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-03-26T06:15:50.322 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-26T06:15:50.322 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-03-26T06:15:50.322 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-03-26T06:15:50.322 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-03-26T06:15:50.322 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-03-26T06:15:50.322 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-03-26T06:15:50.323 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-26T06:15:50.324 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = "" 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-03-26T06:15:50.325 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds balancer = 20 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-03-26T06:15:50.326 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-03-26T06:15:50.352 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-26T06:15:50.352 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-26T06:15:50.503 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-26T06:15:50.503 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:50.503 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-26T06:15:50.559 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:50.559 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-26T06:15:50.612 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T06:15:50.613 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:50.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-26T06:15:50.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-26T06:15:50.768 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:15:50.768 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:15:50.869 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T06:15:50.869 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:15:50.869 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-26T06:15:50.869 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-26T06:15:51.020 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:15:51.020 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:15:51.117 INFO:tasks.ceph:Setting up mon nodes... 2024-03-26T06:15:51.118 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-26T06:15:51.118 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-26T06:15:51.317 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-26T06:15:51.328 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-26T06:15:51.503 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-26T06:15:51.513 INFO:tasks.ceph:Setting up mds nodes... 2024-03-26T06:15:51.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-26T06:15:51.709 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-26T06:15:51.719 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-26T06:15:51.822 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-26T06:15:52.018 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-26T06:15:52.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-26T06:15:52.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-26T06:15:52.303 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-26T06:15:52.312 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-26T06:15:52.405 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-26T06:15:52.585 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-26T06:15:52.594 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-26T06:15:52.685 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-26T06:15:52.686 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-26T06:15:52.824 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-26T06:15:52.887 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-26T06:15:53.019 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-26T06:15:53.078 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-26T06:15:53.208 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-26T06:15:53.263 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-26T06:15:53.387 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-26T06:15:53.436 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-26T06:15:53.436 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-26T06:15:53.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-26T06:15:53.542 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-26T06:15:53.542 INFO:tasks.ceph:role: osd.0 2024-03-26T06:15:53.542 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T06:15:53.542 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-26T06:15:53.650 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-26T06:15:53.650 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-26T06:15:53.650 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-26T06:15:53.650 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-26T06:15:53.650 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-26T06:15:53.651 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-03-26T06:15:53.651 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-26T06:15:53.651 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-26T06:15:53.651 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-26T06:15:53.651 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-26T06:15:54.164 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-03-26T06:15:54.173 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-03-26T06:15:54.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-26T06:15:54.367 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-26T06:15:54.477 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-26T06:15:54.562 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-26T06:15:54.562 INFO:tasks.ceph:role: osd.1 2024-03-26T06:15:54.562 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T06:15:54.562 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-26T06:15:54.656 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-26T06:15:54.656 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-26T06:15:54.656 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-26T06:15:54.656 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-26T06:15:54.656 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-26T06:15:54.657 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-03-26T06:15:54.657 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-26T06:15:54.657 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-26T06:15:54.657 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-26T06:15:54.657 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-26T06:15:55.136 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-03-26T06:15:55.142 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-03-26T06:15:55.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-26T06:15:55.272 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-26T06:15:55.367 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-26T06:15:55.462 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-26T06:15:55.462 INFO:tasks.ceph:role: osd.2 2024-03-26T06:15:55.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T06:15:55.462 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-26T06:15:55.553 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-26T06:15:55.553 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-26T06:15:55.553 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-26T06:15:55.553 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-26T06:15:55.553 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-26T06:15:55.553 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-03-26T06:15:55.553 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-26T06:15:55.553 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-26T06:15:55.554 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-26T06:15:55.554 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-26T06:15:56.058 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-03-26T06:15:56.064 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-03-26T06:15:56.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-26T06:15:56.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-26T06:15:56.352 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-26T06:15:56.446 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-26T06:15:56.446 INFO:tasks.ceph:role: osd.3 2024-03-26T06:15:56.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T06:15:56.446 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-26T06:15:56.548 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-26T06:15:56.549 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-26T06:15:56.549 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-26T06:15:56.549 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-26T06:15:56.549 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-26T06:15:56.549 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-03-26T06:15:56.549 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-26T06:15:56.549 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-26T06:15:56.549 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-26T06:15:56.549 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-26T06:15:57.005 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-03-26T06:15:57.011 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-03-26T06:15:57.011 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-26T06:15:57.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-26T06:15:57.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:15:57.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:15:57.397+0000 7fa3fdc0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-26T06:15:57.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:15:57.398+0000 7fa3fdc0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-26T06:15:57.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:15:57.398+0000 7fa3fdc0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-26T06:15:57.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:15:57.398+0000 7fa3fdc0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-26T06:15:57.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:15:57.398+0000 7fa3fdc0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-26T06:15:57.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:15:57.403+0000 7fa3fdc0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-26T06:16:00.339 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-26T06:16:00.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:16:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:00.590+0000 7fc42768b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-26T06:16:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:00.591+0000 7fc42768b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-26T06:16:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:00.591+0000 7fc42768b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-26T06:16:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:00.591+0000 7fc42768b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-26T06:16:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:00.591+0000 7fc42768b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-26T06:16:00.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:00.594+0000 7fc42768b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-26T06:16:03.790 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-26T06:16:03.890 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:16:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:04.040+0000 7f3dc6e21640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-26T06:16:04.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:04.041+0000 7f3dc6e21640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-26T06:16:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:04.041+0000 7f3dc6e21640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-26T06:16:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:04.041+0000 7f3dc6e21640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-26T06:16:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:04.041+0000 7f3dc6e21640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-26T06:16:04.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:04.043+0000 7f3dc6e21640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-26T06:16:06.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-26T06:16:07.077 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:16:07.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:07.217+0000 7f6813b19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-26T06:16:07.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:07.218+0000 7f6813b19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-26T06:16:07.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:07.218+0000 7f6813b19640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-26T06:16:07.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:07.218+0000 7f6813b19640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-26T06:16:07.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:07.218+0000 7f6813b19640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-26T06:16:07.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:07.221+0000 7f6813b19640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-26T06:16:10.145 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-26T06:16:10.244 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-26T06:16:10.343 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-26T06:16:10.343 INFO:tasks.ceph:role: osd.4 2024-03-26T06:16:10.343 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T06:16:10.343 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-26T06:16:10.443 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-26T06:16:10.444 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-26T06:16:10.444 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-26T06:16:10.444 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-26T06:16:10.444 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-26T06:16:10.444 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-26T06:16:10.444 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-26T06:16:10.444 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-26T06:16:10.444 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-26T06:16:10.444 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-26T06:16:10.966 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-26T06:16:10.975 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-26T06:16:10.975 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-26T06:16:11.170 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-26T06:16:11.281 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-26T06:16:11.364 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-26T06:16:11.364 INFO:tasks.ceph:role: osd.5 2024-03-26T06:16:11.364 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T06:16:11.365 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-26T06:16:11.451 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-26T06:16:11.452 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-26T06:16:11.452 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-26T06:16:11.452 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-26T06:16:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-26T06:16:11.452 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-26T06:16:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-26T06:16:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-26T06:16:11.452 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-26T06:16:11.452 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-26T06:16:11.941 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-26T06:16:11.947 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-26T06:16:11.948 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-26T06:16:12.079 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-26T06:16:12.162 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-26T06:16:12.239 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-26T06:16:12.239 INFO:tasks.ceph:role: osd.6 2024-03-26T06:16:12.239 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T06:16:12.239 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-26T06:16:12.318 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-26T06:16:12.318 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-26T06:16:12.319 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-26T06:16:12.319 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-26T06:16:12.319 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-26T06:16:12.319 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-26T06:16:12.319 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-26T06:16:12.319 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-26T06:16:12.319 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-26T06:16:12.319 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-26T06:16:12.832 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-26T06:16:12.838 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-26T06:16:12.838 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-26T06:16:13.039 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-26T06:16:13.144 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-26T06:16:13.232 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-26T06:16:13.232 INFO:tasks.ceph:role: osd.7 2024-03-26T06:16:13.232 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T06:16:13.232 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-26T06:16:13.325 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-26T06:16:13.325 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-26T06:16:13.325 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-26T06:16:13.325 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-26T06:16:13.326 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-26T06:16:13.326 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-26T06:16:13.326 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-26T06:16:13.326 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-26T06:16:13.326 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-26T06:16:13.326 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-26T06:16:13.770 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-26T06:16:13.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-26T06:16:13.777 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-26T06:16:13.918 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-26T06:16:14.005 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:16:14.147 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:14.147+0000 7f0fa820c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-26T06:16:14.151 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:14.150+0000 7f0fa820c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-26T06:16:14.151 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:14.150+0000 7f0fa820c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-26T06:16:14.151 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:14.150+0000 7f0fa820c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-26T06:16:14.151 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:14.150+0000 7f0fa820c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-26T06:16:14.155 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:14.154+0000 7f0fa820c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-26T06:16:17.330 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-26T06:16:17.425 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:16:17.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:16:17.519 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:16:17.556 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:17.555+0000 7f790240e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-26T06:16:17.556 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:17.556+0000 7f790240e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-26T06:16:17.556 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:17.556+0000 7f790240e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-26T06:16:17.557 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:17.556+0000 7f790240e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-26T06:16:17.557 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:17.556+0000 7f790240e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-26T06:16:17.558 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:17.558+0000 7f790240e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-26T06:16:20.469 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-26T06:16:20.565 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:16:20.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:20.700+0000 7fc2795bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-26T06:16:20.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:20.701+0000 7fc2795bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-26T06:16:20.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:20.701+0000 7fc2795bd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-26T06:16:20.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:20.701+0000 7fc2795bd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-26T06:16:20.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:20.701+0000 7fc2795bd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-26T06:16:20.702 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:20.703+0000 7fc2795bd640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-26T06:16:23.628 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-26T06:16:23.723 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:16:23.861 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:23.861+0000 7f52df01b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-26T06:16:23.861 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:23.861+0000 7f52df01b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-26T06:16:23.861 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:23.862+0000 7f52df01b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-26T06:16:23.861 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:23.862+0000 7f52df01b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-26T06:16:23.862 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:23.862+0000 7f52df01b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-26T06:16:23.863 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:23.864+0000 7f52df01b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-26T06:16:26.777 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-26T06:16:26.866 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-26T06:16:26.866 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:26.866 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-26T06:16:26.972 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:26.972 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-26T06:16:27.073 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:27.073 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-26T06:16:27.165 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:27.165 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-26T06:16:27.300 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:27.300 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-26T06:16:27.389 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:27.389 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-26T06:16:27.483 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:27.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-26T06:16:27.565 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:27.565 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-26T06:16:27.661 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:27.661 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-26T06:16:27.750 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:27.751 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-26T06:16:27.885 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:27.886 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-26T06:16:27.974 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:27.975 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-26T06:16:28.112 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:28.112 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-26T06:16:28.206 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:28.206 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-26T06:16:28.295 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:28.296 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-26T06:16:28.346 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:28.346 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-26T06:16:28.438 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:28.439 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-26T06:16:28.495 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:28.495 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-26T06:16:28.545 INFO:tasks.ceph:Adding keys to all mons... 2024-03-26T06:16:28.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-26T06:16:28.552 DEBUG:teuthology.orchestra.run.smithi204:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAXaAJmCi7+EhAA5QxyT7e0hbekB1pJrwreJQ== 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAXaAJmBVVWKhAAT1KNyKkZa6VZglb9O9GylQ== 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAYaAJm2JgpARAAEB8SEQYJHidzhLYUaynqDg== 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAdaAJmMOa7FxAAE+zHG5r3ClD8oasscYhdkQ== 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAgaAJmoJ0/IxAAv3JVVTA3ov1m4tkye6PH+Q== 2024-03-26T06:16:28.631 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAkaAJmT45tAhAAetc8t/7p8R2jwHZGUlZddw== 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAnaAJms28BDRAAUlph7wTKeUNDFA144/AdaQ== 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAXaAJmJDMIHhAAXLC3wuPcP2kYFDmRGt7uEw== 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAYaAJmORQiEhAAqnvCxGGyRl3YPvmQZWEacg== 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAYaAJmuQjxIhAA2dASwPXPs1OeW/fcVd4IXQ== 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAuaAJmzYTXCBAAbzANshsbxrBzOIaa/BqSJQ== 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2024-03-26T06:16:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAxaAJmwHozIRAADlessuWynNcoe/QkRHqYbg== 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA0aAJmwY7FKRAAg2NLHn4/41R3lKHOYovajA== 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA3aAJmxF9cMxAAaKVUplY07a9GkxaXuV3dlw== 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAYaAJmRB44MRAAZ6mfBf153b2nT0G6Lkv1MA== 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout:[client.2] 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAZaAJmZUs1ARAAbSWJu9BKZJ9+ilp/i2e5VQ== 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout:[client.1] 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAZaAJmqZV7DBAATop9QomwIPfws5mxTjWTUA== 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout:[client.3] 2024-03-26T06:16:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAZaAJmCroiFxAAqJ2QS3ciaguaWep1cAqB1Q== 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.y] 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAXaAJmCi7+EhAA5QxyT7e0hbekB1pJrwreJQ== 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAXaAJmBVVWKhAAT1KNyKkZa6VZglb9O9GylQ== 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAYaAJm2JgpARAAEB8SEQYJHidzhLYUaynqDg== 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.0] 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAdaAJmMOa7FxAAE+zHG5r3ClD8oasscYhdkQ== 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.1] 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAgaAJmoJ0/IxAAv3JVVTA3ov1m4tkye6PH+Q== 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2024-03-26T06:16:28.639 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAkaAJmT45tAhAAetc8t/7p8R2jwHZGUlZddw== 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.3] 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAnaAJms28BDRAAUlph7wTKeUNDFA144/AdaQ== 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.x] 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAXaAJmJDMIHhAAXLC3wuPcP2kYFDmRGt7uEw== 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAYaAJmORQiEhAAqnvCxGGyRl3YPvmQZWEacg== 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAYaAJmuQjxIhAA2dASwPXPs1OeW/fcVd4IXQ== 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.4] 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAuaAJmzYTXCBAAbzANshsbxrBzOIaa/BqSJQ== 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAxaAJmwHozIRAADlessuWynNcoe/QkRHqYbg== 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.6] 2024-03-26T06:16:28.640 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQA0aAJmwY7FKRAAg2NLHn4/41R3lKHOYovajA== 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.7] 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQA3aAJmxF9cMxAAaKVUplY07a9GkxaXuV3dlw== 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:[client.0] 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAYaAJmRB44MRAAZ6mfBf153b2nT0G6Lkv1MA== 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:[client.2] 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAZaAJmZUs1ARAAbSWJu9BKZJ9+ilp/i2e5VQ== 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:[client.1] 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAZaAJmqZV7DBAATop9QomwIPfws5mxTjWTUA== 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:[client.3] 2024-03-26T06:16:28.641 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAZaAJmCroiFxAAqJ2QS3ciaguaWep1cAqB1Q== 2024-03-26T06:16:28.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-26T06:16:28.681 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-26T06:16:28.830 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-26T06:16:28.839 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-26T06:16:28.986 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-26T06:16:28.991 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-26T06:16:29.133 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:29.141 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:29.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:29.295 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:29.444 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:29.452 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:29.592 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:29.596 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:29.739 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-26T06:16:29.745 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-26T06:16:29.889 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-26T06:16:29.896 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-26T06:16:30.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-26T06:16:30.050 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-26T06:16:30.195 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:30.200 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:30.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:30.351 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:30.501 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:30.507 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:30.657 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:30.664 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-26T06:16:30.811 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-26T06:16:30.817 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-26T06:16:30.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-26T06:16:30.970 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-26T06:16:31.115 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-26T06:16:31.121 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-26T06:16:31.267 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-26T06:16:31.274 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-26T06:16:31.421 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-26T06:16:31.421 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-26T06:16:31.520 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-26T06:16:31.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-26T06:16:31.763 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-26T06:16:31.859 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-26T06:16:32.013 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-26T06:16:32.091 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-26T06:16:32.185 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-26T06:16:32.338 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-26T06:16:32.431 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:16:32.439 DEBUG:teuthology.orchestra.run.smithi204:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-26T06:16:32.493 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-26T06:16:32.493 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-26T06:16:32.493 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-26T06:16:32.500 INFO:tasks.ceph.mon.a:Started 2024-03-26T06:16:32.500 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-26T06:16:32.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-26T06:16:32.505 INFO:tasks.ceph.mon.b:Started 2024-03-26T06:16:32.506 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-26T06:16:32.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-26T06:16:32.510 INFO:tasks.ceph.mon.c:Started 2024-03-26T06:16:32.513 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-26T06:16:32.513 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-26T06:16:32.514 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-26T06:16:32.521 INFO:tasks.ceph.mgr.y:Started 2024-03-26T06:16:32.522 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-26T06:16:32.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-26T06:16:32.527 INFO:tasks.ceph.mgr.x:Started 2024-03-26T06:16:32.527 INFO:tasks.ceph:Setting crush tunables to default 2024-03-26T06:16:32.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2024-03-26T06:16:32.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.714+0000 7f36a3400640 1 Processor -- start 2024-03-26T06:16:33.671 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:33.351+0000 7f8fa6821040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-26T06:16:33.671 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:33.420+0000 7f8fa6821040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-26T06:16:33.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.714+0000 7f36a3400640 1 -- start start 2024-03-26T06:16:33.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.715+0000 7f36a3400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f369c0b39f0 0x7f369c0ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.715+0000 7f36a3400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c15efb0 con 0x7f369c0ae570 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.715+0000 7f36a3400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c15e3a0 con 0x7f369c157f90 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.715+0000 7f36a3400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369c15e680 con 0x7f369c0b39f0 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.716+0000 7f36a0a00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f369c157f90 0x7f369c0acc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:55138/0 (socket says 172.21.15.63:55138) 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.716+0000 7f36a0a00640 1 -- 172.21.15.63:0/1375999522 learned_addr learned my addr 172.21.15.63:0/1375999522 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.716+0000 7f36a1400640 1 --2- 172.21.15.63:0/1375999522 >> v2:172.21.15.204:3300/0 conn(0x7f369c0b39f0 0x7f369c0ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.716+0000 7f36a1400640 1 -- 172.21.15.63:0/1375999522 >> v2:172.21.15.204:3300/0 conn(0x7f369c0b39f0 msgr2=0x7f369c0ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.716+0000 7f36a1400640 1 -- 172.21.15.63:0/1375999522 >> v2:172.21.15.204:3300/0 conn(0x7f369c0b39f0 msgr2=0x7f369c0ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.716+0000 7f36a1400640 1 --2- 172.21.15.63:0/1375999522 >> v2:172.21.15.204:3300/0 conn(0x7f369c0b39f0 0x7f369c0ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.716+0000 7f36a1400640 1 --2- 172.21.15.63:0/1375999522 >> v2:172.21.15.204:3300/0 conn(0x7f369c0b39f0 0x7f369c0ae9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-26T06:16:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.725+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970361957 0 0) 0x7f369c15efb0 con 0x7f369c0ae570 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.725+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684003520 con 0x7f369c0ae570 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.725+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641769641 0 0) 0x7f369c15e3a0 con 0x7f369c157f90 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.725+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f369c15efb0 con 0x7f369c157f90 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113055035 0 0) 0x7f369c15efb0 con 0x7f369c157f90 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 >> v2:172.21.15.204:3300/0 conn(0x7f369c0b39f0 msgr2=0x7f369c0ae9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 --2- 172.21.15.63:0/1375999522 >> v2:172.21.15.204:3300/0 conn(0x7f369c0b39f0 0x7f369c0ae9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 >> v1:172.21.15.63:6789/0 conn(0x7f369c0ae570 legacy=0x7f369c0b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c15e960 con 0x7f369c157f90 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f3690001670 con 0x7f369c157f90 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 >> v1:172.21.15.204:6789/0 conn(0x7f369c157f90 legacy=0x7f369c0acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684003b40 0x7f3684003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3684004800 0x7f3684004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36840051c0 0x7f368400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c15e680 con 0x7f3684004800 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c0f0 con 0x7f3684003b40 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c2f0 con 0x7f36840051c0 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f36a0a00640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684003b40 0x7f3684003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f36a1400640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36840051c0 0x7f368400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.726+0000 7f369be00640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3684004800 0x7f3684004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.727+0000 7f369be00640 1 -- 172.21.15.63:0/1375999522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36840051c0 msgr2=0x7f368400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.727+0000 7f369be00640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36840051c0 0x7f368400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.727+0000 7f369be00640 1 -- 172.21.15.63:0/1375999522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684003b40 msgr2=0x7f3684003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.727+0000 7f369be00640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684003b40 0x7f3684003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.727+0000 7f369be00640 1 -- 172.21.15.63:0/1375999522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c15efb0 con 0x7f3684004800 2024-03-26T06:16:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.727+0000 7f36a1400640 1 -- 172.21.15.63:0/1375999522 reap_dead start 2024-03-26T06:16:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.728+0000 7f369be00640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3684004800 0x7f3684004c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3688007f60 tx=0x7f3684005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c76b32e18020ccc server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.728+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688007b30 con 0x7f3684004800 2024-03-26T06:16:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.728+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688030070 con 0x7f3684004800 2024-03-26T06:16:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.728+0000 7f369b400640 1 -- 172.21.15.63:0/1375999522 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368802c6e0 con 0x7f3684004800 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.729+0000 7f36a3400640 1 -- 172.21.15.63:0/1375999522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3684004800 msgr2=0x7f3684004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.729+0000 7f36a3400640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3684004800 0x7f3684004c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3688007f60 tx=0x7f3684005830 comp rx=0 tx=0).stop 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.730+0000 7f36a3400640 1 -- 172.21.15.63:0/1375999522 shutdown_connections 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.730+0000 7f36a3400640 1 --2- 172.21.15.63:0/1375999522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3684004800 0x7f3684004c80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.730+0000 7f36a3400640 1 -- 172.21.15.63:0/1375999522 >> 172.21.15.63:0/1375999522 conn(0x7f369c06ac90 msgr2=0x7f369c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.730+0000 7f36a3400640 1 -- 172.21.15.63:0/1375999522 shutdown_connections 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.730+0000 7f36a3400640 1 -- 172.21.15.63:0/1375999522 wait complete. 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.732+0000 7f36a3400640 1 Processor -- start 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.732+0000 7f36a3400640 1 -- start start 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f36a3400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684004800 0x7f369c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f36a3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f369c14f870 0x7f369c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f36a3400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f369c1f6480 0x7f369c1f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f36a3400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c158370 con 0x7f369c14f870 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f36a3400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c15e050 con 0x7f3684004800 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f36a3400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c14fde0 con 0x7f369c1f6480 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f36a0a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684004800 0x7f369c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f36a0a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684004800 0x7f369c154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:59514/0 (socket says 172.21.15.63:59514) 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f36a0a00640 1 -- 172.21.15.63:0/1479042844 learned_addr learned my addr 172.21.15.63:0/1479042844 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.733+0000 7f369be00640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f369c14f870 0x7f369c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.734+0000 7f36a1400640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f369c1f6480 0x7f369c1f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.734+0000 7f36a0a00640 1 -- 172.21.15.63:0/1479042844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f369c1f6480 msgr2=0x7f369c1f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.734+0000 7f36a0a00640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f369c1f6480 0x7f369c1f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.734+0000 7f36a0a00640 1 -- 172.21.15.63:0/1479042844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f369c14f870 msgr2=0x7f369c06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.734+0000 7f36a0a00640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f369c14f870 0x7f369c06e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.734+0000 7f36a0a00640 1 -- 172.21.15.63:0/1479042844 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c1500c0 con 0x7f3684004800 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.734+0000 7f369be00640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f369c14f870 0x7f369c06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.734+0000 7f36a0a00640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684004800 0x7f369c154a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3690004ec0 tx=0x7f3690007430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.735+0000 7f3698c00640 1 -- 172.21.15.63:0/1479042844 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369000f750 con 0x7f3684004800 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.735+0000 7f3698c00640 1 -- 172.21.15.63:0/1479042844 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690018070 con 0x7f3684004800 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.735+0000 7f3698c00640 1 -- 172.21.15.63:0/1479042844 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369000fb50 con 0x7f3684004800 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.735+0000 7f36a3400640 1 -- 172.21.15.63:0/1479042844 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c1503a0 con 0x7f3684004800 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.735+0000 7f36a3400640 1 -- 172.21.15.63:0/1479042844 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c150960 con 0x7f3684004800 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.736+0000 7f3698c00640 1 -- 172.21.15.63:0/1479042844 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f369000fcf0 con 0x7f3684004800 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.736+0000 7f3698c00640 1 -- 172.21.15.63:0/1479042844 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3690013560 con 0x7f3684004800 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.736+0000 7f36a3400640 1 -- 172.21.15.63:0/1479042844 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369c150b60 con 0x7f3684004800 2024-03-26T06:16:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.740+0000 7f3698c00640 1 -- 172.21.15.63:0/1479042844 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f369c150b60 con 0x7f3684004800 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.837+0000 7f36a3400640 1 -- 172.21.15.63:0/1479042844 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f369c074730 con 0x7f3684004800 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.845+0000 7f3698c00640 1 -- 172.21.15.63:0/1479042844 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f36900137b0 con 0x7f3684004800 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.846+0000 7f36a3400640 1 -- 172.21.15.63:0/1479042844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684004800 msgr2=0x7f369c154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.846+0000 7f36a3400640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684004800 0x7f369c154a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3690004ec0 tx=0x7f3690007430 comp rx=0 tx=0).stop 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.846+0000 7f36a3400640 1 -- 172.21.15.63:0/1479042844 shutdown_connections 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.846+0000 7f36a3400640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f369c1f6480 0x7f369c1f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.846+0000 7f36a3400640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f369c14f870 0x7f369c06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.846+0000 7f36a3400640 1 --2- 172.21.15.63:0/1479042844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3684004800 0x7f369c154a80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.846+0000 7f36a3400640 1 -- 172.21.15.63:0/1479042844 >> 172.21.15.63:0/1479042844 conn(0x7f369c06ac90 msgr2=0x7f369c1564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.846+0000 7f36a3400640 1 -- 172.21.15.63:0/1479042844 shutdown_connections 2024-03-26T06:16:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:32.846+0000 7f36a3400640 1 -- 172.21.15.63:0/1479042844 wait complete. 2024-03-26T06:16:33.689 INFO:tasks.ceph:check_enable_crimson: False 2024-03-26T06:16:33.689 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-26T06:16:33.689 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:33.689 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-26T06:16:33.690 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:33.324+0000 7f550b614040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-26T06:16:33.690 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:33.390+0000 7f550b614040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-26T06:16:33.772 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:33.773 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-26T06:16:33.910 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:33.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-26T06:16:34.005 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:16:34.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-26T06:16:34.020 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.019+0000 7f550b614040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-26T06:16:34.053 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.052+0000 7f8fa6821040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-26T06:16:34.089 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.087+0000 7f550b614040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-26T06:16:34.101 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:34.101 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-26T06:16:34.120 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.119+0000 7f8fa6821040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-26T06:16:34.142 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.141+0000 7f550b614040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-26T06:16:34.174 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.174+0000 7f8fa6821040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-26T06:16:34.189 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:34.190 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-26T06:16:34.207 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.206+0000 7f550b614040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-26T06:16:34.241 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.241+0000 7f8fa6821040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-26T06:16:34.259 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.259+0000 7f550b614040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-26T06:16:34.295 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.294+0000 7f8fa6821040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-26T06:16:34.313 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:34.313 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-26T06:16:34.396 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.394+0000 7f550b614040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-26T06:16:34.436 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.435+0000 7f8fa6821040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-26T06:16:34.443 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:16:34.443 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-26T06:16:34.480 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.478+0000 7f550b614040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-26T06:16:34.520 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.519+0000 7f8fa6821040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-26T06:16:34.535 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.534+0000 7f550b614040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-26T06:16:34.570 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new ee724377-1725-4ddc-bb43-6497ac83ea3e 0 2024-03-26T06:16:34.577 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.577+0000 7f8fa6821040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-26T06:16:34.598 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.597+0000 7f550b614040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-26T06:16:34.642 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.641+0000 7f8fa6821040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-26T06:16:34.655 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:34.654+0000 7f550b614040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-26T06:16:34.701 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:34.700+0000 7f8fa6821040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-26T06:16:34.771 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.770+0000 7fc979200640 1 Processor -- start 2024-03-26T06:16:34.771 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.770+0000 7fc979200640 1 -- start start 2024-03-26T06:16:34.772 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.772+0000 7fc979200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc97415dbb0 0x7fc9740d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:34.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.772+0000 7fc979200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9740d2490 con 0x7fc9740d0b30 2024-03-26T06:16:34.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.772+0000 7fc979200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9740d2770 con 0x7fc97415df90 2024-03-26T06:16:34.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.772+0000 7fc979200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9740d2a50 con 0x7fc97415dbb0 2024-03-26T06:16:34.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.772+0000 7fc96be00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fc97415df90 0x7fc9740d0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:55120/0 (socket says 172.21.15.204:55120) 2024-03-26T06:16:34.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.772+0000 7fc96be00640 1 -- 172.21.15.204:0/1556864401 learned_addr learned my addr 172.21.15.204:0/1556864401 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-26T06:16:34.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.772+0000 7fc971e00640 1 --2- 172.21.15.204:0/1556864401 >> v2:172.21.15.63:3300/0 conn(0x7fc97415dbb0 0x7fc9740d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:34.775 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.772+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257331193 0 0) 0x7fc9740d2770 con 0x7fc97415df90 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc958003520 con 0x7fc97415df90 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 236585508 0 0) 0x7fc958003520 con 0x7fc97415df90 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 >> v2:172.21.15.63:3300/0 conn(0x7fc97415dbb0 msgr2=0x7fc9740d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 --2- 172.21.15.204:0/1556864401 >> v2:172.21.15.63:3300/0 conn(0x7fc97415dbb0 0x7fc9740d1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 >> v1:172.21.15.63:6789/0 conn(0x7fc9740d0b30 legacy=0x7fc9740b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740d2d30 con 0x7fc97415df90 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fc95c001670 con 0x7fc97415df90 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971e00640 1 --2- 172.21.15.204:0/1556864401 >> v2:172.21.15.63:3300/0 conn(0x7fc97415dbb0 0x7fc9740d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 >> v1:172.21.15.204:6789/0 conn(0x7fc97415df90 legacy=0x7fc9740d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580039b0 0x7fc958003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958004800 0x7fc958004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9580051c0 0x7fc95800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:34.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740d2a50 con 0x7fc9580051c0 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95800c070 con 0x7fc9580039b0 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95800c270 con 0x7fc958004800 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc971e00640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580039b0 0x7fc958003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.773+0000 7fc96be00640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958004800 0x7fc958004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.774+0000 7fc972800640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9580051c0 0x7fc95800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.774+0000 7fc971e00640 1 -- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958004800 msgr2=0x7fc958004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.774+0000 7fc971e00640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958004800 0x7fc958004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.774+0000 7fc971e00640 1 -- 172.21.15.204:0/1556864401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9580051c0 msgr2=0x7fc95800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.774+0000 7fc971e00640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9580051c0 0x7fc95800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.774+0000 7fc971e00640 1 -- 172.21.15.204:0/1556864401 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958003520 con 0x7fc9580039b0 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.774+0000 7fc972800640 1 -- 172.21.15.204:0/1556864401 reap_dead start 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.775+0000 7fc971e00640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580039b0 0x7fc958003dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc964009c90 tx=0x7fc958005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d09b8d7de686310 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.775+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964039070 con 0x7fc9580039b0 2024-03-26T06:16:34.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.775+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96402c8f0 con 0x7fc9580039b0 2024-03-26T06:16:34.778 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.775+0000 7fc971400640 1 -- 172.21.15.204:0/1556864401 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964009860 con 0x7fc9580039b0 2024-03-26T06:16:34.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.776+0000 7fc979200640 1 -- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580039b0 msgr2=0x7fc958003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:34.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.776+0000 7fc979200640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580039b0 0x7fc958003dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc964009c90 tx=0x7fc958005830 comp rx=0 tx=0).stop 2024-03-26T06:16:34.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.776+0000 7fc979200640 1 -- 172.21.15.204:0/1556864401 shutdown_connections 2024-03-26T06:16:34.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.776+0000 7fc979200640 1 --2- 172.21.15.204:0/1556864401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580039b0 0x7fc958003dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:34.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.776+0000 7fc979200640 1 -- 172.21.15.204:0/1556864401 >> 172.21.15.204:0/1556864401 conn(0x7fc9740b5540 msgr2=0x7fc9740b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:34.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.776+0000 7fc979200640 1 -- 172.21.15.204:0/1556864401 shutdown_connections 2024-03-26T06:16:34.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.776+0000 7fc979200640 1 -- 172.21.15.204:0/1556864401 wait complete. 2024-03-26T06:16:34.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.778+0000 7fc979200640 1 Processor -- start 2024-03-26T06:16:34.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.778+0000 7fc979200640 1 -- start start 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc979200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9580039b0 0x7fc9740ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc979200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc974153ca0 0x7fc9740cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc979200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc974154120 0x7fc9740aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc979200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740b96e0 con 0x7fc9580039b0 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc979200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740d3740 con 0x7fc974153ca0 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc979200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740b9860 con 0x7fc974154120 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc96be00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc974153ca0 0x7fc9740cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc96be00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc974153ca0 0x7fc9740cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:38358/0 (socket says 172.21.15.204:38358) 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc96be00640 1 -- 172.21.15.204:0/42786183 learned_addr learned my addr 172.21.15.204:0/42786183 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc972800640 1 --2- 172.21.15.204:0/42786183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc974154120 0x7fc9740aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc971e00640 1 --2- 172.21.15.204:0/42786183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9580039b0 0x7fc9740ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:34.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc96be00640 1 -- 172.21.15.204:0/42786183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc974154120 msgr2=0x7fc9740aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc96be00640 1 --2- 172.21.15.204:0/42786183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc974154120 0x7fc9740aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc96be00640 1 -- 172.21.15.204:0/42786183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9580039b0 msgr2=0x7fc9740ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc96be00640 1 --2- 172.21.15.204:0/42786183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9580039b0 0x7fc9740ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.779+0000 7fc96be00640 1 -- 172.21.15.204:0/42786183 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740cd220 con 0x7fc974153ca0 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.780+0000 7fc96be00640 1 --2- 172.21.15.204:0/42786183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc974153ca0 0x7fc9740cc7d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc95c007290 tx=0x7fc95c007750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.780+0000 7fc96a000640 1 -- 172.21.15.204:0/42786183 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00f9c0 con 0x7fc974153ca0 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.780+0000 7fc96a000640 1 -- 172.21.15.204:0/42786183 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c018070 con 0x7fc974153ca0 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.780+0000 7fc96a000640 1 -- 172.21.15.204:0/42786183 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00fda0 con 0x7fc974153ca0 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.780+0000 7fc979200640 1 -- 172.21.15.204:0/42786183 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9740cd500 con 0x7fc974153ca0 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.780+0000 7fc979200640 1 -- 172.21.15.204:0/42786183 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9740cdac0 con 0x7fc974153ca0 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.780+0000 7fc96a000640 1 -- 172.21.15.204:0/42786183 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc95c01d460 con 0x7fc974153ca0 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.780+0000 7fc96a000640 1 -- 172.21.15.204:0/42786183 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc95c0136b0 con 0x7fc974153ca0 2024-03-26T06:16:34.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.781+0000 7fc979200640 1 -- 172.21.15.204:0/42786183 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc974074730 con 0x7fc974153ca0 2024-03-26T06:16:34.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.786+0000 7fc96a000640 1 -- 172.21.15.204:0/42786183 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fc95c01d8e0 con 0x7fc974153ca0 2024-03-26T06:16:34.866 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.866+0000 7fc979200640 1 -- 172.21.15.204:0/42786183 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ee724377-1725-4ddc-bb43-6497ac83ea3e", "id": 0} v 0) v1 -- 0x7fc9740d0670 con 0x7fc974153ca0 2024-03-26T06:16:34.873 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.872+0000 7fc96a000640 1 -- 172.21.15.204:0/42786183 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee724377-1725-4ddc-bb43-6497ac83ea3e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc95c01dac0 con 0x7fc974153ca0 2024-03-26T06:16:34.873 INFO:teuthology.orchestra.run.smithi204.stdout:0 2024-03-26T06:16:34.874 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.874+0000 7fc979200640 1 -- 172.21.15.204:0/42786183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc974153ca0 msgr2=0x7fc9740cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:34.874 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.874+0000 7fc979200640 1 --2- 172.21.15.204:0/42786183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc974153ca0 0x7fc9740cc7d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc95c007290 tx=0x7fc95c007750 comp rx=0 tx=0).stop 2024-03-26T06:16:34.875 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.874+0000 7fc979200640 1 -- 172.21.15.204:0/42786183 shutdown_connections 2024-03-26T06:16:34.875 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.874+0000 7fc979200640 1 --2- 172.21.15.204:0/42786183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc974154120 0x7fc9740aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:34.875 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.874+0000 7fc979200640 1 --2- 172.21.15.204:0/42786183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc974153ca0 0x7fc9740cc7d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:34.875 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.874+0000 7fc979200640 1 --2- 172.21.15.204:0/42786183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9580039b0 0x7fc9740ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:34.875 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.874+0000 7fc979200640 1 -- 172.21.15.204:0/42786183 >> 172.21.15.204:0/42786183 conn(0x7fc9740b5540 msgr2=0x7fc9740b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:34.875 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.874+0000 7fc979200640 1 -- 172.21.15.204:0/42786183 shutdown_connections 2024-03-26T06:16:34.875 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:34.874+0000 7fc979200640 1 -- 172.21.15.204:0/42786183 wait complete. 2024-03-26T06:16:34.892 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 7c935270-094c-4017-ab5b-f04af6dba01f 1 2024-03-26T06:16:35.079 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.078+0000 7fe89c000640 1 Processor -- start 2024-03-26T06:16:35.079 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.078+0000 7fe89c000640 1 -- start start 2024-03-26T06:16:35.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.080+0000 7fe89c000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415dbb0 0x7fe8940d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.080+0000 7fe89c000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940d2490 con 0x7fe89415df90 2024-03-26T06:16:35.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.080+0000 7fe89c000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940d2770 con 0x7fe8940d0b30 2024-03-26T06:16:35.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.080+0000 7fe89c000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940d2a50 con 0x7fe89415dbb0 2024-03-26T06:16:35.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.080+0000 7fe899600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415dbb0 0x7fe8940d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.080+0000 7fe89a000640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fe8940d0b30 0x7fe8940b6bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:55124/0 (socket says 172.21.15.204:55124) 2024-03-26T06:16:35.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.080+0000 7fe89a000640 1 -- 172.21.15.204:0/1392111785 learned_addr learned my addr 172.21.15.204:0/1392111785 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-26T06:16:35.082 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.081+0000 7fe893e00640 1 -- 172.21.15.204:0/1392111785 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749860326 0 0) 0x7fe8940d2770 con 0x7fe8940d0b30 2024-03-26T06:16:35.083 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.081+0000 7fe899600640 1 -- 172.21.15.204:0/1392111785 >> v1:172.21.15.204:6789/0 conn(0x7fe8940d0b30 legacy=0x7fe8940b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.083 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.081+0000 7fe899600640 1 -- 172.21.15.204:0/1392111785 >> v1:172.21.15.63:6789/0 conn(0x7fe89415df90 legacy=0x7fe8940d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.083 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.081+0000 7fe899600640 1 -- 172.21.15.204:0/1392111785 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940d2d30 con 0x7fe89415dbb0 2024-03-26T06:16:35.083 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.082+0000 7fe899600640 1 --2- 172.21.15.204:0/1392111785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415dbb0 0x7fe8940d1bb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe8880097d0 tx=0x7fe88802b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=387c5b10768c8182 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:35.083 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.082+0000 7fe893e00640 1 -- 172.21.15.204:0/1392111785 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888034070 con 0x7fe89415dbb0 2024-03-26T06:16:35.083 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.082+0000 7fe893e00640 1 -- 172.21.15.204:0/1392111785 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888030890 con 0x7fe89415dbb0 2024-03-26T06:16:35.083 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.082+0000 7fe893e00640 1 -- 172.21.15.204:0/1392111785 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888030c60 con 0x7fe89415dbb0 2024-03-26T06:16:35.084 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.083+0000 7fe89c000640 1 -- 172.21.15.204:0/1392111785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415dbb0 msgr2=0x7fe8940d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.084 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.083+0000 7fe89c000640 1 --2- 172.21.15.204:0/1392111785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415dbb0 0x7fe8940d1bb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe8880097d0 tx=0x7fe88802b9d0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.085 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.083+0000 7fe89c000640 1 -- 172.21.15.204:0/1392111785 shutdown_connections 2024-03-26T06:16:35.085 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.083+0000 7fe89c000640 1 --2- 172.21.15.204:0/1392111785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415dbb0 0x7fe8940d1bb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.086 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.083+0000 7fe89c000640 1 -- 172.21.15.204:0/1392111785 >> 172.21.15.204:0/1392111785 conn(0x7fe8940b5540 msgr2=0x7fe8940b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:35.086 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.083+0000 7fe89c000640 1 -- 172.21.15.204:0/1392111785 shutdown_connections 2024-03-26T06:16:35.086 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.083+0000 7fe89c000640 1 -- 172.21.15.204:0/1392111785 wait complete. 2024-03-26T06:16:35.088 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.085+0000 7fe89c000640 1 Processor -- start 2024-03-26T06:16:35.088 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.085+0000 7fe89c000640 1 -- start start 2024-03-26T06:16:35.088 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe89c000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940d0b30 0x7fe89414a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.088 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe89c000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe89415dbb0 0x7fe8940cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe89c000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415df90 0x7fe89415fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe89c000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940d36b0 con 0x7fe8940d0b30 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe89c000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940d3530 con 0x7fe89415dbb0 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe89c000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940b96e0 con 0x7fe89415df90 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe898c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe89415dbb0 0x7fe8940cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe89a000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415df90 0x7fe89415fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe898c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe89415dbb0 0x7fe8940cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:38368/0 (socket says 172.21.15.204:38368) 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe898c00640 1 -- 172.21.15.204:0/3579361858 learned_addr learned my addr 172.21.15.204:0/3579361858 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe899600640 1 --2- 172.21.15.204:0/3579361858 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940d0b30 0x7fe89414a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.086+0000 7fe89a000640 1 -- 172.21.15.204:0/3579361858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe89415dbb0 msgr2=0x7fe8940cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe89a000640 1 --2- 172.21.15.204:0/3579361858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe89415dbb0 0x7fe8940cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe89a000640 1 -- 172.21.15.204:0/3579361858 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940d0b30 msgr2=0x7fe89414a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe89a000640 1 --2- 172.21.15.204:0/3579361858 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940d0b30 0x7fe89414a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe89a000640 1 -- 172.21.15.204:0/3579361858 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89414b1f0 con 0x7fe89415df90 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe898c00640 1 --2- 172.21.15.204:0/3579361858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe89415dbb0 0x7fe8940cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe89a000640 1 --2- 172.21.15.204:0/3579361858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415df90 0x7fe89415fe70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8940d13d0 tx=0x7fe88c00cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe891600640 1 -- 172.21.15.204:0/3579361858 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c018070 con 0x7fe89415df90 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe891600640 1 -- 172.21.15.204:0/3579361858 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c004d60 con 0x7fe89415df90 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe891600640 1 -- 172.21.15.204:0/3579361858 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00a850 con 0x7fe89415df90 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe89c000640 1 -- 172.21.15.204:0/3579361858 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89414b4d0 con 0x7fe89415df90 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe89c000640 1 -- 172.21.15.204:0/3579361858 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89414ba90 con 0x7fe89415df90 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.087+0000 7fe891600640 1 -- 172.21.15.204:0/3579361858 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe88c01b070 con 0x7fe89415df90 2024-03-26T06:16:35.090 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.088+0000 7fe891600640 1 -- 172.21.15.204:0/3579361858 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fe88c01d7f0 con 0x7fe89415df90 2024-03-26T06:16:35.091 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.088+0000 7fe89c000640 1 -- 172.21.15.204:0/3579361858 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8940c6e80 con 0x7fe89415df90 2024-03-26T06:16:35.092 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.091+0000 7fe891600640 1 -- 172.21.15.204:0/3579361858 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fe8940c6e80 con 0x7fe89415df90 2024-03-26T06:16:35.130 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:35.129+0000 7f550b614040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-26T06:16:35.171 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.170+0000 7fe89c000640 1 -- 172.21.15.204:0/3579361858 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7c935270-094c-4017-ab5b-f04af6dba01f", "id": 1} v 0) v1 -- 0x7fe894074730 con 0x7fe89415df90 2024-03-26T06:16:35.179 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.178+0000 7fe891600640 1 -- 172.21.15.204:0/3579361858 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c935270-094c-4017-ab5b-f04af6dba01f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe88c0078f0 con 0x7fe89415df90 2024-03-26T06:16:35.179 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-03-26T06:16:35.180 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.179+0000 7fe89c000640 1 -- 172.21.15.204:0/3579361858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415df90 msgr2=0x7fe89415fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.180 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.179+0000 7fe89c000640 1 --2- 172.21.15.204:0/3579361858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415df90 0x7fe89415fe70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8940d13d0 tx=0x7fe88c00cb60 comp rx=0 tx=0).stop 2024-03-26T06:16:35.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.179+0000 7fe89c000640 1 -- 172.21.15.204:0/3579361858 shutdown_connections 2024-03-26T06:16:35.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.179+0000 7fe89c000640 1 --2- 172.21.15.204:0/3579361858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe89415df90 0x7fe89415fe70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.179+0000 7fe89c000640 1 --2- 172.21.15.204:0/3579361858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe89415dbb0 0x7fe8940cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.180+0000 7fe89c000640 1 --2- 172.21.15.204:0/3579361858 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940d0b30 0x7fe89414a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.180+0000 7fe89c000640 1 -- 172.21.15.204:0/3579361858 >> 172.21.15.204:0/3579361858 conn(0x7fe8940b5540 msgr2=0x7fe8940c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:35.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.180+0000 7fe89c000640 1 -- 172.21.15.204:0/3579361858 shutdown_connections 2024-03-26T06:16:35.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.180+0000 7fe89c000640 1 -- 172.21.15.204:0/3579361858 wait complete. 2024-03-26T06:16:35.190 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:35.190+0000 7f8fa6821040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-26T06:16:35.196 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3 2 2024-03-26T06:16:35.298 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:35.297+0000 7f550b614040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-26T06:16:35.360 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:35.359+0000 7f8fa6821040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-26T06:16:35.381 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.381+0000 7f3dc7000640 1 Processor -- start 2024-03-26T06:16:35.382 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.381+0000 7f3dc7000640 1 -- start start 2024-03-26T06:16:35.383 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.382+0000 7f3dc7000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3dc015f090 0x7f3dc0099a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.383 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.382+0000 7f3dc7000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3dc00b2c60 0x7f3dc0099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.383 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.382+0000 7f3dc7000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc00b29e0 con 0x7f3dc00b21b0 2024-03-26T06:16:35.383 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.382+0000 7f3dc7000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc00cf5b0 con 0x7f3dc00b2c60 2024-03-26T06:16:35.383 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.382+0000 7f3dc7000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc00ae3b0 con 0x7f3dc015f090 2024-03-26T06:16:35.383 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dc5c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3dc015f090 0x7f3dc0099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.384 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dc6600640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f3dc00b21b0 0x7f3dc00b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:55132/0 (socket says 172.21.15.204:55132) 2024-03-26T06:16:35.384 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dc6600640 1 -- 172.21.15.204:0/3195919879 learned_addr learned my addr 172.21.15.204:0/3195919879 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-26T06:16:35.384 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dc5c00640 1 -- 172.21.15.204:0/3195919879 >> v2:172.21.15.63:3300/0 conn(0x7f3dc00b2c60 msgr2=0x7f3dc0099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:35.384 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dc5200640 1 --2- 172.21.15.204:0/3195919879 >> v2:172.21.15.63:3300/0 conn(0x7f3dc00b2c60 0x7f3dc0099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.384 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dc5c00640 1 --2- 172.21.15.204:0/3195919879 >> v2:172.21.15.63:3300/0 conn(0x7f3dc00b2c60 0x7f3dc0099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.385 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dc5c00640 1 -- 172.21.15.204:0/3195919879 >> v1:172.21.15.204:6789/0 conn(0x7f3dc00b21b0 legacy=0x7f3dc00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.385 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dc5c00640 1 -- 172.21.15.204:0/3195919879 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc00cf800 con 0x7f3dc015f090 2024-03-26T06:16:35.385 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dbfe00640 1 -- 172.21.15.204:0/3195919879 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268830309 0 0) 0x7f3dc00b29e0 con 0x7f3dc00b21b0 2024-03-26T06:16:35.385 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.383+0000 7f3dc5200640 1 --2- 172.21.15.204:0/3195919879 >> v2:172.21.15.63:3300/0 conn(0x7f3dc00b2c60 0x7f3dc0099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.384+0000 7f3dc5c00640 1 --2- 172.21.15.204:0/3195919879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dc015f090 0x7f3dc0099a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0072400 tx=0x7f3db402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c18b457236cf435 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dbfe00640 1 -- 172.21.15.204:0/3195919879 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4039070 con 0x7f3dc015f090 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dbfe00640 1 -- 172.21.15.204:0/3195919879 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db402cc80 con 0x7f3dc015f090 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dbfe00640 1 -- 172.21.15.204:0/3195919879 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4034660 con 0x7f3dc015f090 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dc7000640 1 -- 172.21.15.204:0/3195919879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dc015f090 msgr2=0x7f3dc0099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dc7000640 1 --2- 172.21.15.204:0/3195919879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dc015f090 0x7f3dc0099a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0072400 tx=0x7f3db402bed0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dc7000640 1 -- 172.21.15.204:0/3195919879 shutdown_connections 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dc7000640 1 --2- 172.21.15.204:0/3195919879 >> v2:172.21.15.63:3300/0 conn(0x7f3dc00b2c60 0x7f3dc0099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dc7000640 1 --2- 172.21.15.204:0/3195919879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dc015f090 0x7f3dc0099a70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.386 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dc7000640 1 -- 172.21.15.204:0/3195919879 >> 172.21.15.204:0/3195919879 conn(0x7f3dc00b3130 msgr2=0x7f3dc00b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:35.387 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.385+0000 7f3dc7000640 1 -- 172.21.15.204:0/3195919879 shutdown_connections 2024-03-26T06:16:35.387 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.386+0000 7f3dc7000640 1 -- 172.21.15.204:0/3195919879 wait complete. 2024-03-26T06:16:35.387 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.387+0000 7f3dc7000640 1 Processor -- start 2024-03-26T06:16:35.387 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.387+0000 7f3dc7000640 1 -- start start 2024-03-26T06:16:35.389 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc7000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dc00b21b0 0x7f3dc014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.389 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc7000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dc00b2c60 0x7f3dc00cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.389 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc7000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dc015f090 0x7f3dc00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.389 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc7000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00d03f0 con 0x7f3dc00b2c60 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc7000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00d0080 con 0x7f3dc015f090 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc7000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00cdde0 con 0x7f3dc00b21b0 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc5c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dc00b21b0 0x7f3dc014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc6600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dc015f090 0x7f3dc00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc5c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dc00b21b0 0x7f3dc014ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:40164/0 (socket says 172.21.15.204:40164) 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.388+0000 7f3dc5c00640 1 -- 172.21.15.204:0/3418942905 learned_addr learned my addr 172.21.15.204:0/3418942905 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dc5200640 1 --2- 172.21.15.204:0/3418942905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dc00b2c60 0x7f3dc00cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dc5c00640 1 -- 172.21.15.204:0/3418942905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dc015f090 msgr2=0x7f3dc00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dc5c00640 1 --2- 172.21.15.204:0/3418942905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dc015f090 0x7f3dc00b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dc5c00640 1 -- 172.21.15.204:0/3418942905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dc00b2c60 msgr2=0x7f3dc00cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dc5c00640 1 --2- 172.21.15.204:0/3418942905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dc00b2c60 0x7f3dc00cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dc5c00640 1 -- 172.21.15.204:0/3418942905 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc014cfd0 con 0x7f3dc00b21b0 2024-03-26T06:16:35.390 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dc5c00640 1 --2- 172.21.15.204:0/3418942905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dc00b21b0 0x7f3dc014ca90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009e80 tx=0x7f3db4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:35.391 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dbd600640 1 -- 172.21.15.204:0/3418942905 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4039050 con 0x7f3dc00b21b0 2024-03-26T06:16:35.391 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dbd600640 1 -- 172.21.15.204:0/3418942905 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4045070 con 0x7f3dc00b21b0 2024-03-26T06:16:35.392 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dbd600640 1 -- 172.21.15.204:0/3418942905 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db403ea50 con 0x7f3dc00b21b0 2024-03-26T06:16:35.392 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.389+0000 7f3dc7000640 1 -- 172.21.15.204:0/3418942905 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc00c8b80 con 0x7f3dc00b21b0 2024-03-26T06:16:35.392 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.390+0000 7f3dc7000640 1 -- 172.21.15.204:0/3418942905 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc00afca0 con 0x7f3dc00b21b0 2024-03-26T06:16:35.392 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.391+0000 7f3dbd600640 1 -- 172.21.15.204:0/3418942905 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3db402cb00 con 0x7f3dc00b21b0 2024-03-26T06:16:35.392 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.391+0000 7f3dbd600640 1 -- 172.21.15.204:0/3418942905 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3db4040450 con 0x7f3dc00b21b0 2024-03-26T06:16:35.392 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.391+0000 7f3dc7000640 1 -- 172.21.15.204:0/3418942905 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc004f0c0 con 0x7f3dc00b21b0 2024-03-26T06:16:35.394 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.393+0000 7f3dbd600640 1 -- 172.21.15.204:0/3418942905 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3dc014cfd0 con 0x7f3dc00b21b0 2024-03-26T06:16:35.447 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:35.446+0000 7f550b614040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-26T06:16:35.474 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.473+0000 7f3dc7000640 1 -- 172.21.15.204:0/3418942905 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3", "id": 2} v 0) v1 -- 0x7f3dc015dd70 con 0x7f3dc00b21b0 2024-03-26T06:16:35.481 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.480+0000 7f3dbd600640 1 -- 172.21.15.204:0/3418942905 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3db403ed80 con 0x7f3dc00b21b0 2024-03-26T06:16:35.481 INFO:teuthology.orchestra.run.smithi204.stdout:2 2024-03-26T06:16:35.483 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.482+0000 7f3dc7000640 1 -- 172.21.15.204:0/3418942905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dc00b21b0 msgr2=0x7f3dc014ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.483 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.482+0000 7f3dc7000640 1 --2- 172.21.15.204:0/3418942905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dc00b21b0 0x7f3dc014ca90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009e80 tx=0x7f3db4004a40 comp rx=0 tx=0).stop 2024-03-26T06:16:35.483 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.482+0000 7f3dc7000640 1 -- 172.21.15.204:0/3418942905 shutdown_connections 2024-03-26T06:16:35.483 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.482+0000 7f3dc7000640 1 --2- 172.21.15.204:0/3418942905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dc015f090 0x7f3dc00b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.483 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.482+0000 7f3dc7000640 1 --2- 172.21.15.204:0/3418942905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dc00b2c60 0x7f3dc00cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.483 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.482+0000 7f3dc7000640 1 --2- 172.21.15.204:0/3418942905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dc00b21b0 0x7f3dc014ca90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.483 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.482+0000 7f3dc7000640 1 -- 172.21.15.204:0/3418942905 >> 172.21.15.204:0/3418942905 conn(0x7f3dc00b3130 msgr2=0x7f3dc015d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:35.483 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.482+0000 7f3dc7000640 1 -- 172.21.15.204:0/3418942905 shutdown_connections 2024-03-26T06:16:35.483 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.482+0000 7f3dc7000640 1 -- 172.21.15.204:0/3418942905 wait complete. 2024-03-26T06:16:35.499 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new d804cf57-87a1-44a4-b1c1-80b0a5421d61 3 2024-03-26T06:16:35.504 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:35.503+0000 7f550b614040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-26T06:16:35.510 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:35.510+0000 7f8fa6821040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-26T06:16:35.567 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:35.567+0000 7f8fa6821040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-26T06:16:35.636 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:35.635+0000 7f550b614040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-26T06:16:35.691 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.690+0000 7f2d42800640 1 Processor -- start 2024-03-26T06:16:35.691 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.690+0000 7f2d42800640 1 -- start start 2024-03-26T06:16:35.692 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.691+0000 7f2d42800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2d3c0d3840 0x7f2d3c0d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.692 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.692+0000 7f2d42800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0d4160 con 0x7f2d3c15dca0 2024-03-26T06:16:35.692 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.692+0000 7f2d42800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0d22d0 con 0x7f2d3c0b9320 2024-03-26T06:16:35.692 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.692+0000 7f2d42800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3c0d2070 con 0x7f2d3c0d3840 2024-03-26T06:16:35.692 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.692+0000 7f2d41400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2d3c0d3840 0x7f2d3c0d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.692 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.692+0000 7f2d41400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2d3c0d3840 0x7f2d3c0d3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:38398/0 (socket says 172.21.15.204:38398) 2024-03-26T06:16:35.693 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.692+0000 7f2d41400640 1 -- 172.21.15.204:0/814433863 learned_addr learned my addr 172.21.15.204:0/814433863 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:35.693 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.692+0000 7f2d41400640 1 -- 172.21.15.204:0/814433863 >> v1:172.21.15.204:6789/0 conn(0x7f2d3c0b9320 legacy=0x7f2d3c0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.693 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.692+0000 7f2d41400640 1 -- 172.21.15.204:0/814433863 >> v1:172.21.15.63:6789/0 conn(0x7f2d3c15dca0 legacy=0x7f2d3c0d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:35.693 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.692+0000 7f2d41400640 1 -- 172.21.15.204:0/814433863 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0d25b0 con 0x7f2d3c0d3840 2024-03-26T06:16:35.694 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.693+0000 7f2d41400640 1 --2- 172.21.15.204:0/814433863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c0d3840 0x7f2d3c0d3c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d3002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2b486948910af84 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:35.694 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.694+0000 7f2d3be00640 1 -- 172.21.15.204:0/814433863 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30034070 con 0x7f2d3c0d3840 2024-03-26T06:16:35.694 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.694+0000 7f2d3be00640 1 -- 172.21.15.204:0/814433863 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30030860 con 0x7f2d3c0d3840 2024-03-26T06:16:35.694 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.694+0000 7f2d3be00640 1 -- 172.21.15.204:0/814433863 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30030c30 con 0x7f2d3c0d3840 2024-03-26T06:16:35.695 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.695+0000 7f2d42800640 1 -- 172.21.15.204:0/814433863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c0d3840 msgr2=0x7f2d3c0d3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.695 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.695+0000 7f2d42800640 1 --2- 172.21.15.204:0/814433863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c0d3840 0x7f2d3c0d3c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d3002b9a0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.695 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.695+0000 7f2d42800640 1 -- 172.21.15.204:0/814433863 shutdown_connections 2024-03-26T06:16:35.695 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.695+0000 7f2d42800640 1 --2- 172.21.15.204:0/814433863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c0d3840 0x7f2d3c0d3c20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.696 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.695+0000 7f2d42800640 1 -- 172.21.15.204:0/814433863 >> 172.21.15.204:0/814433863 conn(0x7f2d3c06c570 msgr2=0x7f2d3c06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:35.696 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.695+0000 7f2d42800640 1 -- 172.21.15.204:0/814433863 shutdown_connections 2024-03-26T06:16:35.696 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.695+0000 7f2d42800640 1 -- 172.21.15.204:0/814433863 wait complete. 2024-03-26T06:16:35.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.697+0000 7f2d42800640 1 Processor -- start 2024-03-26T06:16:35.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.698+0000 7f2d42800640 1 -- start start 2024-03-26T06:16:35.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d42800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d3c0b9320 0x7f2d3c0c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d42800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d3c0d3840 0x7f2d3c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d42800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c15dca0 0x7f2d3c1f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:35.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d42800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0d2e50 con 0x7f2d3c0d3840 2024-03-26T06:16:35.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d42800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0d2b70 con 0x7f2d3c15dca0 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d42800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0d3370 con 0x7f2d3c0b9320 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d41400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d3c0b9320 0x7f2d3c0c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d41400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d3c0b9320 0x7f2d3c0c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:40176/0 (socket says 172.21.15.204:40176) 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d41400640 1 -- 172.21.15.204:0/2833512374 learned_addr learned my addr 172.21.15.204:0/2833512374 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.699+0000 7f2d41e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c15dca0 0x7f2d3c1f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.700+0000 7f2d40a00640 1 --2- 172.21.15.204:0/2833512374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d3c0d3840 0x7f2d3c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.700+0000 7f2d41400640 1 -- 172.21.15.204:0/2833512374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c15dca0 msgr2=0x7f2d3c1f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.700+0000 7f2d41400640 1 --2- 172.21.15.204:0/2833512374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c15dca0 0x7f2d3c1f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.700+0000 7f2d41400640 1 -- 172.21.15.204:0/2833512374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d3c0d3840 msgr2=0x7f2d3c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.700+0000 7f2d41400640 1 --2- 172.21.15.204:0/2833512374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d3c0d3840 0x7f2d3c0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.700+0000 7f2d41400640 1 -- 172.21.15.204:0/2833512374 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0cc4e0 con 0x7f2d3c0b9320 2024-03-26T06:16:35.702 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.700+0000 7f2d41400640 1 --2- 172.21.15.204:0/2833512374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d3c0b9320 0x7f2d3c0c97a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2d30000c00 tx=0x7f2d30004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:35.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.700+0000 7f2d39600640 1 -- 172.21.15.204:0/2833512374 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30048070 con 0x7f2d3c0b9320 2024-03-26T06:16:35.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.701+0000 7f2d39600640 1 -- 172.21.15.204:0/2833512374 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30039d90 con 0x7f2d3c0b9320 2024-03-26T06:16:35.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.701+0000 7f2d39600640 1 -- 172.21.15.204:0/2833512374 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30034040 con 0x7f2d3c0b9320 2024-03-26T06:16:35.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.701+0000 7f2d42800640 1 -- 172.21.15.204:0/2833512374 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c0cc7c0 con 0x7f2d3c0b9320 2024-03-26T06:16:35.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.701+0000 7f2d42800640 1 -- 172.21.15.204:0/2833512374 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c0ccd80 con 0x7f2d3c0b9320 2024-03-26T06:16:35.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.701+0000 7f2d39600640 1 -- 172.21.15.204:0/2833512374 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2d30037070 con 0x7f2d3c0b9320 2024-03-26T06:16:35.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.701+0000 7f2d39600640 1 -- 172.21.15.204:0/2833512374 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2d30043e00 con 0x7f2d3c0b9320 2024-03-26T06:16:35.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.702+0000 7f2d42800640 1 -- 172.21.15.204:0/2833512374 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c155030 con 0x7f2d3c0b9320 2024-03-26T06:16:35.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.704+0000 7f2d39600640 1 -- 172.21.15.204:0/2833512374 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2d3c155030 con 0x7f2d3c0b9320 2024-03-26T06:16:35.706 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:35.705+0000 7f8fa6821040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-26T06:16:35.753 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:35.752+0000 7f550b614040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-26T06:16:35.784 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.783+0000 7f2d42800640 1 -- 172.21.15.204:0/2833512374 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d804cf57-87a1-44a4-b1c1-80b0a5421d61", "id": 3} v 0) v1 -- 0x7f2d3c04f0c0 con 0x7f2d3c0b9320 2024-03-26T06:16:35.792 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.791+0000 7f2d39600640 1 -- 172.21.15.204:0/2833512374 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d804cf57-87a1-44a4-b1c1-80b0a5421d61", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d30051020 con 0x7f2d3c0b9320 2024-03-26T06:16:35.792 INFO:teuthology.orchestra.run.smithi204.stdout:3 2024-03-26T06:16:35.794 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.793+0000 7f2d42800640 1 -- 172.21.15.204:0/2833512374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d3c0b9320 msgr2=0x7f2d3c0c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:35.794 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.793+0000 7f2d42800640 1 --2- 172.21.15.204:0/2833512374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d3c0b9320 0x7f2d3c0c97a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2d30000c00 tx=0x7f2d30004730 comp rx=0 tx=0).stop 2024-03-26T06:16:35.794 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.793+0000 7f2d42800640 1 -- 172.21.15.204:0/2833512374 shutdown_connections 2024-03-26T06:16:35.794 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.793+0000 7f2d42800640 1 --2- 172.21.15.204:0/2833512374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c15dca0 0x7f2d3c1f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.794 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.793+0000 7f2d42800640 1 --2- 172.21.15.204:0/2833512374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d3c0d3840 0x7f2d3c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.794 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.793+0000 7f2d42800640 1 --2- 172.21.15.204:0/2833512374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d3c0b9320 0x7f2d3c0c97a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:35.794 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.793+0000 7f2d42800640 1 -- 172.21.15.204:0/2833512374 >> 172.21.15.204:0/2833512374 conn(0x7f2d3c06c570 msgr2=0x7f2d3c0b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:35.794 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.793+0000 7f2d42800640 1 -- 172.21.15.204:0/2833512374 shutdown_connections 2024-03-26T06:16:35.794 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:35.793+0000 7f2d42800640 1 -- 172.21.15.204:0/2833512374 wait complete. 2024-03-26T06:16:35.811 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 2ec7998e-1364-4e70-8a32-1a368816f9da 4 2024-03-26T06:16:35.825 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:35.824+0000 7f8fa6821040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-26T06:16:35.939 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:35.938+0000 7f550b614040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-26T06:16:35.994 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:35.990+0000 7f550b614040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-26T06:16:36.013 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:36.013+0000 7f8fa6821040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-26T06:16:36.018 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.017+0000 7fda9be00640 1 Processor -- start 2024-03-26T06:16:36.018 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.017+0000 7fda9be00640 1 -- start start 2024-03-26T06:16:36.019 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.019+0000 7fda9be00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c0d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.019 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.019+0000 7fda9be00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0d22d0 con 0x7fda9c0b9320 2024-03-26T06:16:36.020 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.019+0000 7fda9be00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0d25b0 con 0x7fda9c0d3840 2024-03-26T06:16:36.020 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.019+0000 7fda9be00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0d2890 con 0x7fda9c15dca0 2024-03-26T06:16:36.020 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.019+0000 7fda9aa00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fda9c0d3840 0x7fda9c0d3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:55148/0 (socket says 172.21.15.204:55148) 2024-03-26T06:16:36.020 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.019+0000 7fda9aa00640 1 -- 172.21.15.204:0/869494922 learned_addr learned my addr 172.21.15.204:0/869494922 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-26T06:16:36.020 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.019+0000 7fda9a000640 1 --2- 172.21.15.204:0/869494922 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c0d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.020 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.020+0000 7fda99600640 1 -- 172.21.15.204:0/869494922 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354211660 0 0) 0x7fda9c0d25b0 con 0x7fda9c0d3840 2024-03-26T06:16:36.021 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.020+0000 7fda99600640 1 -- 172.21.15.204:0/869494922 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda80003520 con 0x7fda9c0d3840 2024-03-26T06:16:36.021 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.020+0000 7fda9a000640 1 -- 172.21.15.204:0/869494922 >> v1:172.21.15.204:6789/0 conn(0x7fda9c0d3840 legacy=0x7fda9c0d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.021 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.020+0000 7fda9a000640 1 -- 172.21.15.204:0/869494922 >> v1:172.21.15.63:6789/0 conn(0x7fda9c0b9320 legacy=0x7fda9c0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.021 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.020+0000 7fda9a000640 1 -- 172.21.15.204:0/869494922 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0d2b70 con 0x7fda9c15dca0 2024-03-26T06:16:36.021 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.021+0000 7fda9a000640 1 --2- 172.21.15.204:0/869494922 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c0d1960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda880097d0 tx=0x7fda8802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97eef1d6b0d5548a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:36.022 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.021+0000 7fda99600640 1 -- 172.21.15.204:0/869494922 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88035020 con 0x7fda9c15dca0 2024-03-26T06:16:36.022 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.021+0000 7fda99600640 1 -- 172.21.15.204:0/869494922 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda88031890 con 0x7fda9c15dca0 2024-03-26T06:16:36.022 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.021+0000 7fda99600640 1 -- 172.21.15.204:0/869494922 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88031c60 con 0x7fda9c15dca0 2024-03-26T06:16:36.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.022+0000 7fda9be00640 1 -- 172.21.15.204:0/869494922 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 msgr2=0x7fda9c0d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.022+0000 7fda9be00640 1 --2- 172.21.15.204:0/869494922 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c0d1960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda880097d0 tx=0x7fda8802b930 comp rx=0 tx=0).stop 2024-03-26T06:16:36.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.022+0000 7fda9be00640 1 -- 172.21.15.204:0/869494922 shutdown_connections 2024-03-26T06:16:36.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.022+0000 7fda9be00640 1 --2- 172.21.15.204:0/869494922 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c0d1960 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.022+0000 7fda9be00640 1 -- 172.21.15.204:0/869494922 >> 172.21.15.204:0/869494922 conn(0x7fda9c06c570 msgr2=0x7fda9c06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:36.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.022+0000 7fda9be00640 1 -- 172.21.15.204:0/869494922 shutdown_connections 2024-03-26T06:16:36.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.022+0000 7fda9be00640 1 -- 172.21.15.204:0/869494922 wait complete. 2024-03-26T06:16:36.024 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.024+0000 7fda9be00640 1 Processor -- start 2024-03-26T06:16:36.024 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.024+0000 7fda9be00640 1 -- start start 2024-03-26T06:16:36.027 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda9c0b9320 0x7fda9c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.027 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9be00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda9c0d3840 0x7fda9c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.027 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9be00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.027 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0d2020 con 0x7fda9c0b9320 2024-03-26T06:16:36.027 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9be00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0d1ea0 con 0x7fda9c0d3840 2024-03-26T06:16:36.027 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9be00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0d3370 con 0x7fda9c15dca0 2024-03-26T06:16:36.027 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9a000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda9c0d3840 0x7fda9c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9b400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9a000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda9c0d3840 0x7fda9c1573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:38422/0 (socket says 172.21.15.204:38422) 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9a000640 1 -- 172.21.15.204:0/2678577664 learned_addr learned my addr 172.21.15.204:0/2678577664 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9aa00640 1 --2- 172.21.15.204:0/2678577664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda9c0b9320 0x7fda9c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9b400640 1 -- 172.21.15.204:0/2678577664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda9c0d3840 msgr2=0x7fda9c1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9b400640 1 --2- 172.21.15.204:0/2678577664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda9c0d3840 0x7fda9c1573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9b400640 1 -- 172.21.15.204:0/2678577664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda9c0b9320 msgr2=0x7fda9c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9b400640 1 --2- 172.21.15.204:0/2678577664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda9c0b9320 0x7fda9c1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.025+0000 7fda9b400640 1 -- 172.21.15.204:0/2678577664 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c156350 con 0x7fda9c15dca0 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.026+0000 7fda9b400640 1 --2- 172.21.15.204:0/2678577664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c150030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fda9c08cb80 tx=0x7fda9400cb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.026+0000 7fda93400640 1 -- 172.21.15.204:0/2678577664 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94003b70 con 0x7fda9c15dca0 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.026+0000 7fda93400640 1 -- 172.21.15.204:0/2678577664 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94003d10 con 0x7fda9c15dca0 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.026+0000 7fda93400640 1 -- 172.21.15.204:0/2678577664 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94005310 con 0x7fda9c15dca0 2024-03-26T06:16:36.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.026+0000 7fda9be00640 1 -- 172.21.15.204:0/2678577664 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c156630 con 0x7fda9c15dca0 2024-03-26T06:16:36.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.026+0000 7fda9be00640 1 -- 172.21.15.204:0/2678577664 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c156bf0 con 0x7fda9c15dca0 2024-03-26T06:16:36.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.026+0000 7fda93400640 1 -- 172.21.15.204:0/2678577664 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fda940054b0 con 0x7fda9c15dca0 2024-03-26T06:16:36.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.027+0000 7fda93400640 1 -- 172.21.15.204:0/2678577664 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fda9400ab50 con 0x7fda9c15dca0 2024-03-26T06:16:36.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.027+0000 7fda9be00640 1 -- 172.21.15.204:0/2678577664 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c04f0c0 con 0x7fda9c15dca0 2024-03-26T06:16:36.030 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.030+0000 7fda93400640 1 -- 172.21.15.204:0/2678577664 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fda940057a0 con 0x7fda9c15dca0 2024-03-26T06:16:36.068 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:36.067+0000 7f8fa6821040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-26T06:16:36.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.108+0000 7fda9be00640 1 -- 172.21.15.204:0/2678577664 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2ec7998e-1364-4e70-8a32-1a368816f9da", "id": 4} v 0) v1 -- 0x7fda9c06b090 con 0x7fda9c15dca0 2024-03-26T06:16:36.118 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.118+0000 7fda93400640 1 -- 172.21.15.204:0/2678577664 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ec7998e-1364-4e70-8a32-1a368816f9da", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fda9400a640 con 0x7fda9c15dca0 2024-03-26T06:16:36.119 INFO:teuthology.orchestra.run.smithi204.stdout:4 2024-03-26T06:16:36.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.119+0000 7fda9be00640 1 -- 172.21.15.204:0/2678577664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 msgr2=0x7fda9c150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.119+0000 7fda9be00640 1 --2- 172.21.15.204:0/2678577664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c150030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fda9c08cb80 tx=0x7fda9400cb20 comp rx=0 tx=0).stop 2024-03-26T06:16:36.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.119+0000 7fda9be00640 1 -- 172.21.15.204:0/2678577664 shutdown_connections 2024-03-26T06:16:36.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.119+0000 7fda9be00640 1 --2- 172.21.15.204:0/2678577664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9c15dca0 0x7fda9c150030 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.119+0000 7fda9be00640 1 --2- 172.21.15.204:0/2678577664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda9c0d3840 0x7fda9c1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.119+0000 7fda9be00640 1 --2- 172.21.15.204:0/2678577664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda9c0b9320 0x7fda9c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.119+0000 7fda9be00640 1 -- 172.21.15.204:0/2678577664 >> 172.21.15.204:0/2678577664 conn(0x7fda9c06c570 msgr2=0x7fda9c0d3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:36.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.120+0000 7fda9be00640 1 -- 172.21.15.204:0/2678577664 shutdown_connections 2024-03-26T06:16:36.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.120+0000 7fda9be00640 1 -- 172.21.15.204:0/2678577664 wait complete. 2024-03-26T06:16:36.136 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new eea399b9-e45d-4732-8bd9-2cbe78af67de 5 2024-03-26T06:16:36.175 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:36.174+0000 7f550b614040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-26T06:16:36.253 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:36.252+0000 7f8fa6821040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-26T06:16:36.324 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.323+0000 7f7766600640 1 Processor -- start 2024-03-26T06:16:36.324 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.323+0000 7f7766600640 1 -- start start 2024-03-26T06:16:36.326 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.325+0000 7f7766600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d3560 0x7f77600d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.326 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.325+0000 7f7766600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f77600d08f0 0x7f77600b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.326 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.325+0000 7f7766600640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77600d24c0 con 0x7f776015dc60 2024-03-26T06:16:36.326 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.325+0000 7f7766600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600d27a0 con 0x7f77600d08f0 2024-03-26T06:16:36.326 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.325+0000 7f7766600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600d2a80 con 0x7f77600d3560 2024-03-26T06:16:36.326 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.325+0000 7f775ea00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d3560 0x7f77600d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.326 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.325+0000 7f775f400640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f776015dc60 0x7f77600d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:55156/0 (socket says 172.21.15.204:55156) 2024-03-26T06:16:36.327 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.325+0000 7f775f400640 1 -- 172.21.15.204:0/573553556 learned_addr learned my addr 172.21.15.204:0/573553556 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-26T06:16:36.327 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.325+0000 7f775fe00640 1 --2- 172.21.15.204:0/573553556 >> v2:172.21.15.63:3300/0 conn(0x7f77600d08f0 0x7f77600b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.327 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.326+0000 7f775ea00640 1 -- 172.21.15.204:0/573553556 >> v2:172.21.15.63:3300/0 conn(0x7f77600d08f0 msgr2=0x7f77600b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:36.327 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.326+0000 7f775ea00640 1 --2- 172.21.15.204:0/573553556 >> v2:172.21.15.63:3300/0 conn(0x7f77600d08f0 0x7f77600b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.327 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.326+0000 7f775ea00640 1 -- 172.21.15.204:0/573553556 >> v1:172.21.15.204:6789/0 conn(0x7f776015dc60 legacy=0x7f77600d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.327 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.326+0000 7f775e000640 1 -- 172.21.15.204:0/573553556 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739445457 0 0) 0x7f77600d24c0 con 0x7f776015dc60 2024-03-26T06:16:36.327 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.326+0000 7f775ea00640 1 -- 172.21.15.204:0/573553556 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600d2d60 con 0x7f77600d3560 2024-03-26T06:16:36.328 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.327+0000 7f775ea00640 1 --2- 172.21.15.204:0/573553556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d3560 0x7f77600d03b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f774c0097a0 tx=0x7f774c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8e9fa204ea40bd3 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:36.328 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.327+0000 7f775e000640 1 -- 172.21.15.204:0/573553556 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c035020 con 0x7f77600d3560 2024-03-26T06:16:36.328 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.327+0000 7f775e000640 1 -- 172.21.15.204:0/573553556 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c031830 con 0x7f77600d3560 2024-03-26T06:16:36.328 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.327+0000 7f775e000640 1 -- 172.21.15.204:0/573553556 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c031c00 con 0x7f77600d3560 2024-03-26T06:16:36.328 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.327+0000 7f7766600640 1 -- 172.21.15.204:0/573553556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d3560 msgr2=0x7f77600d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.328 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.327+0000 7f7766600640 1 --2- 172.21.15.204:0/573553556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d3560 0x7f77600d03b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f774c0097a0 tx=0x7f774c02b8d0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.329 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.328+0000 7f7766600640 1 -- 172.21.15.204:0/573553556 shutdown_connections 2024-03-26T06:16:36.329 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.328+0000 7f7766600640 1 --2- 172.21.15.204:0/573553556 >> v2:172.21.15.63:3300/0 conn(0x7f77600d08f0 0x7f77600b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.329 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.328+0000 7f7766600640 1 --2- 172.21.15.204:0/573553556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d3560 0x7f77600d03b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.329 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.328+0000 7f7766600640 1 -- 172.21.15.204:0/573553556 >> 172.21.15.204:0/573553556 conn(0x7f77600729f0 msgr2=0x7f776006c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:36.329 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.328+0000 7f7766600640 1 -- 172.21.15.204:0/573553556 shutdown_connections 2024-03-26T06:16:36.329 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.328+0000 7f7766600640 1 -- 172.21.15.204:0/573553556 wait complete. 2024-03-26T06:16:36.330 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.329+0000 7f7766600640 1 Processor -- start 2024-03-26T06:16:36.330 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.330+0000 7f7766600640 1 -- start start 2024-03-26T06:16:36.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.330+0000 7f7766600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d08f0 0x7f77600cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.330+0000 7f7766600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f77600d3560 0x7f77600cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.330+0000 7f7766600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776015dc60 0x7f77601e5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.330+0000 7f7766600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600d2110 con 0x7f776015dc60 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f7766600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600b9460 con 0x7f77600d3560 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f7766600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776015b460 con 0x7f77600d08f0 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775f400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d08f0 0x7f77600cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775ea00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f77600d3560 0x7f77600cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775ea00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f77600d3560 0x7f77600cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:38436/0 (socket says 172.21.15.204:38436) 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775f400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d08f0 0x7f77600cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:40222/0 (socket says 172.21.15.204:40222) 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775ea00640 1 -- 172.21.15.204:0/3321163639 learned_addr learned my addr 172.21.15.204:0/3321163639 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775fe00640 1 --2- 172.21.15.204:0/3321163639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776015dc60 0x7f77601e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775f400640 1 -- 172.21.15.204:0/3321163639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f77600d3560 msgr2=0x7f77600cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775f400640 1 --2- 172.21.15.204:0/3321163639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f77600d3560 0x7f77600cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775f400640 1 -- 172.21.15.204:0/3321163639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776015dc60 msgr2=0x7f77601e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775f400640 1 --2- 172.21.15.204:0/3321163639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776015dc60 0x7f77601e5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775f400640 1 -- 172.21.15.204:0/3321163639 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77601e3f20 con 0x7f77600d08f0 2024-03-26T06:16:36.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775ea00640 1 --2- 172.21.15.204:0/3321163639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f77600d3560 0x7f77600cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:16:36.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.331+0000 7f775f400640 1 --2- 172.21.15.204:0/3321163639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d08f0 0x7f77600cd630 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f775000c410 tx=0x7f775000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:36.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.332+0000 7f7757400640 1 -- 172.21.15.204:0/3321163639 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77500074e0 con 0x7f77600d08f0 2024-03-26T06:16:36.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.332+0000 7f7757400640 1 -- 172.21.15.204:0/3321163639 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77500047e0 con 0x7f77600d08f0 2024-03-26T06:16:36.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.332+0000 7f7757400640 1 -- 172.21.15.204:0/3321163639 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750004bd0 con 0x7f77600d08f0 2024-03-26T06:16:36.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.332+0000 7f7766600640 1 -- 172.21.15.204:0/3321163639 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77601e41c0 con 0x7f77600d08f0 2024-03-26T06:16:36.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.332+0000 7f7766600640 1 -- 172.21.15.204:0/3321163639 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77600cb840 con 0x7f77600d08f0 2024-03-26T06:16:36.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.332+0000 7f7757400640 1 -- 172.21.15.204:0/3321163639 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7750011070 con 0x7f77600d08f0 2024-03-26T06:16:36.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.332+0000 7f7757400640 1 -- 172.21.15.204:0/3321163639 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7750004d70 con 0x7f77600d08f0 2024-03-26T06:16:36.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.333+0000 7f7766600640 1 -- 172.21.15.204:0/3321163639 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77601e4390 con 0x7f77600d08f0 2024-03-26T06:16:36.336 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.335+0000 7f7757400640 1 -- 172.21.15.204:0/3321163639 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f77500133c0 con 0x7f77600d08f0 2024-03-26T06:16:36.415 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.414+0000 7f7766600640 1 -- 172.21.15.204:0/3321163639 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eea399b9-e45d-4732-8bd9-2cbe78af67de", "id": 5} v 0) v1 -- 0x7f7760074730 con 0x7f77600d08f0 2024-03-26T06:16:36.421 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.421+0000 7f7757400640 1 -- 172.21.15.204:0/3321163639 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eea399b9-e45d-4732-8bd9-2cbe78af67de", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f77500135a0 con 0x7f77600d08f0 2024-03-26T06:16:36.421 INFO:teuthology.orchestra.run.smithi204.stdout:5 2024-03-26T06:16:36.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.422+0000 7f7766600640 1 -- 172.21.15.204:0/3321163639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d08f0 msgr2=0x7f77600cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.422+0000 7f7766600640 1 --2- 172.21.15.204:0/3321163639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d08f0 0x7f77600cd630 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f775000c410 tx=0x7f775000c8d0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.422+0000 7f7766600640 1 -- 172.21.15.204:0/3321163639 shutdown_connections 2024-03-26T06:16:36.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.422+0000 7f7766600640 1 --2- 172.21.15.204:0/3321163639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776015dc60 0x7f77601e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.422+0000 7f7766600640 1 --2- 172.21.15.204:0/3321163639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f77600d3560 0x7f77600cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.422+0000 7f7766600640 1 --2- 172.21.15.204:0/3321163639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77600d08f0 0x7f77600cd630 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.422+0000 7f7766600640 1 -- 172.21.15.204:0/3321163639 >> 172.21.15.204:0/3321163639 conn(0x7f77600729f0 msgr2=0x7f77600c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:36.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.422+0000 7f7766600640 1 -- 172.21.15.204:0/3321163639 shutdown_connections 2024-03-26T06:16:36.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.422+0000 7f7766600640 1 -- 172.21.15.204:0/3321163639 wait complete. 2024-03-26T06:16:36.440 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 13347eed-7d02-417f-867f-7d14821c54a5 6 2024-03-26T06:16:36.626 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.626+0000 7fa17ec00640 1 Processor -- start 2024-03-26T06:16:36.627 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.626+0000 7fa17ec00640 1 -- start start 2024-03-26T06:16:36.629 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa17ec00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.629 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa17ec00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1780b96e0 0x7fa1780d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.629 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa17ec00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1780d2490 con 0x7fa17815dbb0 2024-03-26T06:16:36.629 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa17ec00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1780b7be0 con 0x7fa1780b96e0 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa17ec00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780d2770 con 0x7fa17815df90 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa16fe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa16fe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780d0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:40238/0 (socket says 172.21.15.204:40238) 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa16fe00640 1 -- 172.21.15.204:0/4152394450 learned_addr learned my addr 172.21.15.204:0/4152394450 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa17cc00640 1 --2- 172.21.15.204:0/4152394450 >> v2:172.21.15.63:3300/0 conn(0x7fa1780b96e0 0x7fa1780d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa16fe00640 1 -- 172.21.15.204:0/4152394450 >> v2:172.21.15.63:3300/0 conn(0x7fa1780b96e0 msgr2=0x7fa1780d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa16fe00640 1 --2- 172.21.15.204:0/4152394450 >> v2:172.21.15.63:3300/0 conn(0x7fa1780b96e0 0x7fa1780d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa16fe00640 1 -- 172.21.15.204:0/4152394450 >> v1:172.21.15.63:6789/0 conn(0x7fa17815dbb0 legacy=0x7fa1780d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.628+0000 7fa16fe00640 1 -- 172.21.15.204:0/4152394450 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1780d2a50 con 0x7fa17815df90 2024-03-26T06:16:36.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.629+0000 7fa17cc00640 1 --2- 172.21.15.204:0/4152394450 >> v2:172.21.15.63:3300/0 conn(0x7fa1780b96e0 0x7fa1780d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:16:36.631 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.630+0000 7fa16fe00640 1 --2- 172.21.15.204:0/4152394450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780d0420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa160009870 tx=0x7fa16002ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfbbda944d2aa269 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:36.631 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.630+0000 7fa177400640 1 -- 172.21.15.204:0/4152394450 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16002f830 con 0x7fa17815df90 2024-03-26T06:16:36.631 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa177400640 1 -- 172.21.15.204:0/4152394450 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16002f9d0 con 0x7fa17815df90 2024-03-26T06:16:36.631 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa177400640 1 -- 172.21.15.204:0/4152394450 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16002fda0 con 0x7fa17815df90 2024-03-26T06:16:36.632 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa17ec00640 1 -- 172.21.15.204:0/4152394450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 msgr2=0x7fa1780d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.632 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa17ec00640 1 --2- 172.21.15.204:0/4152394450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780d0420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa160009870 tx=0x7fa16002ba10 comp rx=0 tx=0).stop 2024-03-26T06:16:36.632 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa17ec00640 1 -- 172.21.15.204:0/4152394450 shutdown_connections 2024-03-26T06:16:36.632 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa17ec00640 1 --2- 172.21.15.204:0/4152394450 >> v2:172.21.15.63:3300/0 conn(0x7fa1780b96e0 0x7fa1780d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.632 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa17ec00640 1 --2- 172.21.15.204:0/4152394450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780d0420 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.632 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa17ec00640 1 -- 172.21.15.204:0/4152394450 >> 172.21.15.204:0/4152394450 conn(0x7fa1780b5540 msgr2=0x7fa1780b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:36.632 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa17ec00640 1 -- 172.21.15.204:0/4152394450 shutdown_connections 2024-03-26T06:16:36.633 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.631+0000 7fa17ec00640 1 -- 172.21.15.204:0/4152394450 wait complete. 2024-03-26T06:16:36.633 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.633+0000 7fa17ec00640 1 Processor -- start 2024-03-26T06:16:36.633 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.633+0000 7fa17ec00640 1 -- start start 2024-03-26T06:16:36.636 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa17ec00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1780b96e0 0x7fa17815cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.636 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa17ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa17815dbb0 0x7fa1780b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.636 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa17ec00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.636 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa17ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780d36b0 con 0x7fa17815dbb0 2024-03-26T06:16:36.636 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa17ec00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780d3530 con 0x7fa1780b96e0 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa17ec00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780b6bd0 con 0x7fa17815df90 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa177e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1780b96e0 0x7fa17815cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa17cc00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa177e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1780b96e0 0x7fa17815cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:38448/0 (socket says 172.21.15.204:38448) 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa177e00640 1 -- 172.21.15.204:0/4260351018 learned_addr learned my addr 172.21.15.204:0/4260351018 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.634+0000 7fa16fe00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa17815dbb0 0x7fa1780b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa17cc00640 1 -- 172.21.15.204:0/4260351018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1780b96e0 msgr2=0x7fa17815cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa17cc00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1780b96e0 0x7fa17815cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa17cc00640 1 -- 172.21.15.204:0/4260351018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa17815dbb0 msgr2=0x7fa1780b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa17cc00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa17815dbb0 0x7fa1780b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa17cc00640 1 -- 172.21.15.204:0/4260351018 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1781f42f0 con 0x7fa17815df90 2024-03-26T06:16:36.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa177e00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1780b96e0 0x7fa17815cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:16:36.638 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa16fe00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa17815dbb0 0x7fa1780b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:16:36.638 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa17cc00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780b2f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa170007e60 tx=0x7fa17000d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:36.638 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa174c00640 1 -- 172.21.15.204:0/4260351018 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17001a070 con 0x7fa17815df90 2024-03-26T06:16:36.638 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa174c00640 1 -- 172.21.15.204:0/4260351018 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa170003b90 con 0x7fa17815df90 2024-03-26T06:16:36.638 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa17ec00640 1 -- 172.21.15.204:0/4260351018 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1781f48d0 con 0x7fa17815df90 2024-03-26T06:16:36.638 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.635+0000 7fa174c00640 1 -- 172.21.15.204:0/4260351018 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17000de80 con 0x7fa17815df90 2024-03-26T06:16:36.638 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.636+0000 7fa17ec00640 1 -- 172.21.15.204:0/4260351018 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1781f45d0 con 0x7fa17815df90 2024-03-26T06:16:36.638 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.636+0000 7fa174c00640 1 -- 172.21.15.204:0/4260351018 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa17001d070 con 0x7fa17815df90 2024-03-26T06:16:36.638 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.636+0000 7fa174c00640 1 -- 172.21.15.204:0/4260351018 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa170004620 con 0x7fa17815df90 2024-03-26T06:16:36.639 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.637+0000 7fa17ec00640 1 -- 172.21.15.204:0/4260351018 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa178074730 con 0x7fa17815df90 2024-03-26T06:16:36.639 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.639+0000 7fa174c00640 1 -- 172.21.15.204:0/4260351018 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa170024020 con 0x7fa17815df90 2024-03-26T06:16:36.720 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.719+0000 7fa17ec00640 1 -- 172.21.15.204:0/4260351018 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "13347eed-7d02-417f-867f-7d14821c54a5", "id": 6} v 0) v1 -- 0x7fa17806c460 con 0x7fa17815df90 2024-03-26T06:16:36.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.726+0000 7fa174c00640 1 -- 172.21.15.204:0/4260351018 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "13347eed-7d02-417f-867f-7d14821c54a5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa170010070 con 0x7fa17815df90 2024-03-26T06:16:36.727 INFO:teuthology.orchestra.run.smithi204.stdout:6 2024-03-26T06:16:36.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.728+0000 7fa17ec00640 1 -- 172.21.15.204:0/4260351018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 msgr2=0x7fa1780b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.728+0000 7fa17ec00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780b2f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa170007e60 tx=0x7fa17000d4a0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.728+0000 7fa17ec00640 1 -- 172.21.15.204:0/4260351018 shutdown_connections 2024-03-26T06:16:36.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.728+0000 7fa17ec00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa17815df90 0x7fa1780b2f20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.728+0000 7fa17ec00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa17815dbb0 0x7fa1780b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.728+0000 7fa17ec00640 1 --2- 172.21.15.204:0/4260351018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1780b96e0 0x7fa17815cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.728+0000 7fa17ec00640 1 -- 172.21.15.204:0/4260351018 >> 172.21.15.204:0/4260351018 conn(0x7fa1780b5540 msgr2=0x7fa1780c9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:36.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.728+0000 7fa17ec00640 1 -- 172.21.15.204:0/4260351018 shutdown_connections 2024-03-26T06:16:36.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.728+0000 7fa17ec00640 1 -- 172.21.15.204:0/4260351018 wait complete. 2024-03-26T06:16:36.744 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 2276830e-0c03-4198-b387-d76e439721ca 7 2024-03-26T06:16:36.929 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.928+0000 7f17d1800640 1 Processor -- start 2024-03-26T06:16:36.929 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.928+0000 7f17d1800640 1 -- start start 2024-03-26T06:16:36.930 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.930+0000 7f17d1800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc15df90 0x7f17cc0d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.931 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.930+0000 7f17d1800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0d2490 con 0x7f17cc0b96e0 2024-03-26T06:16:36.931 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.930+0000 7f17d1800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0d2770 con 0x7f17cc15dbb0 2024-03-26T06:16:36.931 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.930+0000 7f17d1800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0d2a50 con 0x7f17cc15df90 2024-03-26T06:16:36.931 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.930+0000 7f17caa00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f17cc15dbb0 0x7f17cc0d1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:55164/0 (socket says 172.21.15.204:55164) 2024-03-26T06:16:36.931 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.930+0000 7f17caa00640 1 -- 172.21.15.204:0/1936829765 learned_addr learned my addr 172.21.15.204:0/1936829765 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-26T06:16:36.931 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.931+0000 7f17ca000640 1 --2- 172.21.15.204:0/1936829765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc15df90 0x7f17cc0d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.932 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.931+0000 7f17ca000640 1 -- 172.21.15.204:0/1936829765 >> v1:172.21.15.204:6789/0 conn(0x7f17cc15dbb0 legacy=0x7f17cc0d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.932 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.931+0000 7f17ca000640 1 -- 172.21.15.204:0/1936829765 >> v1:172.21.15.63:6789/0 conn(0x7f17cc0b96e0 legacy=0x7f17cc0b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.932 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.931+0000 7f17ca000640 1 -- 172.21.15.204:0/1936829765 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0d2d30 con 0x7f17cc15df90 2024-03-26T06:16:36.932 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.932+0000 7f17ca000640 1 --2- 172.21.15.204:0/1936829765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc15df90 0x7f17cc0d0420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f17b40097d0 tx=0x7f17b402b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75f3eed46bbb8829 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:36.936 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.935+0000 7f17c9600640 1 -- 172.21.15.204:0/1936829765 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4034070 con 0x7f17cc15df90 2024-03-26T06:16:36.936 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.935+0000 7f17c9600640 1 -- 172.21.15.204:0/1936829765 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b4030890 con 0x7f17cc15df90 2024-03-26T06:16:36.936 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.935+0000 7f17c9600640 1 -- 172.21.15.204:0/1936829765 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4030c60 con 0x7f17cc15df90 2024-03-26T06:16:36.937 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.936+0000 7f17d1800640 1 -- 172.21.15.204:0/1936829765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc15df90 msgr2=0x7f17cc0d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.937 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.936+0000 7f17d1800640 1 --2- 172.21.15.204:0/1936829765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc15df90 0x7f17cc0d0420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f17b40097d0 tx=0x7f17b402b9d0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.937 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.936+0000 7f17d1800640 1 -- 172.21.15.204:0/1936829765 shutdown_connections 2024-03-26T06:16:36.937 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.936+0000 7f17d1800640 1 --2- 172.21.15.204:0/1936829765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc15df90 0x7f17cc0d0420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.937 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.936+0000 7f17d1800640 1 -- 172.21.15.204:0/1936829765 >> 172.21.15.204:0/1936829765 conn(0x7f17cc0b5540 msgr2=0x7f17cc0b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:36.937 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.936+0000 7f17d1800640 1 -- 172.21.15.204:0/1936829765 shutdown_connections 2024-03-26T06:16:36.937 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.936+0000 7f17d1800640 1 -- 172.21.15.204:0/1936829765 wait complete. 2024-03-26T06:16:36.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.938+0000 7f17d1800640 1 Processor -- start 2024-03-26T06:16:36.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.938+0000 7f17d1800640 1 -- start start 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.939+0000 7f17d1800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc0b96e0 0x7f17cc149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.939+0000 7f17d1800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17cc15dbb0 0x7f17cc157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.939+0000 7f17d1800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc15df90 0x7f17cc1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.939+0000 7f17d1800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0d0ae0 con 0x7f17cc15df90 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.939+0000 7f17d1800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0d0960 con 0x7f17cc15dbb0 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.939+0000 7f17d1800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0d0c60 con 0x7f17cc0b96e0 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17caa00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc0b96e0 0x7f17cc149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17ca000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17cc15dbb0 0x7f17cc157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17caa00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc0b96e0 0x7f17cc149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:40280/0 (socket says 172.21.15.204:40280) 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17caa00640 1 -- 172.21.15.204:0/661633162 learned_addr learned my addr 172.21.15.204:0/661633162 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17cb400640 1 --2- 172.21.15.204:0/661633162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc15df90 0x7f17cc1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:36.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17ca000640 1 -- 172.21.15.204:0/661633162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc0b96e0 msgr2=0x7f17cc149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17ca000640 1 --2- 172.21.15.204:0/661633162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc0b96e0 0x7f17cc149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17ca000640 1 -- 172.21.15.204:0/661633162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc15df90 msgr2=0x7f17cc1576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:36.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17ca000640 1 --2- 172.21.15.204:0/661633162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc15df90 0x7f17cc1576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:36.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17ca000640 1 -- 172.21.15.204:0/661633162 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc14a500 con 0x7f17cc15dbb0 2024-03-26T06:16:36.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17caa00640 1 --2- 172.21.15.204:0/661633162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc0b96e0 0x7f17cc149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:16:36.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.940+0000 7f17ca000640 1 --2- 172.21.15.204:0/661633162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17cc15dbb0 0x7f17cc157170 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17b4033000 tx=0x7f17b40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:36.943 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.941+0000 7f17c2a00640 1 -- 172.21.15.204:0/661633162 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4034040 con 0x7f17cc15dbb0 2024-03-26T06:16:36.943 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.941+0000 7f17c2a00640 1 -- 172.21.15.204:0/661633162 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b40443f0 con 0x7f17cc15dbb0 2024-03-26T06:16:36.943 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.941+0000 7f17d1800640 1 -- 172.21.15.204:0/661633162 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc0c9cd0 con 0x7f17cc15dbb0 2024-03-26T06:16:36.943 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.941+0000 7f17c2a00640 1 -- 172.21.15.204:0/661633162 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40447c0 con 0x7f17cc15dbb0 2024-03-26T06:16:36.943 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.941+0000 7f17d1800640 1 -- 172.21.15.204:0/661633162 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc15f1d0 con 0x7f17cc15dbb0 2024-03-26T06:16:36.943 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.941+0000 7f17c2a00640 1 -- 172.21.15.204:0/661633162 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f17b404b060 con 0x7f17cc15dbb0 2024-03-26T06:16:36.943 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.941+0000 7f17c2a00640 1 -- 172.21.15.204:0/661633162 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f17b4030760 con 0x7f17cc15dbb0 2024-03-26T06:16:36.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.942+0000 7f17d1800640 1 -- 172.21.15.204:0/661633162 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc074730 con 0x7f17cc15dbb0 2024-03-26T06:16:36.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:36.945+0000 7f17c2a00640 1 -- 172.21.15.204:0/661633162 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f17b403f070 con 0x7f17cc15dbb0 2024-03-26T06:16:37.024 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.023+0000 7f17d1800640 1 -- 172.21.15.204:0/661633162 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2276830e-0c03-4198-b387-d76e439721ca", "id": 7} v 0) v1 -- 0x7f17cc0b5b70 con 0x7f17cc15dbb0 2024-03-26T06:16:37.034 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.034+0000 7f17c2a00640 1 -- 172.21.15.204:0/661633162 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2276830e-0c03-4198-b387-d76e439721ca", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f17b4044960 con 0x7f17cc15dbb0 2024-03-26T06:16:37.034 INFO:teuthology.orchestra.run.smithi204.stdout:7 2024-03-26T06:16:37.036 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.035+0000 7f17d1800640 1 -- 172.21.15.204:0/661633162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17cc15dbb0 msgr2=0x7f17cc157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:37.036 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.035+0000 7f17d1800640 1 --2- 172.21.15.204:0/661633162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17cc15dbb0 0x7f17cc157170 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17b4033000 tx=0x7f17b40046c0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.036 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.035+0000 7f17d1800640 1 -- 172.21.15.204:0/661633162 shutdown_connections 2024-03-26T06:16:37.036 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.035+0000 7f17d1800640 1 --2- 172.21.15.204:0/661633162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc15df90 0x7f17cc1576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.036 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.035+0000 7f17d1800640 1 --2- 172.21.15.204:0/661633162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17cc15dbb0 0x7f17cc157170 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.037 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.035+0000 7f17d1800640 1 --2- 172.21.15.204:0/661633162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17cc0b96e0 0x7f17cc149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.037 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.035+0000 7f17d1800640 1 -- 172.21.15.204:0/661633162 >> 172.21.15.204:0/661633162 conn(0x7f17cc0b5540 msgr2=0x7f17cc15bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:37.037 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.036+0000 7f17d1800640 1 -- 172.21.15.204:0/661633162 shutdown_connections 2024-03-26T06:16:37.037 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-26T06:16:37.036+0000 7f17d1800640 1 -- 172.21.15.204:0/661633162 wait complete. 2024-03-26T06:16:37.052 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-26T06:16:37.053 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-26T06:16:37.059 INFO:tasks.ceph.osd.0:Started 2024-03-26T06:16:37.060 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-26T06:16:37.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-26T06:16:37.069 INFO:tasks.ceph.osd.1:Started 2024-03-26T06:16:37.069 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-26T06:16:37.069 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-26T06:16:37.075 INFO:tasks.ceph.osd.2:Started 2024-03-26T06:16:37.075 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-26T06:16:37.075 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-26T06:16:37.079 INFO:tasks.ceph.osd.3:Started 2024-03-26T06:16:37.079 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-26T06:16:37.079 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-26T06:16:37.086 INFO:tasks.ceph.osd.4:Started 2024-03-26T06:16:37.086 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-26T06:16:37.086 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-26T06:16:37.093 INFO:tasks.ceph.osd.5:Started 2024-03-26T06:16:37.093 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-26T06:16:37.093 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-26T06:16:37.097 INFO:tasks.ceph.osd.6:Started 2024-03-26T06:16:37.098 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-26T06:16:37.098 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-26T06:16:37.102 INFO:tasks.ceph.osd.7:Started 2024-03-26T06:16:37.102 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:16:37.315 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:37.314+0000 7f550b614040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-26T06:16:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.326+0000 7fb1cf200640 1 Processor -- start 2024-03-26T06:16:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.326+0000 7fb1cf200640 1 -- start start 2024-03-26T06:16:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.327+0000 7fb1cf200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb1d015d9a0 0x7fb1d00b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.327+0000 7fb1cf200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d00d1c10 0x7fb1d00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.327+0000 7fb1cf200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d00b97c0 con 0x7fb1d00d3250 2024-03-26T06:16:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.327+0000 7fb1cf200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d00d21b0 con 0x7fb1d015d9a0 2024-03-26T06:16:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.327+0000 7fb1cf200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00d2490 con 0x7fb1d00d1c10 2024-03-26T06:16:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.327+0000 7fb1cde00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb1d015d9a0 0x7fb1d00b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.327+0000 7fb1cde00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb1d015d9a0 0x7fb1d00b9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49118/0 (socket says 172.21.15.63:49118) 2024-03-26T06:16:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.327+0000 7fb1cde00640 1 -- 172.21.15.63:0/2173333146 learned_addr learned my addr 172.21.15.63:0/2173333146 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.327+0000 7fb1cd400640 1 --2- 172.21.15.63:0/2173333146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d00d1c10 0x7fb1d00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.328+0000 7fb1cde00640 1 -- 172.21.15.63:0/2173333146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d00d1c10 msgr2=0x7fb1d00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.328+0000 7fb1cde00640 1 --2- 172.21.15.63:0/2173333146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d00d1c10 0x7fb1d00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.328+0000 7fb1cde00640 1 -- 172.21.15.63:0/2173333146 >> v1:172.21.15.204:6789/0 conn(0x7fb1d00d3250 legacy=0x7fb1d00b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.328+0000 7fb1cde00640 1 -- 172.21.15.63:0/2173333146 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00d2770 con 0x7fb1d015d9a0 2024-03-26T06:16:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.329+0000 7fb1cde00640 1 --2- 172.21.15.63:0/2173333146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d015d9a0 0x7fb1d00b9280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009870 tx=0x7fb1c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1a99792839e60d server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.329+0000 7fb1cca00640 1 -- 172.21.15.63:0/2173333146 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0035020 con 0x7fb1d015d9a0 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.329+0000 7fb1cca00640 1 -- 172.21.15.63:0/2173333146 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0031640 con 0x7fb1d015d9a0 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.329+0000 7fb1cca00640 1 -- 172.21.15.63:0/2173333146 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c002d040 con 0x7fb1d015d9a0 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.330+0000 7fb1cf200640 1 -- 172.21.15.63:0/2173333146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d015d9a0 msgr2=0x7fb1d00b9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.330+0000 7fb1cf200640 1 --2- 172.21.15.63:0/2173333146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d015d9a0 0x7fb1d00b9280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009870 tx=0x7fb1c002b8f0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.330+0000 7fb1cf200640 1 -- 172.21.15.63:0/2173333146 shutdown_connections 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.330+0000 7fb1cf200640 1 --2- 172.21.15.63:0/2173333146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d00d1c10 0x7fb1d00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.330+0000 7fb1cf200640 1 --2- 172.21.15.63:0/2173333146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d015d9a0 0x7fb1d00b9280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.330+0000 7fb1cf200640 1 -- 172.21.15.63:0/2173333146 >> 172.21.15.63:0/2173333146 conn(0x7fb1d006bfa0 msgr2=0x7fb1d006c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.330+0000 7fb1cf200640 1 -- 172.21.15.63:0/2173333146 shutdown_connections 2024-03-26T06:16:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.330+0000 7fb1cf200640 1 -- 172.21.15.63:0/2173333146 wait complete. 2024-03-26T06:16:37.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.331+0000 7fb1cf200640 1 Processor -- start 2024-03-26T06:16:37.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.332+0000 7fb1cf200640 1 -- start start 2024-03-26T06:16:37.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.332+0000 7fb1cf200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d00d1c10 0x7fb1d00b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:37.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.332+0000 7fb1cf200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d00d3250 0x7fb1d00b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:37.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cf200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d015d9a0 0x7fb1d015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:37.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cf200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d015dd80 con 0x7fb1d00d1c10 2024-03-26T06:16:37.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cf200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00d2d30 con 0x7fb1d00d3250 2024-03-26T06:16:37.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cf200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00cea50 con 0x7fb1d015d9a0 2024-03-26T06:16:37.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d00d1c10 0x7fb1d00b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d00d1c10 0x7fb1d00b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49134/0 (socket says 172.21.15.63:49134) 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cde00640 1 -- 172.21.15.63:0/2532334351 learned_addr learned my addr 172.21.15.63:0/2532334351 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cd400640 1 --2- 172.21.15.63:0/2532334351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d00d3250 0x7fb1d00b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1ce800640 1 --2- 172.21.15.63:0/2532334351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d015d9a0 0x7fb1d015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cde00640 1 -- 172.21.15.63:0/2532334351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d015d9a0 msgr2=0x7fb1d015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cde00640 1 --2- 172.21.15.63:0/2532334351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d015d9a0 0x7fb1d015feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cde00640 1 -- 172.21.15.63:0/2532334351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d00d3250 msgr2=0x7fb1d00b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cde00640 1 --2- 172.21.15.63:0/2532334351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d00d3250 0x7fb1d00b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.333+0000 7fb1cde00640 1 -- 172.21.15.63:0/2532334351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00b5ba0 con 0x7fb1d00d1c10 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.334+0000 7fb1cde00640 1 --2- 172.21.15.63:0/2532334351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d00d1c10 0x7fb1d00b3ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0000c00 tx=0x7fb1c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.334+0000 7fb1c6000640 1 -- 172.21.15.63:0/2532334351 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0040070 con 0x7fb1d00d1c10 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.334+0000 7fb1c6000640 1 -- 172.21.15.63:0/2532334351 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c00399f0 con 0x7fb1d00d1c10 2024-03-26T06:16:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.334+0000 7fb1cf200640 1 -- 172.21.15.63:0/2532334351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d00b5e80 con 0x7fb1d00d1c10 2024-03-26T06:16:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.334+0000 7fb1c6000640 1 -- 172.21.15.63:0/2532334351 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0035040 con 0x7fb1d00d1c10 2024-03-26T06:16:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.334+0000 7fb1cf200640 1 -- 172.21.15.63:0/2532334351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d00b3590 con 0x7fb1d00d1c10 2024-03-26T06:16:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.334+0000 7fb1c6000640 1 -- 172.21.15.63:0/2532334351 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb1c004b060 con 0x7fb1d00d1c10 2024-03-26T06:16:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.334+0000 7fb1c6000640 1 -- 172.21.15.63:0/2532334351 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb1c0039dc0 con 0x7fb1d00d1c10 2024-03-26T06:16:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.335+0000 7fb1cf200640 1 -- 172.21.15.63:0/2532334351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d004f050 con 0x7fb1d00d1c10 2024-03-26T06:16:37.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.338+0000 7fb1c6000640 1 -- 172.21.15.63:0/2532334351 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb1c003a650 con 0x7fb1d00d1c10 2024-03-26T06:16:37.349 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:37.349+0000 7f8fa6821040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-26T06:16:37.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.403+0000 7fb1cf200640 1 -- 172.21.15.63:0/2532334351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1d00b8660 con 0x7fb1d00d1c10 2024-03-26T06:16:37.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.404+0000 7fb1c6000640 1 -- 172.21.15.63:0/2532334351 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fb1c0052020 con 0x7fb1d00d1c10 2024-03-26T06:16:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:16:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:16:37.026603+0000","last_up_change":"0.000000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:16:37.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.405+0000 7fb1cf200640 1 -- 172.21.15.63:0/2532334351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d00d1c10 msgr2=0x7fb1d00b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:37.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.405+0000 7fb1cf200640 1 --2- 172.21.15.63:0/2532334351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d00d1c10 0x7fb1d00b3ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0000c00 tx=0x7fb1c00046c0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.405+0000 7fb1cf200640 1 -- 172.21.15.63:0/2532334351 shutdown_connections 2024-03-26T06:16:37.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.405+0000 7fb1cf200640 1 --2- 172.21.15.63:0/2532334351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d015d9a0 0x7fb1d015feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.405+0000 7fb1cf200640 1 --2- 172.21.15.63:0/2532334351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d00d3250 0x7fb1d00b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.405+0000 7fb1cf200640 1 --2- 172.21.15.63:0/2532334351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1d00d1c10 0x7fb1d00b3ab0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:37.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.405+0000 7fb1cf200640 1 -- 172.21.15.63:0/2532334351 >> 172.21.15.63:0/2532334351 conn(0x7fb1d006bfa0 msgr2=0x7fb1d00cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:37.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.405+0000 7fb1cf200640 1 -- 172.21.15.63:0/2532334351 shutdown_connections 2024-03-26T06:16:37.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:37.406+0000 7fb1cf200640 1 -- 172.21.15.63:0/2532334351 wait complete. 2024-03-26T06:16:37.423 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-26T06:16:37.424 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-26T06:16:37.647 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:37.646+0000 7f550b614040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-26T06:16:37.664 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:37.663+0000 7f8fa6821040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-26T06:16:37.710 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:37.709+0000 7f550b614040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-26T06:16:37.725 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:37.724+0000 7f8fa6821040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-26T06:16:37.759 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T06:16:37.758+0000 7f7604648640 -1 Falling back to public interface 2024-03-26T06:16:37.770 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T06:16:37.770+0000 7fe5e1a22640 -1 Falling back to public interface 2024-03-26T06:16:37.775 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T06:16:37.775+0000 7f7a1d56b640 -1 Falling back to public interface 2024-03-26T06:16:37.785 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T06:16:37.784+0000 7f2855248640 -1 Falling back to public interface 2024-03-26T06:16:37.794 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T06:16:37.793+0000 7f55b612a640 -1 Falling back to public interface 2024-03-26T06:16:37.798 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T06:16:37.798+0000 7fe85b614640 -1 Falling back to public interface 2024-03-26T06:16:37.811 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T06:16:37.811+0000 7f7b96ea6640 -1 Falling back to public interface 2024-03-26T06:16:37.815 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T06:16:37.815+0000 7fae02413640 -1 Falling back to public interface 2024-03-26T06:16:37.853 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:37.852+0000 7f550b614040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-26T06:16:37.870 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-26T06:16:37.870+0000 7f8fa6821040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-26T06:16:38.229 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-26T06:16:38.411 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.410+0000 7fe790800640 1 Processor -- start 2024-03-26T06:16:38.411 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.410+0000 7fe790800640 1 -- start start 2024-03-26T06:16:38.412 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.411+0000 7fe790800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe7880cd9e0 0x7fe788160020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:38.412 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.411+0000 7fe790800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7880cddc0 0x7fe78815c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.411+0000 7fe790800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe788160560 con 0x7fe78815c560 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.411+0000 7fe790800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78815cb50 con 0x7fe7880cddc0 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.411+0000 7fe790800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78815ce30 con 0x7fe7880cd9e0 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.411+0000 7fe78d400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7880cddc0 0x7fe78815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.411+0000 7fe78d400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7880cddc0 0x7fe78815c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49194/0 (socket says 172.21.15.63:49194) 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.411+0000 7fe78d400640 1 -- 172.21.15.63:0/4202781049 learned_addr learned my addr 172.21.15.63:0/4202781049 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.412+0000 7fe78de00640 1 --2- 172.21.15.63:0/4202781049 >> v2:172.21.15.204:3300/0 conn(0x7fe7880cd9e0 0x7fe788160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.412+0000 7fe78d400640 1 -- 172.21.15.63:0/4202781049 >> v2:172.21.15.204:3300/0 conn(0x7fe7880cd9e0 msgr2=0x7fe788160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.412+0000 7fe78d400640 1 --2- 172.21.15.63:0/4202781049 >> v2:172.21.15.204:3300/0 conn(0x7fe7880cd9e0 0x7fe788160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.412+0000 7fe78d400640 1 -- 172.21.15.63:0/4202781049 >> v1:172.21.15.204:6789/0 conn(0x7fe78815c560 legacy=0x7fe7880cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:38.413 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.412+0000 7fe78d400640 1 -- 172.21.15.63:0/4202781049 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78815f820 con 0x7fe7880cddc0 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.413+0000 7fe78d400640 1 --2- 172.21.15.63:0/4202781049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 0x7fe78815c020 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe78806cde0 tx=0x7fe77c02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d228fea13a29a73f server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.413+0000 7fe78ca00640 1 -- 172.21.15.63:0/4202781049 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c035020 con 0x7fe7880cddc0 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.413+0000 7fe78ca00640 1 -- 172.21.15.63:0/4202781049 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c031890 con 0x7fe7880cddc0 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.413+0000 7fe78ca00640 1 -- 172.21.15.63:0/4202781049 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c031c60 con 0x7fe7880cddc0 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.413+0000 7fe790800640 1 -- 172.21.15.63:0/4202781049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 msgr2=0x7fe78815c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.414+0000 7fe790800640 1 --2- 172.21.15.63:0/4202781049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 0x7fe78815c020 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe78806cde0 tx=0x7fe77c02b930 comp rx=0 tx=0).stop 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.414+0000 7fe790800640 1 -- 172.21.15.63:0/4202781049 shutdown_connections 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.414+0000 7fe790800640 1 --2- 172.21.15.63:0/4202781049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 0x7fe78815c020 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.414+0000 7fe790800640 1 --2- 172.21.15.63:0/4202781049 >> v2:172.21.15.204:3300/0 conn(0x7fe7880cd9e0 0x7fe788160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.414+0000 7fe790800640 1 -- 172.21.15.63:0/4202781049 >> 172.21.15.63:0/4202781049 conn(0x7fe78806ace0 msgr2=0x7fe78806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.414+0000 7fe790800640 1 -- 172.21.15.63:0/4202781049 shutdown_connections 2024-03-26T06:16:38.415 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.414+0000 7fe790800640 1 -- 172.21.15.63:0/4202781049 wait complete. 2024-03-26T06:16:38.416 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.415+0000 7fe790800640 1 Processor -- start 2024-03-26T06:16:38.416 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.415+0000 7fe790800640 1 -- start start 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.416+0000 7fe790800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7880cd9e0 0x7fe7880b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.416+0000 7fe790800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 0x7fe788144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.416+0000 7fe790800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe78815c560 0x7fe7880ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.416+0000 7fe790800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe788071640 con 0x7fe7880cddc0 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.416+0000 7fe790800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78806f1f0 con 0x7fe7880cd9e0 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.416+0000 7fe790800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880ce220 con 0x7fe78815c560 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 0x7fe788144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 0x7fe788144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49204/0 (socket says 172.21.15.63:49204) 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78d400640 1 -- 172.21.15.63:0/2386268368 learned_addr learned my addr 172.21.15.63:0/2386268368 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:38.418 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78e800640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe78815c560 0x7fe7880ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:38.419 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78de00640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7880cd9e0 0x7fe7880b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:38.419 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78d400640 1 -- 172.21.15.63:0/2386268368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe78815c560 msgr2=0x7fe7880ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:38.419 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78d400640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe78815c560 0x7fe7880ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:38.419 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78d400640 1 -- 172.21.15.63:0/2386268368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7880cd9e0 msgr2=0x7fe7880b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:38.419 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78d400640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7880cd9e0 0x7fe7880b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:38.419 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78d400640 1 -- 172.21.15.63:0/2386268368 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7880ad1b0 con 0x7fe7880cddc0 2024-03-26T06:16:38.419 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78de00640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7880cd9e0 0x7fe7880b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:38.420 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.417+0000 7fe78d400640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 0x7fe788144250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe77c02b970 tx=0x7fe77c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:38.420 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.418+0000 7fe782000640 1 -- 172.21.15.63:0/2386268368 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c040070 con 0x7fe7880cddc0 2024-03-26T06:16:38.420 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.418+0000 7fe782000640 1 -- 172.21.15.63:0/2386268368 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c03a420 con 0x7fe7880cddc0 2024-03-26T06:16:38.420 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.418+0000 7fe782000640 1 -- 172.21.15.63:0/2386268368 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c035040 con 0x7fe7880cddc0 2024-03-26T06:16:38.420 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.418+0000 7fe790800640 1 -- 172.21.15.63:0/2386268368 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7880b34f0 con 0x7fe7880cddc0 2024-03-26T06:16:38.421 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.418+0000 7fe790800640 1 -- 172.21.15.63:0/2386268368 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7880b3ab0 con 0x7fe7880cddc0 2024-03-26T06:16:38.421 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.419+0000 7fe782000640 1 -- 172.21.15.63:0/2386268368 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 2) v1 ==== 45093+0+0 (secure 0 0 0) 0x7fe77c038020 con 0x7fe7880cddc0 2024-03-26T06:16:38.421 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.419+0000 7fe790800640 1 -- 172.21.15.63:0/2386268368 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7880b3300 con 0x7fe7880cddc0 2024-03-26T06:16:38.421 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.420+0000 7fe782000640 1 -- 172.21.15.63:0/2386268368 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe77c06c260 con 0x7fe7880cddc0 2024-03-26T06:16:38.423 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.422+0000 7fe782000640 1 -- 172.21.15.63:0/2386268368 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fe77c02d040 con 0x7fe7880cddc0 2024-03-26T06:16:38.492 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.491+0000 7fe790800640 1 -- 172.21.15.63:0/2386268368 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe788068610 con 0x7fe7880cddc0 2024-03-26T06:16:38.493 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.492+0000 7fe782000640 1 -- 172.21.15.63:0/2386268368 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fe77c031750 con 0x7fe7880cddc0 2024-03-26T06:16:38.493 INFO:teuthology.misc.health.smithi063.stdout: 2024-03-26T06:16:38.494 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":10,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:16:37.026603+0000","last_up_change":"0.000000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:16:38.495 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.493+0000 7fe790800640 1 -- 172.21.15.63:0/2386268368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 msgr2=0x7fe788144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:38.495 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.493+0000 7fe790800640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 0x7fe788144250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe77c02b970 tx=0x7fe77c0046c0 comp rx=0 tx=0).stop 2024-03-26T06:16:38.495 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.494+0000 7fe790800640 1 -- 172.21.15.63:0/2386268368 shutdown_connections 2024-03-26T06:16:38.495 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.494+0000 7fe790800640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe78815c560 0x7fe7880ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:38.495 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.494+0000 7fe790800640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7880cddc0 0x7fe788144250 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:38.495 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.494+0000 7fe790800640 1 --2- 172.21.15.63:0/2386268368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7880cd9e0 0x7fe7880b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:38.495 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.494+0000 7fe790800640 1 -- 172.21.15.63:0/2386268368 >> 172.21.15.63:0/2386268368 conn(0x7fe78806ace0 msgr2=0x7fe78806d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:38.495 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.494+0000 7fe790800640 1 -- 172.21.15.63:0/2386268368 shutdown_connections 2024-03-26T06:16:38.496 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:38.494+0000 7fe790800640 1 -- 172.21.15.63:0/2386268368 wait complete. 2024-03-26T06:16:38.508 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-26T06:16:38.888 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:38.887+0000 7f54abc00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-26T06:16:38.889 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T06:16:38.888+0000 7f54abc00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-26T06:16:41.312 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T06:16:41.312+0000 7f7a1d56b640 -1 osd.6 0 log_to_monitors true 2024-03-26T06:16:41.345 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T06:16:41.345+0000 7f7b96ea6640 -1 osd.7 0 log_to_monitors true 2024-03-26T06:16:41.374 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T06:16:41.373+0000 7f55b612a640 -1 osd.1 0 log_to_monitors true 2024-03-26T06:16:41.375 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T06:16:41.373+0000 7fe85b614640 -1 osd.3 0 log_to_monitors true 2024-03-26T06:16:41.389 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T06:16:41.389+0000 7fae02413640 -1 osd.4 0 log_to_monitors true 2024-03-26T06:16:41.523 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T06:16:41.522+0000 7f7604648640 -1 osd.0 0 log_to_monitors true 2024-03-26T06:16:41.576 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T06:16:41.575+0000 7fe5e1a22640 -1 osd.5 0 log_to_monitors true 2024-03-26T06:16:41.591 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T06:16:41.590+0000 7f2855248640 -1 osd.2 0 log_to_monitors true 2024-03-26T06:16:45.251 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T06:16:45.251+0000 7fadfd600640 -1 osd.4 0 waiting for initial osdmap 2024-03-26T06:16:45.264 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T06:16:45.263+0000 7fadf2c00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T06:16:45.314 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-26T06:16:45.374 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T06:16:45.372+0000 7f2850000640 -1 osd.2 0 waiting for initial osdmap 2024-03-26T06:16:45.381 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T06:16:45.381+0000 7f2846000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T06:16:45.405 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T06:16:45.403+0000 7fe856800640 -1 osd.3 0 waiting for initial osdmap 2024-03-26T06:16:45.413 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T06:16:45.412+0000 7fe5dce00640 -1 osd.5 0 waiting for initial osdmap 2024-03-26T06:16:45.414 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T06:16:45.412+0000 7fe84be00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T06:16:45.424 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T06:16:45.424+0000 7f7b91e00640 -1 osd.7 0 waiting for initial osdmap 2024-03-26T06:16:45.425 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T06:16:45.424+0000 7fe5d2400640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T06:16:45.425 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T06:16:45.425+0000 7f7a18400640 -1 osd.6 0 waiting for initial osdmap 2024-03-26T06:16:45.434 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T06:16:45.434+0000 7f7a0e400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T06:16:45.439 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T06:16:45.438+0000 7f55b1000640 -1 osd.1 0 waiting for initial osdmap 2024-03-26T06:16:45.440 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T06:16:45.440+0000 7f7b87e00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T06:16:45.450 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T06:16:45.449+0000 7f75ffe00640 -1 osd.0 0 waiting for initial osdmap 2024-03-26T06:16:45.455 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T06:16:45.455+0000 7f55a7000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T06:16:45.458 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T06:16:45.457+0000 7f75f5400640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T06:16:45.512 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.511+0000 7fe1ef200640 1 Processor -- start 2024-03-26T06:16:45.512 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.511+0000 7fe1ef200640 1 -- start start 2024-03-26T06:16:45.514 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.512+0000 7fe1ef200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1f00b6d60 0x7fe1f00ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:45.514 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ef200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f00cf0c0 con 0x7fe1f00d0b20 2024-03-26T06:16:45.514 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ef200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f00d1e20 con 0x7fe1f015d900 2024-03-26T06:16:45.514 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ef200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f00cf3a0 con 0x7fe1f00b6d60 2024-03-26T06:16:45.514 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ee800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1f00b6d60 0x7fe1f00ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:45.514 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ee800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1f00b6d60 0x7fe1f00ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57042/0 (socket says 172.21.15.63:57042) 2024-03-26T06:16:45.514 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ee800640 1 -- 172.21.15.63:0/2395312011 learned_addr learned my addr 172.21.15.63:0/2395312011 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:45.515 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ed400640 1 --1- 172.21.15.63:0/2395312011 >> v1:172.21.15.63:6789/0 conn(0x7fe1f00d0b20 0x7fe1f00d2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35746/0 (socket says 172.21.15.63:35746) 2024-03-26T06:16:45.515 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ee800640 1 -- 172.21.15.63:0/2395312011 >> v1:172.21.15.204:6789/0 conn(0x7fe1f015d900 legacy=0x7fe1f00d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:45.515 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ee800640 1 -- 172.21.15.63:0/2395312011 >> v1:172.21.15.63:6789/0 conn(0x7fe1f00d0b20 legacy=0x7fe1f00d2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:45.515 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1ee800640 1 -- 172.21.15.63:0/2395312011 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00d2100 con 0x7fe1f00b6d60 2024-03-26T06:16:45.515 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.513+0000 7fe1eca00640 1 -- 172.21.15.63:0/2395312011 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455471446 0 0) 0x7fe1f00cf0c0 con 0x7fe1f00d0b20 2024-03-26T06:16:45.516 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.514+0000 7fe1ee800640 1 --2- 172.21.15.63:0/2395312011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f00b6d60 0x7fe1f00ce9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009e80 tx=0x7fe1e802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a7b45cb5c60eac server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:45.516 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1eca00640 1 -- 172.21.15.63:0/2395312011 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e802caf0 con 0x7fe1f00b6d60 2024-03-26T06:16:45.516 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1eca00640 1 -- 172.21.15.63:0/2395312011 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e802cc90 con 0x7fe1f00b6d60 2024-03-26T06:16:45.516 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1eca00640 1 -- 172.21.15.63:0/2395312011 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8034610 con 0x7fe1f00b6d60 2024-03-26T06:16:45.516 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1ef200640 1 -- 172.21.15.63:0/2395312011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f00b6d60 msgr2=0x7fe1f00ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:45.516 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1ef200640 1 --2- 172.21.15.63:0/2395312011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f00b6d60 0x7fe1f00ce9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009e80 tx=0x7fe1e802bf50 comp rx=0 tx=0).stop 2024-03-26T06:16:45.516 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1ef200640 1 -- 172.21.15.63:0/2395312011 shutdown_connections 2024-03-26T06:16:45.517 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1ef200640 1 --2- 172.21.15.63:0/2395312011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f00b6d60 0x7fe1f00ce9c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:45.517 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1ef200640 1 -- 172.21.15.63:0/2395312011 >> 172.21.15.63:0/2395312011 conn(0x7fe1f00b5570 msgr2=0x7fe1f00b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:45.517 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1ef200640 1 -- 172.21.15.63:0/2395312011 shutdown_connections 2024-03-26T06:16:45.517 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.515+0000 7fe1ef200640 1 -- 172.21.15.63:0/2395312011 wait complete. 2024-03-26T06:16:45.518 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.517+0000 7fe1ef200640 1 Processor -- start 2024-03-26T06:16:45.518 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.517+0000 7fe1ef200640 1 -- start start 2024-03-26T06:16:45.520 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ef200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1f00b6d60 0x7fe1f00cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:45.520 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ef200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1f00d0b20 0x7fe1f00cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:45.520 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ef200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f015d900 0x7fe1f01f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:45.520 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ef200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f015de60 con 0x7fe1f015d900 2024-03-26T06:16:45.520 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ef200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f015dce0 con 0x7fe1f00b6d60 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ef200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f015dfe0 con 0x7fe1f00d0b20 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ee800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f015d900 0x7fe1f01f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ee800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f015d900 0x7fe1f01f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57050/0 (socket says 172.21.15.63:57050) 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ee800640 1 -- 172.21.15.63:0/3210935043 learned_addr learned my addr 172.21.15.63:0/3210935043 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ed400640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1f00d0b20 0x7fe1f00cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ee800640 1 -- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1f00d0b20 msgr2=0x7fe1f00cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1ee800640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1f00d0b20 0x7fe1f00cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1ee800640 1 -- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1f00b6d60 msgr2=0x7fe1f00cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.518+0000 7fe1ede00640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1f00b6d60 0x7fe1f00cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1ee800640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1f00b6d60 0x7fe1f00cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1ee800640 1 -- 172.21.15.63:0/3210935043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f01565b0 con 0x7fe1f015d900 2024-03-26T06:16:45.521 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1ed400640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1f00d0b20 0x7fe1f00cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:45.522 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1ede00640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1f00b6d60 0x7fe1f00cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:45.522 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1ee800640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f015d900 0x7fe1f01f3ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009e80 tx=0x7fe1e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:45.522 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1e6000640 1 -- 172.21.15.63:0/3210935043 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8043030 con 0x7fe1f015d900 2024-03-26T06:16:45.522 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1e6000640 1 -- 172.21.15.63:0/3210935043 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e803e450 con 0x7fe1f015d900 2024-03-26T06:16:45.522 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f00cba00 con 0x7fe1f015d900 2024-03-26T06:16:45.522 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1e6000640 1 -- 172.21.15.63:0/3210935043 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8009510 con 0x7fe1f015d900 2024-03-26T06:16:45.522 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.519+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f00cbfc0 con 0x7fe1f015d900 2024-03-26T06:16:45.523 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.521+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f015d160 con 0x7fe1f015d900 2024-03-26T06:16:45.523 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.521+0000 7fe1e6000640 1 -- 172.21.15.63:0/3210935043 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 90080+0+0 (secure 0 0 0) 0x7fe1e8046070 con 0x7fe1f015d900 2024-03-26T06:16:45.523 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.522+0000 7fe1e6000640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe1d006bb70 0x7fe1d006e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:45.523 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.522+0000 7fe1e6000640 1 -- 172.21.15.63:0/3210935043 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fe1e80ac070 con 0x7fe1f015d900 2024-03-26T06:16:45.523 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.522+0000 7fe1ede00640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe1d006bb70 0x7fe1d006e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:45.524 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.523+0000 7fe1ede00640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe1d006bb70 0x7fe1d006e030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000a830 tx=0x7fe1e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:45.528 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.527+0000 7fe1e6000640 1 -- 172.21.15.63:0/3210935043 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe1f015d160 con 0x7fe1f015d900 2024-03-26T06:16:45.723 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.722+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1f004f050 con 0x7fe1f015d900 2024-03-26T06:16:45.724 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.723+0000 7fe1e6000640 1 -- 172.21.15.63:0/3210935043 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fe1e804d070 con 0x7fe1f015d900 2024-03-26T06:16:45.724 INFO:teuthology.misc.health.smithi063.stdout: 2024-03-26T06:16:45.725 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":12,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:16:42.958428+0000","last_up_change":"0.000000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:16:45.727 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe1d006bb70 msgr2=0x7fe1d006e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:45.727 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe1d006bb70 0x7fe1d006e030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000a830 tx=0x7fe1e0008040 comp rx=0 tx=0).stop 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f015d900 msgr2=0x7fe1f01f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f015d900 0x7fe1f01f3ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009e80 tx=0x7fe1e8004a40 comp rx=0 tx=0).stop 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 shutdown_connections 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe1d006bb70 0x7fe1d006e030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1f015d900 0x7fe1f01f3ae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1f00d0b20 0x7fe1f00cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 --2- 172.21.15.63:0/3210935043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1f00b6d60 0x7fe1f00cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 >> 172.21.15.63:0/3210935043 conn(0x7fe1f00b5570 msgr2=0x7fe1f0156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 shutdown_connections 2024-03-26T06:16:45.728 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:45.726+0000 7fe1ef200640 1 -- 172.21.15.63:0/3210935043 wait complete. 2024-03-26T06:16:45.740 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-26T06:16:47.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:16:47.677 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:16:52.547 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-26T06:16:52.747 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.746+0000 7f0377000640 1 Processor -- start 2024-03-26T06:16:52.747 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.746+0000 7f0377000640 1 -- start start 2024-03-26T06:16:52.750 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.748+0000 7f0377000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0370144050 0x7f037006ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:52.750 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.748+0000 7f0377000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f03701473e0 0x7f03700b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:52.750 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.748+0000 7f0377000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0370162600 con 0x7f03701616c0 2024-03-26T06:16:52.750 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.748+0000 7f0377000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0370072700 con 0x7f03701473e0 2024-03-26T06:16:52.750 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.748+0000 7f0377000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037006df90 con 0x7f0370144050 2024-03-26T06:16:52.750 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.749+0000 7f0375c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0370144050 0x7f037006ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:52.750 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.749+0000 7f0375c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0370144050 0x7f037006ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:41842/0 (socket says 172.21.15.63:41842) 2024-03-26T06:16:52.751 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.749+0000 7f0375c00640 1 -- 172.21.15.63:0/2880758774 learned_addr learned my addr 172.21.15.63:0/2880758774 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:52.751 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.749+0000 7f0375200640 1 --2- 172.21.15.63:0/2880758774 >> v2:172.21.15.63:3300/0 conn(0x7f03701473e0 0x7f03700b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:52.751 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.749+0000 7f0375c00640 1 -- 172.21.15.63:0/2880758774 >> v2:172.21.15.63:3300/0 conn(0x7f03701473e0 msgr2=0x7f03700b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:52.751 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.749+0000 7f0375c00640 1 --2- 172.21.15.63:0/2880758774 >> v2:172.21.15.63:3300/0 conn(0x7f03701473e0 0x7f03700b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:52.751 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.749+0000 7f0375c00640 1 -- 172.21.15.63:0/2880758774 >> v1:172.21.15.63:6789/0 conn(0x7f03701616c0 legacy=0x7f0370161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:52.751 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.749+0000 7f0375c00640 1 -- 172.21.15.63:0/2880758774 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0370162320 con 0x7f0370144050 2024-03-26T06:16:52.751 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.750+0000 7f0375c00640 1 --2- 172.21.15.63:0/2880758774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0370144050 0x7f037006ea30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0370072e00 tx=0x7f036402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f10fbd773c84b473 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:52.752 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.751+0000 7f036fe00640 1 -- 172.21.15.63:0/2880758774 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364035020 con 0x7f0370144050 2024-03-26T06:16:52.752 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.751+0000 7f036fe00640 1 -- 172.21.15.63:0/2880758774 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0364031870 con 0x7f0370144050 2024-03-26T06:16:52.752 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.751+0000 7f036fe00640 1 -- 172.21.15.63:0/2880758774 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364031c40 con 0x7f0370144050 2024-03-26T06:16:52.753 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.751+0000 7f0377000640 1 -- 172.21.15.63:0/2880758774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0370144050 msgr2=0x7f037006ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:52.753 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.751+0000 7f0377000640 1 --2- 172.21.15.63:0/2880758774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0370144050 0x7f037006ea30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0370072e00 tx=0x7f036402b910 comp rx=0 tx=0).stop 2024-03-26T06:16:52.753 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.752+0000 7f0377000640 1 -- 172.21.15.63:0/2880758774 shutdown_connections 2024-03-26T06:16:52.753 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.752+0000 7f0377000640 1 --2- 172.21.15.63:0/2880758774 >> v2:172.21.15.63:3300/0 conn(0x7f03701473e0 0x7f03700b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:52.753 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.752+0000 7f0377000640 1 --2- 172.21.15.63:0/2880758774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0370144050 0x7f037006ea30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:52.753 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.752+0000 7f0377000640 1 -- 172.21.15.63:0/2880758774 >> 172.21.15.63:0/2880758774 conn(0x7f03700b14d0 msgr2=0x7f03700b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:52.753 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.752+0000 7f0377000640 1 -- 172.21.15.63:0/2880758774 shutdown_connections 2024-03-26T06:16:52.753 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.752+0000 7f0377000640 1 -- 172.21.15.63:0/2880758774 wait complete. 2024-03-26T06:16:52.754 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.754+0000 7f0377000640 1 Processor -- start 2024-03-26T06:16:52.755 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.754+0000 7f0377000640 1 -- start start 2024-03-26T06:16:52.757 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0377000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0370144050 0x7f037015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:52.757 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0377000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03701473e0 0x7f03700ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0377000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03701616c0 0x7f03701e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0377000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370144430 con 0x7f03701473e0 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0377000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037006e510 con 0x7f0370144050 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0377000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03701445b0 con 0x7f03701616c0 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0375200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03701473e0 0x7f03700ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0375200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03701473e0 0x7f03700ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60074/0 (socket says 172.21.15.63:60074) 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0375200640 1 -- 172.21.15.63:0/1027021411 learned_addr learned my addr 172.21.15.63:0/1027021411 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.755+0000 7f0375c00640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0370144050 0x7f037015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f0375200640 1 -- 172.21.15.63:0/1027021411 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03701616c0 msgr2=0x7f03701e7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f0376600640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03701616c0 0x7f03701e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f0375200640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03701616c0 0x7f03701e7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:52.758 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f0375200640 1 -- 172.21.15.63:0/1027021411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0370144050 msgr2=0x7f037015ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:52.759 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f0375200640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0370144050 0x7f037015ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:52.759 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f0375200640 1 -- 172.21.15.63:0/1027021411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700cc350 con 0x7f03701473e0 2024-03-26T06:16:52.759 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f0375200640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03701473e0 0x7f03700ced90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f035c00e9b0 tx=0x7f035c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:52.759 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f036d600640 1 -- 172.21.15.63:0/1027021411 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c017070 con 0x7f03701473e0 2024-03-26T06:16:52.759 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f036d600640 1 -- 172.21.15.63:0/1027021411 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c00c9a0 con 0x7f03701473e0 2024-03-26T06:16:52.759 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f036d600640 1 -- 172.21.15.63:0/1027021411 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c00cd90 con 0x7f03701473e0 2024-03-26T06:16:52.759 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.756+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03700cc630 con 0x7f03701473e0 2024-03-26T06:16:52.759 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.757+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03700ccbf0 con 0x7f03701473e0 2024-03-26T06:16:52.759 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.758+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037004f050 con 0x7f03701473e0 2024-03-26T06:16:52.761 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.760+0000 7f036d600640 1 -- 172.21.15.63:0/1027021411 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f035c01a070 con 0x7f03701473e0 2024-03-26T06:16:52.762 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.761+0000 7f036d600640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f035006bc20 0x7f035006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:52.762 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.761+0000 7f036d600640 1 -- 172.21.15.63:0/1027021411 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f035c08ad40 con 0x7f03701473e0 2024-03-26T06:16:52.762 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.761+0000 7f0375c00640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f035006bc20 0x7f035006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:52.762 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.762+0000 7f0375c00640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f035006bc20 0x7f035006e0e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0364036000 tx=0x7f036403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:52.766 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.766+0000 7f036d600640 1 -- 172.21.15.63:0/1027021411 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f035c0596a0 con 0x7f03701473e0 2024-03-26T06:16:52.970 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.969+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f037006c3d0 con 0x7f03701473e0 2024-03-26T06:16:52.972 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.972+0000 7f036d600640 1 -- 172.21.15.63:0/1027021411 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12896 (secure 0 0 0) 0x7f035c05d740 con 0x7f03701473e0 2024-03-26T06:16:52.973 INFO:teuthology.misc.health.smithi063.stdout: 2024-03-26T06:16:52.973 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":17,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:16:50.314666+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.974+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f035006bc20 msgr2=0x7f035006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.974+0000 7f0377000640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f035006bc20 0x7f035006e0e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0364036000 tx=0x7f036403c040 comp rx=0 tx=0).stop 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.974+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03701473e0 msgr2=0x7f03700ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.974+0000 7f0377000640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03701473e0 0x7f03700ced90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f035c00e9b0 tx=0x7f035c00ee70 comp rx=0 tx=0).stop 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.975+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 shutdown_connections 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.975+0000 7f0377000640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f035006bc20 0x7f035006e0e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.975+0000 7f0377000640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03701616c0 0x7f03701e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.975+0000 7f0377000640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03701473e0 0x7f03700ced90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.975+0000 7f0377000640 1 --2- 172.21.15.63:0/1027021411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0370144050 0x7f037015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.975+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 >> 172.21.15.63:0/1027021411 conn(0x7f03700b14d0 msgr2=0x7f0370146790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:52.976 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.975+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 shutdown_connections 2024-03-26T06:16:52.977 INFO:teuthology.misc.health.smithi063.stderr:2024-03-26T06:16:52.975+0000 7f0377000640 1 -- 172.21.15.63:0/1027021411 wait complete. 2024-03-26T06:16:52.991 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-26T06:16:52.991 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-26T06:16:52.992 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-26T06:16:52.992 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-26T06:16:52.996 INFO:tasks.ceph.mds.a:Started 2024-03-26T06:16:52.996 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-26T06:16:52.996 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-26T06:16:53.001 INFO:tasks.ceph.mds.c:Started 2024-03-26T06:16:53.001 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-26T06:16:53.001 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-26T06:16:53.009 INFO:tasks.ceph.mds.b:Started 2024-03-26T06:16:53.009 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-26T06:16:53.009 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-26T06:16:53.016 INFO:tasks.ceph.mds.d:Started 2024-03-26T06:16:53.016 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-26T06:16:53.016 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:16:53.152 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-03-26T06:16:53.153 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2024-03-26T06:16:53.171 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-03-26T06:16:53.175 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-03-26T06:16:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.209+0000 7f6354200640 1 Processor -- start 2024-03-26T06:16:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.209+0000 7f6354200640 1 -- start start 2024-03-26T06:16:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.210+0000 7f6354200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f634c15a900 0x7f634c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.210+0000 7f6354200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cf920 0x7f634c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.210+0000 7f6354200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c06cc60 con 0x7f634c0b2e50 2024-03-26T06:16:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.210+0000 7f6354200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0cf490 con 0x7f634c15a900 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.210+0000 7f6354200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0ceb60 con 0x7f634c0cf920 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f6350e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f634c0b2e50 0x7f634c0cad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59474/0 (socket says 172.21.15.63:59474) 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f6350e00640 1 -- 172.21.15.63:0/2875176562 learned_addr learned my addr 172.21.15.63:0/2875176562 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f6352200640 1 --2- 172.21.15.63:0/2875176562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cf920 0x7f634c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f6351800640 1 --2- 172.21.15.63:0/2875176562 >> v2:172.21.15.204:3300/0 conn(0x7f634c15a900 0x7f634c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f634be00640 1 -- 172.21.15.63:0/2875176562 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858498301 0 0) 0x7f634c06cc60 con 0x7f634c0b2e50 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f634be00640 1 -- 172.21.15.63:0/2875176562 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6334003520 con 0x7f634c0b2e50 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f6352200640 1 -- 172.21.15.63:0/2875176562 >> v2:172.21.15.204:3300/0 conn(0x7f634c15a900 msgr2=0x7f634c0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f6352200640 1 --2- 172.21.15.63:0/2875176562 >> v2:172.21.15.204:3300/0 conn(0x7f634c15a900 0x7f634c0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f6352200640 1 -- 172.21.15.63:0/2875176562 >> v1:172.21.15.63:6789/0 conn(0x7f634c0b2e50 legacy=0x7f634c0cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.211+0000 7f6352200640 1 -- 172.21.15.63:0/2875176562 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0cee40 con 0x7f634c0cf920 2024-03-26T06:16:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.213+0000 7f6352200640 1 --2- 172.21.15.63:0/2875176562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cf920 0x7f634c0cfd70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6344009d90 tx=0x7f634402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df622761ccb0754 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.213+0000 7f634be00640 1 -- 172.21.15.63:0/2875176562 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344039070 con 0x7f634c0cf920 2024-03-26T06:16:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.213+0000 7f634be00640 1 -- 172.21.15.63:0/2875176562 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634402cc50 con 0x7f634c0cf920 2024-03-26T06:16:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.213+0000 7f634be00640 1 -- 172.21.15.63:0/2875176562 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344034440 con 0x7f634c0cf920 2024-03-26T06:16:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.214+0000 7f6354200640 1 -- 172.21.15.63:0/2875176562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cf920 msgr2=0x7f634c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.214+0000 7f6354200640 1 --2- 172.21.15.63:0/2875176562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cf920 0x7f634c0cfd70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6344009d90 tx=0x7f634402bea0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.214+0000 7f6354200640 1 -- 172.21.15.63:0/2875176562 shutdown_connections 2024-03-26T06:16:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.214+0000 7f6354200640 1 --2- 172.21.15.63:0/2875176562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cf920 0x7f634c0cfd70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.214+0000 7f6354200640 1 --2- 172.21.15.63:0/2875176562 >> v2:172.21.15.204:3300/0 conn(0x7f634c15a900 0x7f634c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.214+0000 7f6354200640 1 -- 172.21.15.63:0/2875176562 >> 172.21.15.63:0/2875176562 conn(0x7f634c0b2330 msgr2=0x7f634c0b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.214+0000 7f6354200640 1 -- 172.21.15.63:0/2875176562 shutdown_connections 2024-03-26T06:16:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.214+0000 7f6354200640 1 -- 172.21.15.63:0/2875176562 wait complete. 2024-03-26T06:16:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.215+0000 7f6354200640 1 Processor -- start 2024-03-26T06:16:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.216+0000 7f6354200640 1 -- start start 2024-03-26T06:16:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.216+0000 7f6354200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0b2e50 0x7f634c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6354200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634c0cf920 0x7f634c1f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6354200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c15a900 0x7f634c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6354200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0cb440 con 0x7f634c0cf920 2024-03-26T06:16:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6354200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c15ace0 con 0x7f634c15a900 2024-03-26T06:16:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6354200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0b4cd0 con 0x7f634c0b2e50 2024-03-26T06:16:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6350e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634c0cf920 0x7f634c1f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6350e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634c0cf920 0x7f634c1f7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60128/0 (socket says 172.21.15.63:60128) 2024-03-26T06:16:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6350e00640 1 -- 172.21.15.63:0/495643439 learned_addr learned my addr 172.21.15.63:0/495643439 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:53.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6350e00640 1 -- 172.21.15.63:0/495643439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0b2e50 msgr2=0x7f634c1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6350e00640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0b2e50 0x7f634c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6350e00640 1 -- 172.21.15.63:0/495643439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c15a900 msgr2=0x7f634c0b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6350e00640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c15a900 0x7f634c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.217+0000 7f6350e00640 1 -- 172.21.15.63:0/495643439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0b4980 con 0x7f634c0cf920 2024-03-26T06:16:53.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.218+0000 7f6350e00640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634c0cf920 0x7f634c1f7540 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f633800c430 tx=0x7f633800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:53.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.218+0000 7f6349600640 1 -- 172.21.15.63:0/495643439 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338017070 con 0x7f634c0cf920 2024-03-26T06:16:53.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.218+0000 7f6349600640 1 -- 172.21.15.63:0/495643439 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6338005ce0 con 0x7f634c0cf920 2024-03-26T06:16:53.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.218+0000 7f6349600640 1 -- 172.21.15.63:0/495643439 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63380072f0 con 0x7f634c0cf920 2024-03-26T06:16:53.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.218+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c1f7f20 con 0x7f634c0cf920 2024-03-26T06:16:53.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.218+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c153f10 con 0x7f634c0cf920 2024-03-26T06:16:53.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.219+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c067ce0 con 0x7f634c0cf920 2024-03-26T06:16:53.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.220+0000 7f6349600640 1 -- 172.21.15.63:0/495643439 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f633801a070 con 0x7f634c0cf920 2024-03-26T06:16:53.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.221+0000 7f6349600640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.221+0000 7f6349600640 1 -- 172.21.15.63:0/495643439 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6338089bf0 con 0x7f634c0cf920 2024-03-26T06:16:53.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.221+0000 7f6351800640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.222+0000 7f6351800640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6340006fd0 tx=0x7f6340008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.226+0000 7f6349600640 1 -- 172.21.15.63:0/495643439 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f634c067ce0 con 0x7f634c0cf920 2024-03-26T06:16:53.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.428+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f634c06e150 con 0x7f634c0cf920 2024-03-26T06:16:53.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.433+0000 7f6349600640 1 -- 172.21.15.63:0/495643439 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12896 (secure 0 0 0) 0x7f634c06e150 con 0x7f634c0cf920 2024-03-26T06:16:53.434 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:16:53.435 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:16:50.314666+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:16:53.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 msgr2=0x7f632c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6340006fd0 tx=0x7f6340008040 comp rx=0 tx=0).stop 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634c0cf920 msgr2=0x7f634c1f7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634c0cf920 0x7f634c1f7540 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f633800c430 tx=0x7f633800c8f0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 shutdown_connections 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c15a900 0x7f634c0b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634c0cf920 0x7f634c1f7540 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 --2- 172.21.15.63:0/495643439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0b2e50 0x7f634c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 >> 172.21.15.63:0/495643439 conn(0x7f634c0b2330 msgr2=0x7f634c159850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 shutdown_connections 2024-03-26T06:16:53.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.437+0000 7f6354200640 1 -- 172.21.15.63:0/495643439 wait complete. 2024-03-26T06:16:53.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-26T06:16:53.456 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:16:53.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.675+0000 7f298f000640 1 Processor -- start 2024-03-26T06:16:53.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.675+0000 7f298f000640 1 -- start start 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.677+0000 7f298f000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29880d3840 0x7f29880d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.677+0000 7f298f000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880d4160 con 0x7f29880b9320 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.677+0000 7f298f000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880d22d0 con 0x7f298815dca0 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.677+0000 7f298f000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29880d2070 con 0x7f29880d3840 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.677+0000 7f298e600640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f29880b9320 0x7f29880b6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59488/0 (socket says 172.21.15.63:59488) 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.677+0000 7f298e600640 1 -- 172.21.15.63:0/4282287838 learned_addr learned my addr 172.21.15.63:0/4282287838 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f298dc00640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29880d3840 0x7f29880d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380257122 0 0) 0x7f29880d4160 con 0x7f29880b9320 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2970003520 con 0x7f29880b9320 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570846917 0 0) 0x7f2970003520 con 0x7f29880b9320 2024-03-26T06:16:53.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29880d3840 msgr2=0x7f29880d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29880d3840 0x7f29880d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 >> v1:172.21.15.204:6789/0 conn(0x7f298815dca0 legacy=0x7f29880d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880d25b0 con 0x7f29880b9320 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f2980001670 con 0x7f29880b9320 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 >> v1:172.21.15.63:6789/0 conn(0x7f29880b9320 legacy=0x7f29880b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29700039e0 0x7f2970003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29880d3840 0x7f2970004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2970004d40 0x7f29700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880d2070 con 0x7f29700039e0 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297000ba70 con 0x7f2970004d40 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297000bc70 con 0x7f29880d3840 2024-03-26T06:16:53.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.678+0000 7f298dc00640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29700039e0 0x7f2970003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.679+0000 7f298dc00640 1 -- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29880d3840 msgr2=0x7f2970004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.679+0000 7f298d200640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29880d3840 0x7f2970004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.679+0000 7f298e600640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2970004d40 0x7f29700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.679+0000 7f298dc00640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29880d3840 0x7f2970004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.679+0000 7f298dc00640 1 -- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2970004d40 msgr2=0x7f29700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.679+0000 7f298dc00640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2970004d40 0x7f29700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.679+0000 7f298dc00640 1 -- 172.21.15.63:0/4282287838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970003520 con 0x7f29700039e0 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.679+0000 7f298d200640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29880d3840 0x7f2970004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.679+0000 7f298e600640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2970004d40 0x7f29700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:53.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.680+0000 7f298dc00640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29700039e0 0x7f2970003e00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f297c009f90 tx=0x7f2970005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f8bea22174ae27 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.680+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c039070 con 0x7f29700039e0 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.680+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c02cbd0 con 0x7f29700039e0 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.680+0000 7f2987e00640 1 -- 172.21.15.63:0/4282287838 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c009c10 con 0x7f29700039e0 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.681+0000 7f298f000640 1 -- 172.21.15.63:0/4282287838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29700039e0 msgr2=0x7f2970003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.681+0000 7f298f000640 1 --2- 172.21.15.63:0/4282287838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29700039e0 0x7f2970003e00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f297c009f90 tx=0x7f2970005830 comp rx=0 tx=0).stop 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.681+0000 7f298e600640 1 -- 172.21.15.63:0/4282287838 reap_dead start 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.681+0000 7f298f000640 1 -- 172.21.15.63:0/4282287838 shutdown_connections 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.681+0000 7f298f000640 1 -- 172.21.15.63:0/4282287838 >> 172.21.15.63:0/4282287838 conn(0x7f298806c570 msgr2=0x7f298806c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.681+0000 7f298f000640 1 -- 172.21.15.63:0/4282287838 shutdown_connections 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.681+0000 7f298f000640 1 -- 172.21.15.63:0/4282287838 wait complete. 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.684+0000 7f298f000640 1 Processor -- start 2024-03-26T06:16:53.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.684+0000 7f298f000640 1 -- start start 2024-03-26T06:16:53.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.685+0000 7f298f000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29700039e0 0x7f29881f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.685+0000 7f298f000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29880c95f0 0x7f29880c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.685+0000 7f298f000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29880c73c0 0x7f29880c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.685+0000 7f298f000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880d2e50 con 0x7f29880c95f0 2024-03-26T06:16:53.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.685+0000 7f298f000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880d2b70 con 0x7f29880c73c0 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.685+0000 7f298f000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29880d3370 con 0x7f29700039e0 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.685+0000 7f298d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29880c95f0 0x7f29880c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.685+0000 7f298d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29880c95f0 0x7f29880c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60148/0 (socket says 172.21.15.63:60148) 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.685+0000 7f298d200640 1 -- 172.21.15.63:0/3165771221 learned_addr learned my addr 172.21.15.63:0/3165771221 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298e600640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29880c73c0 0x7f29880c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298dc00640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29700039e0 0x7f29881f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298d200640 1 -- 172.21.15.63:0/3165771221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29700039e0 msgr2=0x7f29881f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298d200640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29700039e0 0x7f29881f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298d200640 1 -- 172.21.15.63:0/3165771221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29880c73c0 msgr2=0x7f29880c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298d200640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29880c73c0 0x7f29880c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298d200640 1 -- 172.21.15.63:0/3165771221 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880c80d0 con 0x7f29880c95f0 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298dc00640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29700039e0 0x7f29881f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298d200640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29880c95f0 0x7f29880c9a50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f297400d7d0 tx=0x7f297400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:53.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f2985600640 1 -- 172.21.15.63:0/3165771221 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974005070 con 0x7f29880c95f0 2024-03-26T06:16:53.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f2985600640 1 -- 172.21.15.63:0/3165771221 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974005230 con 0x7f29880c95f0 2024-03-26T06:16:53.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f2985600640 1 -- 172.21.15.63:0/3165771221 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974007030 con 0x7f29880c95f0 2024-03-26T06:16:53.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.686+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29880c83b0 con 0x7f29880c95f0 2024-03-26T06:16:53.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.687+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29880c8970 con 0x7f29880c95f0 2024-03-26T06:16:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.688+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298804f0c0 con 0x7f29880c95f0 2024-03-26T06:16:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.689+0000 7f2985600640 1 -- 172.21.15.63:0/3165771221 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f297401a020 con 0x7f29880c95f0 2024-03-26T06:16:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.690+0000 7f2985600640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f296806bc00 0x7f296806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.690+0000 7f2985600640 1 -- 172.21.15.63:0/3165771221 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2974089f90 con 0x7f29880c95f0 2024-03-26T06:16:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.690+0000 7f298dc00640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f296806bc00 0x7f296806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:53.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.691+0000 7f298dc00640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f296806bc00 0x7f296806e0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f297c036000 tx=0x7f297c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:53.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.697+0000 7f2985600640 1 -- 172.21.15.63:0/3165771221 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2974058dd0 con 0x7f29880c95f0 2024-03-26T06:16:53.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.899+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f298806b090 con 0x7f29880c95f0 2024-03-26T06:16:53.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.900+0000 7f2985600640 1 -- 172.21.15.63:0/3165771221 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29740586d0 con 0x7f29880c95f0 2024-03-26T06:16:53.901 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:16:53.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.902+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f296806bc00 msgr2=0x7f296806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.902+0000 7f298f000640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f296806bc00 0x7f296806e0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f297c036000 tx=0x7f297c02e000 comp rx=0 tx=0).stop 2024-03-26T06:16:53.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.902+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29880c95f0 msgr2=0x7f29880c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:53.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.902+0000 7f298f000640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29880c95f0 0x7f29880c9a50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f297400d7d0 tx=0x7f297400dc90 comp rx=0 tx=0).stop 2024-03-26T06:16:53.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.903+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 shutdown_connections 2024-03-26T06:16:53.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.903+0000 7f298f000640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f296806bc00 0x7f296806e0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.903+0000 7f298f000640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29880c73c0 0x7f29880c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.903+0000 7f298f000640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29880c95f0 0x7f29880c9a50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.903+0000 7f298f000640 1 --2- 172.21.15.63:0/3165771221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29700039e0 0x7f29881f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:53.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.903+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 >> 172.21.15.63:0/3165771221 conn(0x7f298806c570 msgr2=0x7f29880cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.903+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 shutdown_connections 2024-03-26T06:16:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:53.903+0000 7f298f000640 1 -- 172.21.15.63:0/3165771221 wait complete. 2024-03-26T06:16:53.923 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:16:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.138+0000 7f6bcee00640 1 Processor -- start 2024-03-26T06:16:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.138+0000 7f6bcee00640 1 -- start start 2024-03-26T06:16:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcee00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6bc815a600 0x7f6bc806ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcee00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6bc806f160 0x7f6bc80cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcee00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc80cca00 0x7f6bc80ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcee00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc806f5d0 con 0x7f6bc806f160 2024-03-26T06:16:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcee00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc815a9e0 con 0x7f6bc815a600 2024-03-26T06:16:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcee00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc815e1c0 con 0x7f6bc80cca00 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcd000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6bc806f160 0x7f6bc80cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcd000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6bc806f160 0x7f6bc80cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60154/0 (socket says 172.21.15.63:60154) 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcd000640 1 -- 172.21.15.63:0/800159681 learned_addr learned my addr 172.21.15.63:0/800159681 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcda00640 1 --2- 172.21.15.63:0/800159681 >> v2:172.21.15.204:3300/0 conn(0x7f6bc815a600 0x7f6bc806ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bce400640 1 --2- 172.21.15.63:0/800159681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc80cca00 0x7f6bc80ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcd000640 1 -- 172.21.15.63:0/800159681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc80cca00 msgr2=0x7f6bc80ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcd000640 1 --2- 172.21.15.63:0/800159681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc80cca00 0x7f6bc80ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcd000640 1 -- 172.21.15.63:0/800159681 >> v2:172.21.15.204:3300/0 conn(0x7f6bc815a600 msgr2=0x7f6bc806ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcd000640 1 --2- 172.21.15.63:0/800159681 >> v2:172.21.15.204:3300/0 conn(0x7f6bc815a600 0x7f6bc806ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.141+0000 7f6bcd000640 1 -- 172.21.15.63:0/800159681 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc815e4a0 con 0x7f6bc806f160 2024-03-26T06:16:54.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.142+0000 7f6bcd000640 1 --2- 172.21.15.63:0/800159681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 0x7f6bc80cc4c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80b2370 tx=0x7f6bb402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6a2698fc72d772 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:54.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.142+0000 7f6bc7e00640 1 -- 172.21.15.63:0/800159681 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4035020 con 0x7f6bc806f160 2024-03-26T06:16:54.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.142+0000 7f6bc7e00640 1 -- 172.21.15.63:0/800159681 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb4031870 con 0x7f6bc806f160 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.142+0000 7f6bc7e00640 1 -- 172.21.15.63:0/800159681 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4031c40 con 0x7f6bc806f160 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.143+0000 7f6bcee00640 1 -- 172.21.15.63:0/800159681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 msgr2=0x7f6bc80cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.143+0000 7f6bcee00640 1 --2- 172.21.15.63:0/800159681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 0x7f6bc80cc4c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80b2370 tx=0x7f6bb402b910 comp rx=0 tx=0).stop 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.143+0000 7f6bcee00640 1 -- 172.21.15.63:0/800159681 shutdown_connections 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.143+0000 7f6bcee00640 1 --2- 172.21.15.63:0/800159681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc80cca00 0x7f6bc80ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.143+0000 7f6bcee00640 1 --2- 172.21.15.63:0/800159681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 0x7f6bc80cc4c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.143+0000 7f6bcee00640 1 --2- 172.21.15.63:0/800159681 >> v2:172.21.15.204:3300/0 conn(0x7f6bc815a600 0x7f6bc806ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.143+0000 7f6bcee00640 1 -- 172.21.15.63:0/800159681 >> 172.21.15.63:0/800159681 conn(0x7f6bc80b13d0 msgr2=0x7f6bc80b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.143+0000 7f6bcee00640 1 -- 172.21.15.63:0/800159681 shutdown_connections 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.143+0000 7f6bcee00640 1 -- 172.21.15.63:0/800159681 wait complete. 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.145+0000 7f6bcee00640 1 Processor -- start 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.145+0000 7f6bcee00640 1 -- start start 2024-03-26T06:16:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.146+0000 7f6bcee00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 0x7f6bc8158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.146+0000 7f6bcee00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc80cca00 0x7f6bc8147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.146+0000 7f6bcee00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc815a600 0x7f6bc80b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.146+0000 7f6bcee00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc815ed40 con 0x7f6bc806f160 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.146+0000 7f6bcee00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc815ea60 con 0x7f6bc815a600 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.146+0000 7f6bcee00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80cce70 con 0x7f6bc80cca00 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.146+0000 7f6bcda00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 0x7f6bc8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.146+0000 7f6bcda00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 0x7f6bc8158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60164/0 (socket says 172.21.15.63:60164) 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.146+0000 7f6bcda00640 1 -- 172.21.15.63:0/2176317450 learned_addr learned my addr 172.21.15.63:0/2176317450 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bcda00640 1 -- 172.21.15.63:0/2176317450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc80cca00 msgr2=0x7f6bc8147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bcda00640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc80cca00 0x7f6bc8147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bcda00640 1 -- 172.21.15.63:0/2176317450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc815a600 msgr2=0x7f6bc80b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bcda00640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc815a600 0x7f6bc80b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bcda00640 1 -- 172.21.15.63:0/2176317450 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8152510 con 0x7f6bc806f160 2024-03-26T06:16:54.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bcda00640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 0x7f6bc8158890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00d5f0 tx=0x7f6bbc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:54.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bc5600640 1 -- 172.21.15.63:0/2176317450 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0125f0 con 0x7f6bc806f160 2024-03-26T06:16:54.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bc5600640 1 -- 172.21.15.63:0/2176317450 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc019070 con 0x7f6bc806f160 2024-03-26T06:16:54.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc8151f50 con 0x7f6bc806f160 2024-03-26T06:16:54.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bc5600640 1 -- 172.21.15.63:0/2176317450 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0129d0 con 0x7f6bc806f160 2024-03-26T06:16:54.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.147+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc80afdf0 con 0x7f6bc806f160 2024-03-26T06:16:54.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.148+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc804f050 con 0x7f6bc806f160 2024-03-26T06:16:54.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.149+0000 7f6bc5600640 1 -- 172.21.15.63:0/2176317450 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6bbc012b70 con 0x7f6bc806f160 2024-03-26T06:16:54.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.150+0000 7f6bc5600640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6ba806bc00 0x7f6ba806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.150+0000 7f6bc5600640 1 -- 172.21.15.63:0/2176317450 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6bbc08aa70 con 0x7f6bc806f160 2024-03-26T06:16:54.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.150+0000 7f6bcd000640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6ba806bc00 0x7f6ba806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.151+0000 7f6bcd000640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6ba806bc00 0x7f6ba806e0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4036000 tx=0x7f6bb4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:54.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.154+0000 7f6bc5600640 1 -- 172.21.15.63:0/2176317450 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f6bbc0598a0 con 0x7f6bc806f160 2024-03-26T06:16:54.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.392+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bc806d840 con 0x7f6bc806f160 2024-03-26T06:16:54.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.393+0000 7f6bc5600640 1 -- 172.21.15.63:0/2176317450 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f6bbc0591a0 con 0x7f6bc806f160 2024-03-26T06:16:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:16:54.395 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-26T06:16:54.395 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2024-03-26T06:16:54.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6ba806bc00 msgr2=0x7f6ba806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6ba806bc00 0x7f6ba806e0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4036000 tx=0x7f6bb4030000 comp rx=0 tx=0).stop 2024-03-26T06:16:54.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 msgr2=0x7f6bc8158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 0x7f6bc8158890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00d5f0 tx=0x7f6bbc00dab0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 shutdown_connections 2024-03-26T06:16:54.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6ba806bc00 0x7f6ba806e0c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc815a600 0x7f6bc80b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc80cca00 0x7f6bc8147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 --2- 172.21.15.63:0/2176317450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc806f160 0x7f6bc8158890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 >> 172.21.15.63:0/2176317450 conn(0x7f6bc80b13d0 msgr2=0x7f6bc80b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:54.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 shutdown_connections 2024-03-26T06:16:54.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.397+0000 7f6bcee00640 1 -- 172.21.15.63:0/2176317450 wait complete. 2024-03-26T06:16:54.417 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:16:54.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.635+0000 7f2b57200640 1 Processor -- start 2024-03-26T06:16:54.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.636+0000 7f2b57200640 1 -- start start 2024-03-26T06:16:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.637+0000 7f2b57200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2b580c4660 0x7f2b58162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.637+0000 7f2b57200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2b580b0af0 0x7f2b580c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.637+0000 7f2b57200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b5806bda0 0x7f2b5806c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.637+0000 7f2b57200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b580c4f80 con 0x7f2b580c4660 2024-03-26T06:16:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b57200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b581629f0 con 0x7f2b580b0af0 2024-03-26T06:16:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b57200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58162cd0 con 0x7f2b5806bda0 2024-03-26T06:16:54.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b55e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2b580c4660 0x7f2b58162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b55e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2b580c4660 0x7f2b58162410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60178/0 (socket says 172.21.15.63:60178) 2024-03-26T06:16:54.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b55e00640 1 -- 172.21.15.63:0/3905006258 learned_addr learned my addr 172.21.15.63:0/3905006258 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:54.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b55e00640 1 -- 172.21.15.63:0/3905006258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b5806bda0 msgr2=0x7f2b5806c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:54.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b55e00640 1 --2- 172.21.15.63:0/3905006258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b5806bda0 0x7f2b5806c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b55e00640 1 -- 172.21.15.63:0/3905006258 >> v2:172.21.15.204:3300/0 conn(0x7f2b580b0af0 msgr2=0x7f2b580c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:54.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b55e00640 1 --2- 172.21.15.63:0/3905006258 >> v2:172.21.15.204:3300/0 conn(0x7f2b580b0af0 0x7f2b580c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.638+0000 7f2b55e00640 1 -- 172.21.15.63:0/3905006258 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b58162fb0 con 0x7f2b580c4660 2024-03-26T06:16:54.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.639+0000 7f2b55e00640 1 --2- 172.21.15.63:0/3905006258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580c4660 0x7f2b58162410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b580727d0 tx=0x7f2b4002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12eb561f651958aa server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:54.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.640+0000 7f2b54a00640 1 -- 172.21.15.63:0/3905006258 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4002e070 con 0x7f2b580c4660 2024-03-26T06:16:54.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.640+0000 7f2b54a00640 1 -- 172.21.15.63:0/3905006258 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40037070 con 0x7f2b580c4660 2024-03-26T06:16:54.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.640+0000 7f2b54a00640 1 -- 172.21.15.63:0/3905006258 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40031a00 con 0x7f2b580c4660 2024-03-26T06:16:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.640+0000 7f2b57200640 1 -- 172.21.15.63:0/3905006258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580c4660 msgr2=0x7f2b58162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.640+0000 7f2b57200640 1 --2- 172.21.15.63:0/3905006258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580c4660 0x7f2b58162410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b580727d0 tx=0x7f2b4002b880 comp rx=0 tx=0).stop 2024-03-26T06:16:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.641+0000 7f2b57200640 1 -- 172.21.15.63:0/3905006258 shutdown_connections 2024-03-26T06:16:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.641+0000 7f2b57200640 1 --2- 172.21.15.63:0/3905006258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b5806bda0 0x7f2b5806c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.641+0000 7f2b57200640 1 --2- 172.21.15.63:0/3905006258 >> v2:172.21.15.204:3300/0 conn(0x7f2b580b0af0 0x7f2b580c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.641+0000 7f2b57200640 1 --2- 172.21.15.63:0/3905006258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580c4660 0x7f2b58162410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.641+0000 7f2b57200640 1 -- 172.21.15.63:0/3905006258 >> 172.21.15.63:0/3905006258 conn(0x7f2b580b3180 msgr2=0x7f2b580b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.641+0000 7f2b57200640 1 -- 172.21.15.63:0/3905006258 shutdown_connections 2024-03-26T06:16:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.641+0000 7f2b57200640 1 -- 172.21.15.63:0/3905006258 wait complete. 2024-03-26T06:16:54.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.643+0000 7f2b57200640 1 Processor -- start 2024-03-26T06:16:54.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.643+0000 7f2b57200640 1 -- start start 2024-03-26T06:16:54.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b57200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b5806bda0 0x7f2b58153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b57200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580b0af0 0x7f2b58157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b57200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580c4660 0x7f2b580b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b57200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58165c90 con 0x7f2b580b0af0 2024-03-26T06:16:54.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b57200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58165b10 con 0x7f2b580c4660 2024-03-26T06:16:54.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b57200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58165e10 con 0x7f2b5806bda0 2024-03-26T06:16:54.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b55400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580b0af0 0x7f2b58157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b55400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580b0af0 0x7f2b58157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60188/0 (socket says 172.21.15.63:60188) 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b55400640 1 -- 172.21.15.63:0/892561250 learned_addr learned my addr 172.21.15.63:0/892561250 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b55e00640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b5806bda0 0x7f2b58153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b55400640 1 -- 172.21.15.63:0/892561250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b5806bda0 msgr2=0x7f2b58153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b56800640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580c4660 0x7f2b580b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b55400640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b5806bda0 0x7f2b58153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b55400640 1 -- 172.21.15.63:0/892561250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580c4660 msgr2=0x7f2b580b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b55400640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580c4660 0x7f2b580b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b55400640 1 -- 172.21.15.63:0/892561250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b58159940 con 0x7f2b580b0af0 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.644+0000 7f2b56800640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580c4660 0x7f2b580b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.645+0000 7f2b55400640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580b0af0 0x7f2b58157eb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800b9c0 tx=0x7f2b4800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.645+0000 7f2b4e000640 1 -- 172.21.15.63:0/892561250 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48019070 con 0x7f2b580b0af0 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.645+0000 7f2b4e000640 1 -- 172.21.15.63:0/892561250 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800cbc0 con 0x7f2b580b0af0 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.645+0000 7f2b4e000640 1 -- 172.21.15.63:0/892561250 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48014440 con 0x7f2b580b0af0 2024-03-26T06:16:54.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.645+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b581588a0 con 0x7f2b580b0af0 2024-03-26T06:16:54.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.645+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b58159140 con 0x7f2b580b0af0 2024-03-26T06:16:54.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.646+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5804f050 con 0x7f2b580b0af0 2024-03-26T06:16:54.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.647+0000 7f2b4e000640 1 -- 172.21.15.63:0/892561250 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2b4801c070 con 0x7f2b580b0af0 2024-03-26T06:16:54.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.649+0000 7f2b4e000640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2b3406bbd0 0x7f2b3406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:54.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.649+0000 7f2b4e000640 1 -- 172.21.15.63:0/892561250 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2b4808a560 con 0x7f2b580b0af0 2024-03-26T06:16:54.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.649+0000 7f2b55e00640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2b3406bbd0 0x7f2b3406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:54.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.650+0000 7f2b55e00640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2b3406bbd0 0x7f2b3406e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b40036000 tx=0x7f2b40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:54.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.653+0000 7f2b4e000640 1 -- 172.21.15.63:0/892561250 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2b48059300 con 0x7f2b580b0af0 2024-03-26T06:16:54.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.851+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b580b7610 con 0x7f2b580b0af0 2024-03-26T06:16:54.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.854+0000 7f2b4e000640 1 -- 172.21.15.63:0/892561250 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12896 (secure 0 0 0) 0x7f2b48058c00 con 0x7f2b580b0af0 2024-03-26T06:16:54.855 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:16:54.855 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:16:50.314666+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:16:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.856+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2b3406bbd0 msgr2=0x7f2b3406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.856+0000 7f2b57200640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2b3406bbd0 0x7f2b3406e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b40036000 tx=0x7f2b40008030 comp rx=0 tx=0).stop 2024-03-26T06:16:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.856+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580b0af0 msgr2=0x7f2b58157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.856+0000 7f2b57200640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580b0af0 0x7f2b58157eb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800b9c0 tx=0x7f2b4800be80 comp rx=0 tx=0).stop 2024-03-26T06:16:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.857+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 shutdown_connections 2024-03-26T06:16:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.857+0000 7f2b57200640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2b3406bbd0 0x7f2b3406e090 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.857+0000 7f2b57200640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580c4660 0x7f2b580b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.857+0000 7f2b57200640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b580b0af0 0x7f2b58157eb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.857+0000 7f2b57200640 1 --2- 172.21.15.63:0/892561250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b5806bda0 0x7f2b58153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:54.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.857+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 >> 172.21.15.63:0/892561250 conn(0x7f2b580b3180 msgr2=0x7f2b5806fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:54.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.857+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 shutdown_connections 2024-03-26T06:16:54.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:54.857+0000 7f2b57200640 1 -- 172.21.15.63:0/892561250 wait complete. 2024-03-26T06:16:54.876 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-26T06:16:54.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:16:55.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.103+0000 7f3c29c00640 1 Processor -- start 2024-03-26T06:16:55.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.103+0000 7f3c29c00640 1 -- start start 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.104+0000 7f3c29c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c2415ba30 0x7f3c2409a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.104+0000 7f3c29c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c2415c980 0x7f3c240cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.104+0000 7f3c29c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c24099bf0 con 0x7f3c240cc6c0 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c29c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c24099e70 con 0x7f3c2415ba30 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c29c00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2409a150 con 0x7f3c2415c980 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c23e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c2415ba30 0x7f3c2409a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c23e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c2415ba30 0x7f3c2409a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60204/0 (socket says 172.21.15.63:60204) 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c23e00640 1 -- 172.21.15.63:0/1213621141 learned_addr learned my addr 172.21.15.63:0/1213621141 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c29200640 1 --1- 172.21.15.63:0/1213621141 >> v1:172.21.15.63:6789/0 conn(0x7f3c240cc6c0 0x7f3c240cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59500/0 (socket says 172.21.15.63:59500) 2024-03-26T06:16:55.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c1be00640 1 --2- 172.21.15.63:0/1213621141 >> v2:172.21.15.204:3300/0 conn(0x7f3c2415c980 0x7f3c240cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c23e00640 1 -- 172.21.15.63:0/1213621141 >> v2:172.21.15.204:3300/0 conn(0x7f3c2415c980 msgr2=0x7f3c240cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:55.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c23e00640 1 --2- 172.21.15.63:0/1213621141 >> v2:172.21.15.204:3300/0 conn(0x7f3c2415c980 0x7f3c240cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c23e00640 1 -- 172.21.15.63:0/1213621141 >> v1:172.21.15.63:6789/0 conn(0x7f3c240cc6c0 legacy=0x7f3c240cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c23e00640 1 -- 172.21.15.63:0/1213621141 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2409a430 con 0x7f3c2415ba30 2024-03-26T06:16:55.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c23400640 1 -- 172.21.15.63:0/1213621141 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827630732 0 0) 0x7f3c1c001490 con 0x7f3c240cc6c0 2024-03-26T06:16:55.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.105+0000 7f3c1be00640 1 --2- 172.21.15.63:0/1213621141 >> v2:172.21.15.204:3300/0 conn(0x7f3c2415c980 0x7f3c240cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:16:55.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.107+0000 7f3c23e00640 1 --2- 172.21.15.63:0/1213621141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 0x7f3c2409a950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406f330 tx=0x7f3c1402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaad305475cdf230 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.107+0000 7f3c23400640 1 -- 172.21.15.63:0/1213621141 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14034070 con 0x7f3c2415ba30 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.107+0000 7f3c23400640 1 -- 172.21.15.63:0/1213621141 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14030860 con 0x7f3c2415ba30 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.107+0000 7f3c23400640 1 -- 172.21.15.63:0/1213621141 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14030c30 con 0x7f3c2415ba30 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.108+0000 7f3c29c00640 1 -- 172.21.15.63:0/1213621141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 msgr2=0x7f3c2409a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.108+0000 7f3c29c00640 1 --2- 172.21.15.63:0/1213621141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 0x7f3c2409a950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406f330 tx=0x7f3c1402b9a0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.108+0000 7f3c29c00640 1 -- 172.21.15.63:0/1213621141 shutdown_connections 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.108+0000 7f3c29c00640 1 --2- 172.21.15.63:0/1213621141 >> v2:172.21.15.204:3300/0 conn(0x7f3c2415c980 0x7f3c240cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.108+0000 7f3c29c00640 1 --2- 172.21.15.63:0/1213621141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 0x7f3c2409a950 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.108+0000 7f3c29c00640 1 -- 172.21.15.63:0/1213621141 >> 172.21.15.63:0/1213621141 conn(0x7f3c240b3180 msgr2=0x7f3c240b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.108+0000 7f3c29c00640 1 -- 172.21.15.63:0/1213621141 shutdown_connections 2024-03-26T06:16:55.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.108+0000 7f3c29c00640 1 -- 172.21.15.63:0/1213621141 wait complete. 2024-03-26T06:16:55.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.110+0000 7f3c29c00640 1 Processor -- start 2024-03-26T06:16:55.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.110+0000 7f3c29c00640 1 -- start start 2024-03-26T06:16:55.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c29c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c240cc6c0 0x7f3c2409e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c29c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 0x7f3c2414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c29c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c2415c980 0x7f3c2414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c29c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240cccd0 con 0x7f3c2415ba30 2024-03-26T06:16:55.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c29c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240ccb50 con 0x7f3c2415c980 2024-03-26T06:16:55.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c29c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240cce50 con 0x7f3c240cc6c0 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c1be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 0x7f3c2414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c1be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 0x7f3c2414a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60212/0 (socket says 172.21.15.63:60212) 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c1be00640 1 -- 172.21.15.63:0/3358806465 learned_addr learned my addr 172.21.15.63:0/3358806465 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c23e00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c240cc6c0 0x7f3c2409e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c29200640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c2415c980 0x7f3c2414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c1be00640 1 -- 172.21.15.63:0/3358806465 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c240cc6c0 msgr2=0x7f3c2409e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c1be00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c240cc6c0 0x7f3c2409e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.111+0000 7f3c1be00640 1 -- 172.21.15.63:0/3358806465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c2415c980 msgr2=0x7f3c2414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.112+0000 7f3c1be00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c2415c980 0x7f3c2414a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.112+0000 7f3c1be00640 1 -- 172.21.15.63:0/3358806465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c241f4cd0 con 0x7f3c2415ba30 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.112+0000 7f3c29200640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c2415c980 0x7f3c2414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:55.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.112+0000 7f3c1be00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 0x7f3c2414a9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00d800 tx=0x7f3c0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:55.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.112+0000 7f3c20c00640 1 -- 172.21.15.63:0/3358806465 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c004030 con 0x7f3c2415ba30 2024-03-26T06:16:55.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.112+0000 7f3c20c00640 1 -- 172.21.15.63:0/3358806465 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c0041d0 con 0x7f3c2415ba30 2024-03-26T06:16:55.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.112+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c241f4fb0 con 0x7f3c2415ba30 2024-03-26T06:16:55.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.112+0000 7f3c20c00640 1 -- 172.21.15.63:0/3358806465 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c0096a0 con 0x7f3c2415ba30 2024-03-26T06:16:55.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.112+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c241f5570 con 0x7f3c2415ba30 2024-03-26T06:16:55.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.113+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2404f0c0 con 0x7f3c2415ba30 2024-03-26T06:16:55.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.114+0000 7f3c20c00640 1 -- 172.21.15.63:0/3358806465 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3c0c009840 con 0x7f3c2415ba30 2024-03-26T06:16:55.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.115+0000 7f3c20c00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3c0006bbd0 0x7f3c0006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.115+0000 7f3c20c00640 1 -- 172.21.15.63:0/3358806465 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3c0c08aa50 con 0x7f3c2415ba30 2024-03-26T06:16:55.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.115+0000 7f3c23e00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3c0006bbd0 0x7f3c0006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.116+0000 7f3c23e00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3c0006bbd0 0x7f3c0006e090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c14036000 tx=0x7f3c1403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:55.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.119+0000 7f3c20c00640 1 -- 172.21.15.63:0/3358806465 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f3c0c059890 con 0x7f3c2415ba30 2024-03-26T06:16:55.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.318+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c2414af20 con 0x7f3c2415ba30 2024-03-26T06:16:55.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.320+0000 7f3c20c00640 1 -- 172.21.15.63:0/3358806465 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c0c059190 con 0x7f3c2415ba30 2024-03-26T06:16:55.320 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:16:55.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3c0006bbd0 msgr2=0x7f3c0006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3c0006bbd0 0x7f3c0006e090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c14036000 tx=0x7f3c1403b040 comp rx=0 tx=0).stop 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 msgr2=0x7f3c2414a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 0x7f3c2414a9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00d800 tx=0x7f3c0c00dcc0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 shutdown_connections 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3c0006bbd0 0x7f3c0006e090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c2415c980 0x7f3c2414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415ba30 0x7f3c2414a9e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 --2- 172.21.15.63:0/3358806465 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c240cc6c0 0x7f3c2409e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 >> 172.21.15.63:0/3358806465 conn(0x7f3c240b3180 msgr2=0x7f3c240b62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 shutdown_connections 2024-03-26T06:16:55.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.322+0000 7f3c29c00640 1 -- 172.21.15.63:0/3358806465 wait complete. 2024-03-26T06:16:55.342 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-26T06:16:55.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.565+0000 7f2257200640 1 Processor -- start 2024-03-26T06:16:55.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.565+0000 7f2257200640 1 -- start start 2024-03-26T06:16:55.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.567+0000 7f2257200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f225815a600 0x7f225806ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.567+0000 7f2257200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 0x7f22580cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.567+0000 7f2257200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225815a9e0 con 0x7f22580cca00 2024-03-26T06:16:55.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.567+0000 7f2257200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225806f5a0 con 0x7f225815a600 2024-03-26T06:16:55.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.567+0000 7f2257200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225815e1c0 con 0x7f225806f160 2024-03-26T06:16:55.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.567+0000 7f2255e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f225815a600 0x7f225806ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.567+0000 7f2256800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f22580cca00 0x7f22580ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59504/0 (socket says 172.21.15.63:59504) 2024-03-26T06:16:55.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.567+0000 7f2256800640 1 -- 172.21.15.63:0/3254497157 learned_addr learned my addr 172.21.15.63:0/3254497157 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:16:55.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.568+0000 7f224d400640 1 --2- 172.21.15.63:0/3254497157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 0x7f22580cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.568+0000 7f2255e00640 1 -- 172.21.15.63:0/3254497157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 msgr2=0x7f22580cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:55.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.568+0000 7f2255e00640 1 --2- 172.21.15.63:0/3254497157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 0x7f22580cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.568+0000 7f2255e00640 1 -- 172.21.15.63:0/3254497157 >> v1:172.21.15.63:6789/0 conn(0x7f22580cca00 legacy=0x7f22580ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.568+0000 7f2255e00640 1 -- 172.21.15.63:0/3254497157 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225815e4a0 con 0x7f225815a600 2024-03-26T06:16:55.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.568+0000 7f224d400640 1 --2- 172.21.15.63:0/3254497157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 0x7f22580cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.569+0000 7f2255e00640 1 --2- 172.21.15.63:0/3254497157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 0x7f225806ec20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22480097a0 tx=0x7f224802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e56c3808b209b99 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.569+0000 7f2255400640 1 -- 172.21.15.63:0/3254497157 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248035020 con 0x7f225815a600 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.569+0000 7f2255400640 1 -- 172.21.15.63:0/3254497157 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2248031810 con 0x7f225815a600 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.569+0000 7f2255400640 1 -- 172.21.15.63:0/3254497157 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248031be0 con 0x7f225815a600 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.570+0000 7f2257200640 1 -- 172.21.15.63:0/3254497157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 msgr2=0x7f225806ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.570+0000 7f2257200640 1 --2- 172.21.15.63:0/3254497157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 0x7f225806ec20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22480097a0 tx=0x7f224802b8b0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.570+0000 7f2257200640 1 -- 172.21.15.63:0/3254497157 shutdown_connections 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.570+0000 7f2257200640 1 --2- 172.21.15.63:0/3254497157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 0x7f22580cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.570+0000 7f2257200640 1 --2- 172.21.15.63:0/3254497157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 0x7f225806ec20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.570+0000 7f2257200640 1 -- 172.21.15.63:0/3254497157 >> 172.21.15.63:0/3254497157 conn(0x7f22580b13d0 msgr2=0x7f22580b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.570+0000 7f2257200640 1 -- 172.21.15.63:0/3254497157 shutdown_connections 2024-03-26T06:16:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.570+0000 7f2257200640 1 -- 172.21.15.63:0/3254497157 wait complete. 2024-03-26T06:16:55.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.571+0000 7f2257200640 1 Processor -- start 2024-03-26T06:16:55.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.572+0000 7f2257200640 1 -- start start 2024-03-26T06:16:55.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.572+0000 7f2257200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 0x7f2258148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.572+0000 7f2257200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22580cca00 0x7f22580af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2257200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 0x7f22580aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2257200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225815ed40 con 0x7f225815a600 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2257200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225815ea60 con 0x7f22580cca00 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2257200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22580cce70 con 0x7f225806f160 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2256800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 0x7f22580aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2256800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 0x7f22580aff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60226/0 (socket says 172.21.15.63:60226) 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2256800640 1 -- 172.21.15.63:0/1831722082 learned_addr learned my addr 172.21.15.63:0/1831722082 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2255e00640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 0x7f2258148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f224d400640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22580cca00 0x7f22580af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2256800640 1 -- 172.21.15.63:0/1831722082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 msgr2=0x7f2258148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2256800640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 0x7f2258148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2256800640 1 -- 172.21.15.63:0/1831722082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22580cca00 msgr2=0x7f22580af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2256800640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22580cca00 0x7f22580af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f2256800640 1 -- 172.21.15.63:0/1831722082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22580a84d0 con 0x7f225815a600 2024-03-26T06:16:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.573+0000 7f224d400640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22580cca00 0x7f22580af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.574+0000 7f2256800640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 0x7f22580aff20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f225000cbf0 tx=0x7f225000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.574+0000 7f224ea00640 1 -- 172.21.15.63:0/1831722082 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250017070 con 0x7f225815a600 2024-03-26T06:16:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.574+0000 7f224ea00640 1 -- 172.21.15.63:0/1831722082 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225000ad40 con 0x7f225815a600 2024-03-26T06:16:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.574+0000 7f224ea00640 1 -- 172.21.15.63:0/1831722082 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250012600 con 0x7f225815a600 2024-03-26T06:16:55.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.574+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22580a87b0 con 0x7f225815a600 2024-03-26T06:16:55.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.574+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22580a8d70 con 0x7f225815a600 2024-03-26T06:16:55.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.575+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225804f050 con 0x7f225815a600 2024-03-26T06:16:55.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.576+0000 7f224ea00640 1 -- 172.21.15.63:0/1831722082 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f225001a070 con 0x7f225815a600 2024-03-26T06:16:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.577+0000 7f224ea00640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f223406bbd0 0x7f223406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.577+0000 7f224ea00640 1 -- 172.21.15.63:0/1831722082 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f225008a440 con 0x7f225815a600 2024-03-26T06:16:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.577+0000 7f2255e00640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f223406bbd0 0x7f223406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.578+0000 7f2255e00640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f223406bbd0 0x7f223406e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2248036000 tx=0x7f224803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.582+0000 7f224ea00640 1 -- 172.21.15.63:0/1831722082 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f225815a9e0 con 0x7f225815a600 2024-03-26T06:16:55.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.785+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f225806d840 con 0x7f225815a600 2024-03-26T06:16:55.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.786+0000 7f224ea00640 1 -- 172.21.15.63:0/1831722082 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2250058b90 con 0x7f225815a600 2024-03-26T06:16:55.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:16:55.786 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-03-26T06:16:55.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:16:55.786 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-03-26T06:16:55.786 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-03-26T06:16:55.786 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:16:55.786 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-03-26T06:16:55.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f223406bbd0 msgr2=0x7f223406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f223406bbd0 0x7f223406e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2248036000 tx=0x7f224803c040 comp rx=0 tx=0).stop 2024-03-26T06:16:55.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 msgr2=0x7f22580aff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 0x7f22580aff20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f225000cbf0 tx=0x7f225000a430 comp rx=0 tx=0).stop 2024-03-26T06:16:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 shutdown_connections 2024-03-26T06:16:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f223406bbd0 0x7f223406e090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f225815a600 0x7f22580aff20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22580cca00 0x7f22580af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 --2- 172.21.15.63:0/1831722082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f225806f160 0x7f2258148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.788+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 >> 172.21.15.63:0/1831722082 conn(0x7f22580b13d0 msgr2=0x7f22580b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.789+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 shutdown_connections 2024-03-26T06:16:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:55.789+0000 7f2257200640 1 -- 172.21.15.63:0/1831722082 wait complete. 2024-03-26T06:16:55.809 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-26T06:16:55.809 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-26T06:16:56.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.033+0000 7f1986800640 1 Processor -- start 2024-03-26T06:16:56.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.034+0000 7f1986800640 1 -- start start 2024-03-26T06:16:56.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.035+0000 7f1986800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f198006b6d0 0x7f19800b4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.035+0000 7f1986800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19800ce7f0 0x7f19800cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.035+0000 7f1986800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19800b32b0 con 0x7f19801451b0 2024-03-26T06:16:56.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.035+0000 7f1986800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19800b3060 con 0x7f198006b6d0 2024-03-26T06:16:56.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.035+0000 7f1986800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19800b3590 con 0x7f19800ce7f0 2024-03-26T06:16:56.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.036+0000 7f197f400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f19801451b0 0x7f198006afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59510/0 (socket says 172.21.15.63:59510) 2024-03-26T06:16:56.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.036+0000 7f197f400640 1 -- 172.21.15.63:0/3920671181 learned_addr learned my addr 172.21.15.63:0/3920671181 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:16:56.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.036+0000 7f1977e00640 1 --2- 172.21.15.63:0/3920671181 >> v2:172.21.15.204:3300/0 conn(0x7f198006b6d0 0x7f19800b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.036+0000 7f197fe00640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19800ce7f0 0x7f19800cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.036+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963792567 0 0) 0x7f19800b32b0 con 0x7f19801451b0 2024-03-26T06:16:56.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.036+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1964003520 con 0x7f19801451b0 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561979048 0 0) 0x7f1964003520 con 0x7f19801451b0 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19800ce7f0 msgr2=0x7f19800cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19800ce7f0 0x7f19800cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 >> v2:172.21.15.204:3300/0 conn(0x7f198006b6d0 msgr2=0x7f19800b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 --2- 172.21.15.63:0/3920671181 >> v2:172.21.15.204:3300/0 conn(0x7f198006b6d0 0x7f19800b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800b3870 con 0x7f19801451b0 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f1970001670 con 0x7f19801451b0 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 >> v1:172.21.15.63:6789/0 conn(0x7f19801451b0 legacy=0x7f198006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19640039b0 0x7f1964003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1964004800 0x7f1964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19800ce7f0 0x7f19640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800b3060 con 0x7f19640039b0 2024-03-26T06:16:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800b3590 con 0x7f1964004800 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196400b9c0 con 0x7f19800ce7f0 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197f400640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19640039b0 0x7f1964003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f1977e00640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1964004800 0x7f1964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197fe00640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19800ce7f0 0x7f19640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197f400640 1 -- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19800ce7f0 msgr2=0x7f19640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197f400640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19800ce7f0 0x7f19640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197f400640 1 -- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1964004800 msgr2=0x7f1964004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.037+0000 7f197f400640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1964004800 0x7f1964004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.038+0000 7f197f400640 1 -- 172.21.15.63:0/3920671181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964003520 con 0x7f19640039b0 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.038+0000 7f197fe00640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19800ce7f0 0x7f19640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.039+0000 7f197f400640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19640039b0 0x7f1964003dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f197000c190 tx=0x7f1964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce061b78ade7aff server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:56.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.039+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970007c60 con 0x7f19640039b0 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.039+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1970030070 con 0x7f19640039b0 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.039+0000 7f197ea00640 1 -- 172.21.15.63:0/3920671181 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970005d30 con 0x7f19640039b0 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.039+0000 7f1986800640 1 -- 172.21.15.63:0/3920671181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19640039b0 msgr2=0x7f1964003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.039+0000 7f1986800640 1 --2- 172.21.15.63:0/3920671181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19640039b0 0x7f1964003dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f197000c190 tx=0x7f1964005830 comp rx=0 tx=0).stop 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.039+0000 7f197fe00640 1 -- 172.21.15.63:0/3920671181 reap_dead start 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.040+0000 7f1986800640 1 -- 172.21.15.63:0/3920671181 shutdown_connections 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.040+0000 7f1986800640 1 -- 172.21.15.63:0/3920671181 >> 172.21.15.63:0/3920671181 conn(0x7f19800cf670 msgr2=0x7f19800cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.040+0000 7f1986800640 1 -- 172.21.15.63:0/3920671181 shutdown_connections 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.040+0000 7f1986800640 1 -- 172.21.15.63:0/3920671181 wait complete. 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.041+0000 7f1986800640 1 Processor -- start 2024-03-26T06:16:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.042+0000 7f1986800640 1 -- start start 2024-03-26T06:16:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1986800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19640039b0 0x7f1980141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1986800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f198015de90 0x7f198015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1986800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19800c50a0 0x7f19800c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1986800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1980145590 con 0x7f198015de90 2024-03-26T06:16:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1986800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800b3e30 con 0x7f19800c50a0 2024-03-26T06:16:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1986800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1980145710 con 0x7f19640039b0 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1977e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f198015de90 0x7f198015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1977e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f198015de90 0x7f198015e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60246/0 (socket says 172.21.15.63:60246) 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1977e00640 1 -- 172.21.15.63:0/1349968126 learned_addr learned my addr 172.21.15.63:0/1349968126 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f197fe00640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19800c50a0 0x7f19800c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f197f400640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19640039b0 0x7f1980141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1977e00640 1 -- 172.21.15.63:0/1349968126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19640039b0 msgr2=0x7f1980141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1977e00640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19640039b0 0x7f1980141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1977e00640 1 -- 172.21.15.63:0/1349968126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19800c50a0 msgr2=0x7f19800c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1977e00640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19800c50a0 0x7f19800c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.043+0000 7f1977e00640 1 -- 172.21.15.63:0/1349968126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800c5db0 con 0x7f198015de90 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.044+0000 7f1977e00640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f198015de90 0x7f198015e310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19680115c0 tx=0x7f1968011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.044+0000 7f1977400640 1 -- 172.21.15.63:0/1349968126 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968004220 con 0x7f198015de90 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.044+0000 7f1977400640 1 -- 172.21.15.63:0/1349968126 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19680043c0 con 0x7f198015de90 2024-03-26T06:16:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.044+0000 7f1977400640 1 -- 172.21.15.63:0/1349968126 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968015930 con 0x7f198015de90 2024-03-26T06:16:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.044+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19800c6090 con 0x7f198015de90 2024-03-26T06:16:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.044+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19800c6650 con 0x7f198015de90 2024-03-26T06:16:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.046+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1980074810 con 0x7f198015de90 2024-03-26T06:16:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.046+0000 7f1977400640 1 -- 172.21.15.63:0/1349968126 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1968015ad0 con 0x7f198015de90 2024-03-26T06:16:56.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.047+0000 7f1977400640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f195c06bc00 0x7f195c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.047+0000 7f1977400640 1 -- 172.21.15.63:0/1349968126 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f196808abe0 con 0x7f198015de90 2024-03-26T06:16:56.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.047+0000 7f197f400640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f195c06bc00 0x7f195c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.048+0000 7f197f400640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f195c06bc00 0x7f195c06e0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1970034000 tx=0x7f1970007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:56.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.052+0000 7f1977400640 1 -- 172.21.15.63:0/1349968126 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1968019030 con 0x7f198015de90 2024-03-26T06:16:56.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.253+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1980141850 con 0x7f198015de90 2024-03-26T06:16:56.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.454+0000 7f1977400640 1 -- 172.21.15.63:0/1349968126 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1968059980 con 0x7f198015de90 2024-03-26T06:16:56.455 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-03-26T06:16:56.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f195c06bc00 msgr2=0x7f195c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f195c06bc00 0x7f195c06e0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1970034000 tx=0x7f1970007000 comp rx=0 tx=0).stop 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f198015de90 msgr2=0x7f198015e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f198015de90 0x7f198015e310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19680115c0 tx=0x7f1968011a80 comp rx=0 tx=0).stop 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 shutdown_connections 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f195c06bc00 0x7f195c06e0c0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1970034000 tx=0x7f1970007000 comp rx=0 tx=0).stop 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19800c50a0 0x7f19800c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f198015de90 0x7f198015e310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 --2- 172.21.15.63:0/1349968126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19640039b0 0x7f1980141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.458+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 >> 172.21.15.63:0/1349968126 conn(0x7f19800cf670 msgr2=0x7f198015bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.459+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 shutdown_connections 2024-03-26T06:16:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.459+0000 7f1986800640 1 -- 172.21.15.63:0/1349968126 wait complete. 2024-03-26T06:16:56.490 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-26T06:16:56.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.705+0000 7fb561400640 1 Processor -- start 2024-03-26T06:16:56.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.705+0000 7fb561400640 1 -- start start 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.707+0000 7fb561400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 0x7fb55c15ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.707+0000 7fb561400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb55c0cfc40 0x7fb55c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.707+0000 7fb561400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c15e890 con 0x7fb55c15e410 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.707+0000 7fb561400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0cd530 con 0x7fb55c0cfc40 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.707+0000 7fb561400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c15f3b0 con 0x7fb55c15dd30 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.707+0000 7fb55b200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb55c0cfc40 0x7fb55c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.707+0000 7fb55b200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb55c0cfc40 0x7fb55c0cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60262/0 (socket says 172.21.15.63:60262) 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.707+0000 7fb55b200640 1 -- 172.21.15.63:0/2674129105 learned_addr learned my addr 172.21.15.63:0/2674129105 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.708+0000 7fb55a800640 1 --2- 172.21.15.63:0/2674129105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 0x7fb55c15ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.708+0000 7fb55b200640 1 -- 172.21.15.63:0/2674129105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 msgr2=0x7fb55c15ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:56.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.708+0000 7fb55b200640 1 --2- 172.21.15.63:0/2674129105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 0x7fb55c15ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.708+0000 7fb55b200640 1 -- 172.21.15.63:0/2674129105 >> v1:172.21.15.204:6789/0 conn(0x7fb55c15e410 legacy=0x7fb55c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.708+0000 7fb55b200640 1 -- 172.21.15.63:0/2674129105 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c15c420 con 0x7fb55c0cfc40 2024-03-26T06:16:56.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.709+0000 7fb55b200640 1 --2- 172.21.15.63:0/2674129105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 0x7fb55c0cdc80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb554009e50 tx=0x7fb55402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f828be26952bf8a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:56.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.709+0000 7fb559400640 1 -- 172.21.15.63:0/2674129105 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55402cb00 con 0x7fb55c0cfc40 2024-03-26T06:16:56.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.709+0000 7fb559400640 1 -- 172.21.15.63:0/2674129105 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55402cca0 con 0x7fb55c0cfc40 2024-03-26T06:16:56.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.709+0000 7fb559400640 1 -- 172.21.15.63:0/2674129105 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554034610 con 0x7fb55c0cfc40 2024-03-26T06:16:56.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.710+0000 7fb561400640 1 -- 172.21.15.63:0/2674129105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 msgr2=0x7fb55c0cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.710+0000 7fb561400640 1 --2- 172.21.15.63:0/2674129105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 0x7fb55c0cdc80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb554009e50 tx=0x7fb55402bf60 comp rx=0 tx=0).stop 2024-03-26T06:16:56.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.710+0000 7fb561400640 1 -- 172.21.15.63:0/2674129105 shutdown_connections 2024-03-26T06:16:56.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.710+0000 7fb561400640 1 --2- 172.21.15.63:0/2674129105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 0x7fb55c0cdc80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.710+0000 7fb561400640 1 --2- 172.21.15.63:0/2674129105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 0x7fb55c15ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.710+0000 7fb561400640 1 -- 172.21.15.63:0/2674129105 >> 172.21.15.63:0/2674129105 conn(0x7fb55c06ac90 msgr2=0x7fb55c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:56.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.710+0000 7fb561400640 1 -- 172.21.15.63:0/2674129105 shutdown_connections 2024-03-26T06:16:56.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.710+0000 7fb561400640 1 -- 172.21.15.63:0/2674129105 wait complete. 2024-03-26T06:16:56.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.712+0000 7fb561400640 1 Processor -- start 2024-03-26T06:16:56.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.712+0000 7fb561400640 1 -- start start 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.713+0000 7fb561400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 0x7fb55c153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.713+0000 7fb561400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 0x7fb55c1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.713+0000 7fb561400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb55c15e410 0x7fb55c0b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.713+0000 7fb561400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c15edf0 con 0x7fb55c0cfc40 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.713+0000 7fb561400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0cd7f0 con 0x7fb55c15e410 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.713+0000 7fb561400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c15f0d0 con 0x7fb55c15dd30 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.713+0000 7fb55a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 0x7fb55c153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.713+0000 7fb55a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 0x7fb55c153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60264/0 (socket says 172.21.15.63:60264) 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.713+0000 7fb55a800640 1 -- 172.21.15.63:0/850760713 learned_addr learned my addr 172.21.15.63:0/850760713 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb559e00640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 0x7fb55c1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb55b200640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb55c15e410 0x7fb55c0b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb55a800640 1 -- 172.21.15.63:0/850760713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 msgr2=0x7fb55c1521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb55a800640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 0x7fb55c1521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb55a800640 1 -- 172.21.15.63:0/850760713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb55c15e410 msgr2=0x7fb55c0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb55a800640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb55c15e410 0x7fb55c0b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb55a800640 1 -- 172.21.15.63:0/850760713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0b2860 con 0x7fb55c0cfc40 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb55b200640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb55c15e410 0x7fb55c0b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb55a800640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 0x7fb55c153450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00d830 tx=0x7fb54c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.714+0000 7fb552a00640 1 -- 172.21.15.63:0/850760713 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00b6c0 con 0x7fb55c0cfc40 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.715+0000 7fb552a00640 1 -- 172.21.15.63:0/850760713 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c019070 con 0x7fb55c0cfc40 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.715+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c0b2b00 con 0x7fb55c0cfc40 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.715+0000 7fb552a00640 1 -- 172.21.15.63:0/850760713 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00bac0 con 0x7fb55c0cfc40 2024-03-26T06:16:56.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.715+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c153b50 con 0x7fb55c0cfc40 2024-03-26T06:16:56.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.716+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c074730 con 0x7fb55c0cfc40 2024-03-26T06:16:56.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.717+0000 7fb552a00640 1 -- 172.21.15.63:0/850760713 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb54c01e460 con 0x7fb55c0cfc40 2024-03-26T06:16:56.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.718+0000 7fb552a00640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb53c06bbd0 0x7fb53c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:56.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.718+0000 7fb552a00640 1 -- 172.21.15.63:0/850760713 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb54c08af90 con 0x7fb55c0cfc40 2024-03-26T06:16:56.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.718+0000 7fb559e00640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb53c06bbd0 0x7fb53c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:56.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.719+0000 7fb559e00640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb53c06bbd0 0x7fb53c06e090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb55c1f7050 tx=0x7fb548009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:56.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.723+0000 7fb552a00640 1 -- 172.21.15.63:0/850760713 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb54c059c70 con 0x7fb55c0cfc40 2024-03-26T06:16:56.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:56.925+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fb55c06ea70 con 0x7fb55c0cfc40 2024-03-26T06:16:57.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.461+0000 7fb552a00640 1 -- 172.21.15.63:0/850760713 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fb54c059570 con 0x7fb55c0cfc40 2024-03-26T06:16:57.461 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-03-26T06:16:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb53c06bbd0 msgr2=0x7fb53c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb53c06bbd0 0x7fb53c06e090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb55c1f7050 tx=0x7fb548009040 comp rx=0 tx=0).stop 2024-03-26T06:16:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 msgr2=0x7fb55c153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 0x7fb55c153450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00d830 tx=0x7fb54c00dcf0 comp rx=0 tx=0).stop 2024-03-26T06:16:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 shutdown_connections 2024-03-26T06:16:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb53c06bbd0 0x7fb53c06e090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb55c15e410 0x7fb55c0b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb55c15dd30 0x7fb55c1521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 --2- 172.21.15.63:0/850760713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb55c0cfc40 0x7fb55c153450 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 >> 172.21.15.63:0/850760713 conn(0x7fb55c06ac90 msgr2=0x7fb55c0af000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 shutdown_connections 2024-03-26T06:16:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.465+0000 7fb561400640 1 -- 172.21.15.63:0/850760713 wait complete. 2024-03-26T06:16:57.504 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-26T06:16:57.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.692+0000 7f97e8800640 1 Processor -- start 2024-03-26T06:16:57.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.692+0000 7f97e8800640 1 -- start start 2024-03-26T06:16:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.694+0000 7f97e8800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f97e00b39f0 0x7f97e00ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.694+0000 7f97e8800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e015efb0 con 0x7f97e00ae570 2024-03-26T06:16:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.694+0000 7f97e8800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e015e3a0 con 0x7f97e0157f90 2024-03-26T06:16:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.694+0000 7f97e8800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e015e680 con 0x7f97e00b39f0 2024-03-26T06:16:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.695+0000 7f97e5400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f97e00ae570 0x7f97e00b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59516/0 (socket says 172.21.15.63:59516) 2024-03-26T06:16:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.695+0000 7f97e5400640 1 -- 172.21.15.63:0/955326933 learned_addr learned my addr 172.21.15.63:0/955326933 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:16:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.695+0000 7f97e6800640 1 --2- 172.21.15.63:0/955326933 >> v2:172.21.15.63:3300/0 conn(0x7f97e00b39f0 0x7f97e00ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.695+0000 7f97e4a00640 1 -- 172.21.15.63:0/955326933 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304963013 0 0) 0x7f97e015efb0 con 0x7f97e00ae570 2024-03-26T06:16:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.695+0000 7f97e4a00640 1 -- 172.21.15.63:0/955326933 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c8003520 con 0x7f97e00ae570 2024-03-26T06:16:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.695+0000 7f97e6800640 1 -- 172.21.15.63:0/955326933 >> v1:172.21.15.204:6789/0 conn(0x7f97e0157f90 legacy=0x7f97e00acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.695+0000 7f97e6800640 1 -- 172.21.15.63:0/955326933 >> v1:172.21.15.63:6789/0 conn(0x7f97e00ae570 legacy=0x7f97e00b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.695+0000 7f97e6800640 1 -- 172.21.15.63:0/955326933 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e015e960 con 0x7f97e00b39f0 2024-03-26T06:16:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.696+0000 7f97e6800640 1 --2- 172.21.15.63:0/955326933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00b39f0 0x7f97e00ae9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009d90 tx=0x7f97dc02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96ec9de2b55af28 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.697+0000 7f97e4a00640 1 -- 172.21.15.63:0/955326933 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc039070 con 0x7f97e00b39f0 2024-03-26T06:16:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.697+0000 7f97e4a00640 1 -- 172.21.15.63:0/955326933 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc02ccf0 con 0x7f97e00b39f0 2024-03-26T06:16:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.697+0000 7f97e4a00640 1 -- 172.21.15.63:0/955326933 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc034660 con 0x7f97e00b39f0 2024-03-26T06:16:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.697+0000 7f97e8800640 1 -- 172.21.15.63:0/955326933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00b39f0 msgr2=0x7f97e00ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.697+0000 7f97e8800640 1 --2- 172.21.15.63:0/955326933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00b39f0 0x7f97e00ae9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009d90 tx=0x7f97dc02bf40 comp rx=0 tx=0).stop 2024-03-26T06:16:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.697+0000 7f97e8800640 1 -- 172.21.15.63:0/955326933 shutdown_connections 2024-03-26T06:16:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.697+0000 7f97e8800640 1 --2- 172.21.15.63:0/955326933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00b39f0 0x7f97e00ae9f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.697+0000 7f97e8800640 1 -- 172.21.15.63:0/955326933 >> 172.21.15.63:0/955326933 conn(0x7f97e006ac90 msgr2=0x7f97e006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.697+0000 7f97e8800640 1 -- 172.21.15.63:0/955326933 shutdown_connections 2024-03-26T06:16:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.698+0000 7f97e8800640 1 -- 172.21.15.63:0/955326933 wait complete. 2024-03-26T06:16:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.699+0000 7f97e8800640 1 Processor -- start 2024-03-26T06:16:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.699+0000 7f97e8800640 1 -- start start 2024-03-26T06:16:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.700+0000 7f97e8800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00ae570 0x7f97e0150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.700+0000 7f97e8800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97e00b39f0 0x7f97e0146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.700+0000 7f97e8800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97e0157f90 0x7f97e01514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.700+0000 7f97e8800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e0158370 con 0x7f97e00ae570 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.700+0000 7f97e8800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e015e050 con 0x7f97e0157f90 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.700+0000 7f97e8800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e01527f0 con 0x7f97e00b39f0 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.700+0000 7f97e5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00ae570 0x7f97e0150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.700+0000 7f97e5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00ae570 0x7f97e0150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60276/0 (socket says 172.21.15.63:60276) 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.700+0000 7f97e5e00640 1 -- 172.21.15.63:0/2551615884 learned_addr learned my addr 172.21.15.63:0/2551615884 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.701+0000 7f97e6800640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97e0157f90 0x7f97e01514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.701+0000 7f97e5400640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97e00b39f0 0x7f97e0146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.701+0000 7f97e5e00640 1 -- 172.21.15.63:0/2551615884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97e00b39f0 msgr2=0x7f97e0146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.701+0000 7f97e5e00640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97e00b39f0 0x7f97e0146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.701+0000 7f97e5e00640 1 -- 172.21.15.63:0/2551615884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97e0157f90 msgr2=0x7f97e01514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.701+0000 7f97e5e00640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97e0157f90 0x7f97e01514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.701+0000 7f97e5e00640 1 -- 172.21.15.63:0/2551615884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e0152c80 con 0x7f97e00ae570 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.701+0000 7f97e6800640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97e0157f90 0x7f97e01514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.701+0000 7f97e5e00640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00ae570 0x7f97e0150c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c450 tx=0x7f97d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:57.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.702+0000 7f97da000640 1 -- 172.21.15.63:0/2551615884 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d40052d0 con 0x7f97e00ae570 2024-03-26T06:16:57.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.702+0000 7f97da000640 1 -- 172.21.15.63:0/2551615884 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4005470 con 0x7f97e00ae570 2024-03-26T06:16:57.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.702+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e01556d0 con 0x7f97e00ae570 2024-03-26T06:16:57.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.702+0000 7f97da000640 1 -- 172.21.15.63:0/2551615884 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4012870 con 0x7f97e00ae570 2024-03-26T06:16:57.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.702+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e0152480 con 0x7f97e00ae570 2024-03-26T06:16:57.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.703+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e00adb50 con 0x7f97e00ae570 2024-03-26T06:16:57.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.704+0000 7f97da000640 1 -- 172.21.15.63:0/2551615884 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f97d4012a10 con 0x7f97e00ae570 2024-03-26T06:16:57.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.705+0000 7f97da000640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f97c406bbd0 0x7f97c406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:57.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.705+0000 7f97da000640 1 -- 172.21.15.63:0/2551615884 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f97d408a640 con 0x7f97e00ae570 2024-03-26T06:16:57.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.705+0000 7f97e5400640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f97c406bbd0 0x7f97c406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:57.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.706+0000 7f97e5400640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f97c406bbd0 0x7f97c406e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f97e00ce6f0 tx=0x7f97d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:57.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.710+0000 7f97da000640 1 -- 172.21.15.63:0/2551615884 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f97e00adb50 con 0x7f97e00ae570 2024-03-26T06:16:57.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:57.954+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f97e0074730 con 0x7f97e00ae570 2024-03-26T06:16:58.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.509+0000 7f97da000640 1 -- 172.21.15.63:0/2551615884 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f97d4059190 con 0x7f97e00ae570 2024-03-26T06:16:58.510 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 2 and data pool 3 2024-03-26T06:16:58.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f97c406bbd0 msgr2=0x7f97c406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:58.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f97c406bbd0 0x7f97c406e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f97e00ce6f0 tx=0x7f97d0009040 comp rx=0 tx=0).stop 2024-03-26T06:16:58.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00ae570 msgr2=0x7f97e0150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:58.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00ae570 0x7f97e0150c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c450 tx=0x7f97d400c910 comp rx=0 tx=0).stop 2024-03-26T06:16:58.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 shutdown_connections 2024-03-26T06:16:58.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f97c406bbd0 0x7f97c406e090 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f97e00ce6f0 tx=0x7f97d0009040 comp rx=0 tx=0).stop 2024-03-26T06:16:58.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97e0157f90 0x7f97e01514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:58.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97e00b39f0 0x7f97e0146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:58.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 --2- 172.21.15.63:0/2551615884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97e00ae570 0x7f97e0150c90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:58.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.522+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 >> 172.21.15.63:0/2551615884 conn(0x7f97e006ac90 msgr2=0x7f97e00ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:58.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.523+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 shutdown_connections 2024-03-26T06:16:58.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.523+0000 7f97e8800640 1 -- 172.21.15.63:0/2551615884 wait complete. 2024-03-26T06:16:58.554 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-26T06:16:58.555 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-26T06:16:58.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.743+0000 7f9687800640 1 Processor -- start 2024-03-26T06:16:58.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.743+0000 7f9687800640 1 -- start start 2024-03-26T06:16:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.744+0000 7f9687800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f968006c1e0 0x7f968006c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.744+0000 7f9687800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f96800b6a80 0x7f96800b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.744+0000 7f9687800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96800cefd0 con 0x7f968015dce0 2024-03-26T06:16:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.744+0000 7f9687800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968006cb60 con 0x7f96800b6a80 2024-03-26T06:16:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.744+0000 7f9687800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968015e0c0 con 0x7f968006c1e0 2024-03-26T06:16:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.745+0000 7f9685800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f96800b6a80 0x7f96800b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.745+0000 7f9685800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f96800b6a80 0x7f96800b6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60284/0 (socket says 172.21.15.63:60284) 2024-03-26T06:16:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.745+0000 7f9685800640 1 -- 172.21.15.63:0/1568271799 learned_addr learned my addr 172.21.15.63:0/1568271799 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.745+0000 7f967fe00640 1 --2- 172.21.15.63:0/1568271799 >> v2:172.21.15.204:3300/0 conn(0x7f968006c1e0 0x7f968006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:58.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.745+0000 7f9685800640 1 -- 172.21.15.63:0/1568271799 >> v2:172.21.15.204:3300/0 conn(0x7f968006c1e0 msgr2=0x7f968006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:58.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.745+0000 7f9685800640 1 --2- 172.21.15.63:0/1568271799 >> v2:172.21.15.204:3300/0 conn(0x7f968006c1e0 0x7f968006c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:58.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.745+0000 7f9685800640 1 -- 172.21.15.63:0/1568271799 >> v1:172.21.15.204:6789/0 conn(0x7f968015dce0 legacy=0x7f96800ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:58.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.745+0000 7f9685800640 1 -- 172.21.15.63:0/1568271799 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96800d2880 con 0x7f96800b6a80 2024-03-26T06:16:58.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.747+0000 7f9685800640 1 --2- 172.21.15.63:0/1568271799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 0x7f96800b6eb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f968006a740 tx=0x7f967802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d7c8ac081151e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:58.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.747+0000 7f967f400640 1 -- 172.21.15.63:0/1568271799 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967802cbb0 con 0x7f96800b6a80 2024-03-26T06:16:58.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.747+0000 7f967f400640 1 -- 172.21.15.63:0/1568271799 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967802cd50 con 0x7f96800b6a80 2024-03-26T06:16:58.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.747+0000 7f967f400640 1 -- 172.21.15.63:0/1568271799 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678034610 con 0x7f96800b6a80 2024-03-26T06:16:58.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.748+0000 7f9687800640 1 -- 172.21.15.63:0/1568271799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 msgr2=0x7f96800b6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:58.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.748+0000 7f9687800640 1 --2- 172.21.15.63:0/1568271799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 0x7f96800b6eb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f968006a740 tx=0x7f967802c010 comp rx=0 tx=0).stop 2024-03-26T06:16:58.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.748+0000 7f9687800640 1 -- 172.21.15.63:0/1568271799 shutdown_connections 2024-03-26T06:16:58.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.748+0000 7f9687800640 1 --2- 172.21.15.63:0/1568271799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 0x7f96800b6eb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:58.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.748+0000 7f9687800640 1 --2- 172.21.15.63:0/1568271799 >> v2:172.21.15.204:3300/0 conn(0x7f968006c1e0 0x7f968006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:58.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.748+0000 7f9687800640 1 -- 172.21.15.63:0/1568271799 >> 172.21.15.63:0/1568271799 conn(0x7f96800729f0 msgr2=0x7f96800d3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:58.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.748+0000 7f9687800640 1 -- 172.21.15.63:0/1568271799 shutdown_connections 2024-03-26T06:16:58.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.748+0000 7f9687800640 1 -- 172.21.15.63:0/1568271799 wait complete. 2024-03-26T06:16:58.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.750+0000 7f9687800640 1 Processor -- start 2024-03-26T06:16:58.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.750+0000 7f9687800640 1 -- start start 2024-03-26T06:16:58.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.751+0000 7f9687800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968006c1e0 0x7f96801581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.751+0000 7f9687800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 0x7f9680156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.751+0000 7f9687800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968015dce0 0x7f968015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.751+0000 7f9687800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96800d3120 con 0x7f96800b6a80 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.751+0000 7f9687800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96800d2e40 con 0x7f968006c1e0 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.751+0000 7f9687800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96800d3400 con 0x7f968015dce0 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.751+0000 7f967fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 0x7f9680156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.751+0000 7f967fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 0x7f9680156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60300/0 (socket says 172.21.15.63:60300) 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.751+0000 7f967fe00640 1 -- 172.21.15.63:0/466377765 learned_addr learned my addr 172.21.15.63:0/466377765 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f9684e00640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968006c1e0 0x7f96801581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f9685800640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968015dce0 0x7f968015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f967fe00640 1 -- 172.21.15.63:0/466377765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968015dce0 msgr2=0x7f968015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f967fe00640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968015dce0 0x7f968015a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f967fe00640 1 -- 172.21.15.63:0/466377765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968006c1e0 msgr2=0x7f96801581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:58.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f967fe00640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968006c1e0 0x7f96801581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:58.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f967fe00640 1 -- 172.21.15.63:0/466377765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9680153710 con 0x7f96800b6a80 2024-03-26T06:16:58.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f967fe00640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 0x7f9680156640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f966800e9b0 tx=0x7f966800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f967cc00640 1 -- 172.21.15.63:0/466377765 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668017070 con 0x7f96800b6a80 2024-03-26T06:16:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f967cc00640 1 -- 172.21.15.63:0/466377765 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800c9a0 con 0x7f96800b6a80 2024-03-26T06:16:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f967cc00640 1 -- 172.21.15.63:0/466377765 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800cd90 con 0x7f96800b6a80 2024-03-26T06:16:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.752+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96801587e0 con 0x7f96800b6a80 2024-03-26T06:16:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.753+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9680155e40 con 0x7f96800b6a80 2024-03-26T06:16:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.754+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9680074810 con 0x7f96800b6a80 2024-03-26T06:16:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.755+0000 7f967cc00640 1 -- 172.21.15.63:0/466377765 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f966801a070 con 0x7f96800b6a80 2024-03-26T06:16:58.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.756+0000 7f967cc00640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f965c06bbd0 0x7f965c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:58.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.756+0000 7f967cc00640 1 -- 172.21.15.63:0/466377765 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f966808aaf0 con 0x7f96800b6a80 2024-03-26T06:16:58.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.756+0000 7f9684e00640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f965c06bbd0 0x7f965c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:58.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.757+0000 7f9684e00640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f965c06bbd0 0x7f965c06e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9670000f60 tx=0x7f9670009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:58.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.760+0000 7f967cc00640 1 -- 172.21.15.63:0/466377765 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f96801587e0 con 0x7f96800b6a80 2024-03-26T06:16:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:58.969+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f96801e4600 con 0x7f96800b6a80 2024-03-26T06:16:59.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.519+0000 7f967cc00640 1 -- 172.21.15.63:0/466377765 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f96680595d0 con 0x7f96800b6a80 2024-03-26T06:16:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.523+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f965c06bbd0 msgr2=0x7f965c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.523+0000 7f9687800640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f965c06bbd0 0x7f965c06e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9670000f60 tx=0x7f9670009040 comp rx=0 tx=0).stop 2024-03-26T06:16:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.523+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 msgr2=0x7f9680156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.523+0000 7f9687800640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 0x7f9680156640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f966800e9b0 tx=0x7f966800ee70 comp rx=0 tx=0).stop 2024-03-26T06:16:59.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.524+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 shutdown_connections 2024-03-26T06:16:59.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.524+0000 7f9687800640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f965c06bbd0 0x7f965c06e090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.524+0000 7f9687800640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968015dce0 0x7f968015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.524+0000 7f9687800640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96800b6a80 0x7f9680156640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.524+0000 7f9687800640 1 --2- 172.21.15.63:0/466377765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968006c1e0 0x7f96801581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.524+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 >> 172.21.15.63:0/466377765 conn(0x7f96800729f0 msgr2=0x7f96801e2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:59.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.525+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 shutdown_connections 2024-03-26T06:16:59.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.525+0000 7f9687800640 1 -- 172.21.15.63:0/466377765 wait complete. 2024-03-26T06:16:59.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-26T06:16:59.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.766+0000 7fecee000640 1 Processor -- start 2024-03-26T06:16:59.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.766+0000 7fecee000640 1 -- start start 2024-03-26T06:16:59.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.768+0000 7fecee000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fece806ac90 0x7fece80cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:59.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.768+0000 7fecee000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cf4e0 0x7fece806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:59.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.768+0000 7fecee000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fece80cd860 0x7fece80ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:59.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.768+0000 7fecee000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece80cfee0 con 0x7fece806ac90 2024-03-26T06:16:59.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.768+0000 7fecee000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece806b5b0 con 0x7fece80cd860 2024-03-26T06:16:59.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.768+0000 7fecee000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80d0180 con 0x7fece80cf4e0 2024-03-26T06:16:59.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.768+0000 7fece7400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fece806ac90 0x7fece80cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:59.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.768+0000 7fece7400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fece806ac90 0x7fece80cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60312/0 (socket says 172.21.15.63:60312) 2024-03-26T06:16:59.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.768+0000 7fece7400640 1 -- 172.21.15.63:0/1759010813 learned_addr learned my addr 172.21.15.63:0/1759010813 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.769+0000 7fece7e00640 1 --2- 172.21.15.63:0/1759010813 >> v2:172.21.15.204:3300/0 conn(0x7fece80cd860 0x7fece80ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.769+0000 7fece6a00640 1 --2- 172.21.15.63:0/1759010813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cf4e0 0x7fece806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.769+0000 7fece7400640 1 -- 172.21.15.63:0/1759010813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cf4e0 msgr2=0x7fece806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.769+0000 7fece7400640 1 --2- 172.21.15.63:0/1759010813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cf4e0 0x7fece806b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.769+0000 7fece7400640 1 -- 172.21.15.63:0/1759010813 >> v2:172.21.15.204:3300/0 conn(0x7fece80cd860 msgr2=0x7fece80ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:16:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.769+0000 7fece7400640 1 --2- 172.21.15.63:0/1759010813 >> v2:172.21.15.204:3300/0 conn(0x7fece80cd860 0x7fece80ad5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.769+0000 7fece7400640 1 -- 172.21.15.63:0/1759010813 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece80ccd80 con 0x7fece806ac90 2024-03-26T06:16:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.769+0000 7fece7e00640 1 --2- 172.21.15.63:0/1759010813 >> v2:172.21.15.204:3300/0 conn(0x7fece80cd860 0x7fece80ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.769+0000 7fece6a00640 1 --2- 172.21.15.63:0/1759010813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cf4e0 0x7fece806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.770+0000 7fece7400640 1 --2- 172.21.15.63:0/1759010813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece806ac90 0x7fece80cf9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fece8072440 tx=0x7fecd802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d201115d4035456e server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.770+0000 7fece6000640 1 -- 172.21.15.63:0/1759010813 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd802ca70 con 0x7fece806ac90 2024-03-26T06:16:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.770+0000 7fece6000640 1 -- 172.21.15.63:0/1759010813 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd802cc10 con 0x7fece806ac90 2024-03-26T06:16:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.770+0000 7fece6000640 1 -- 172.21.15.63:0/1759010813 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd80343f0 con 0x7fece806ac90 2024-03-26T06:16:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.771+0000 7fecee000640 1 -- 172.21.15.63:0/1759010813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece806ac90 msgr2=0x7fece80cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.771+0000 7fecee000640 1 --2- 172.21.15.63:0/1759010813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece806ac90 0x7fece80cf9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fece8072440 tx=0x7fecd802bed0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.771+0000 7fecee000640 1 -- 172.21.15.63:0/1759010813 shutdown_connections 2024-03-26T06:16:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.771+0000 7fecee000640 1 --2- 172.21.15.63:0/1759010813 >> v2:172.21.15.204:3300/0 conn(0x7fece80cd860 0x7fece80ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.771+0000 7fecee000640 1 --2- 172.21.15.63:0/1759010813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cf4e0 0x7fece806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.771+0000 7fecee000640 1 --2- 172.21.15.63:0/1759010813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece806ac90 0x7fece80cf9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.771+0000 7fecee000640 1 -- 172.21.15.63:0/1759010813 >> 172.21.15.63:0/1759010813 conn(0x7fece8099a70 msgr2=0x7fece80b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:16:59.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.771+0000 7fecee000640 1 -- 172.21.15.63:0/1759010813 shutdown_connections 2024-03-26T06:16:59.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.771+0000 7fecee000640 1 -- 172.21.15.63:0/1759010813 wait complete. 2024-03-26T06:16:59.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.773+0000 7fecee000640 1 Processor -- start 2024-03-26T06:16:59.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.773+0000 7fecee000640 1 -- start start 2024-03-26T06:16:59.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.774+0000 7fecee000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fece806ac90 0x7fece8149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:59.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.774+0000 7fecee000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cd860 0x7fece80c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:59.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.774+0000 7fecee000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece80cf4e0 0x7fece80c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:59.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.774+0000 7fecee000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece80d0460 con 0x7fece80cf4e0 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.774+0000 7fecee000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece80cd340 con 0x7fece806ac90 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.774+0000 7fecee000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece815bcb0 con 0x7fece80cd860 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.774+0000 7fece7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece80cf4e0 0x7fece80c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.774+0000 7fece7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece80cf4e0 0x7fece80c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60318/0 (socket says 172.21.15.63:60318) 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.774+0000 7fece7e00640 1 -- 172.21.15.63:0/742614929 learned_addr learned my addr 172.21.15.63:0/742614929 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fece6a00640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cd860 0x7fece80c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fece7400640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fece806ac90 0x7fece8149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fece7e00640 1 -- 172.21.15.63:0/742614929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cd860 msgr2=0x7fece80c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fece7e00640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cd860 0x7fece80c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fece7e00640 1 -- 172.21.15.63:0/742614929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fece806ac90 msgr2=0x7fece8149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fece7e00640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fece806ac90 0x7fece8149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fece7e00640 1 -- 172.21.15.63:0/742614929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8152ca0 con 0x7fece80cf4e0 2024-03-26T06:16:59.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fece7400640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fece806ac90 0x7fece8149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:16:59.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fece7e00640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece80cf4e0 0x7fece80c7d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fece000c7f0 tx=0x7fece000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:59.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fecdf400640 1 -- 172.21.15.63:0/742614929 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0015070 con 0x7fece80cf4e0 2024-03-26T06:16:59.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fecdf400640 1 -- 172.21.15.63:0/742614929 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0007820 con 0x7fece80cf4e0 2024-03-26T06:16:59.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fecdf400640 1 -- 172.21.15.63:0/742614929 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0007c10 con 0x7fece80cf4e0 2024-03-26T06:16:59.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece80c8330 con 0x7fece80cf4e0 2024-03-26T06:16:59.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.775+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece80c88f0 con 0x7fece80cf4e0 2024-03-26T06:16:59.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.777+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece8074730 con 0x7fece80cf4e0 2024-03-26T06:16:59.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.777+0000 7fecdf400640 1 -- 172.21.15.63:0/742614929 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fece0018070 con 0x7fece80cf4e0 2024-03-26T06:16:59.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.778+0000 7fecdf400640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fecc806bbd0 0x7fecc806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:16:59.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.778+0000 7fecdf400640 1 -- 172.21.15.63:0/742614929 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6007+0+0 (secure 0 0 0) 0x7fece008ad10 con 0x7fece80cf4e0 2024-03-26T06:16:59.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.779+0000 7fece7400640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fecc806bbd0 0x7fecc806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:16:59.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.779+0000 7fece7400640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fecc806bbd0 0x7fecc806e090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fecd8035000 tx=0x7fecd8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:16:59.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.783+0000 7fecdf400640 1 -- 172.21.15.63:0/742614929 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fece0090020 con 0x7fece80cf4e0 2024-03-26T06:16:59.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:16:59.983+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fece8149ff0 con 0x7fece80cf4e0 2024-03-26T06:17:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.529+0000 7fecdf400640 1 -- 172.21.15.63:0/742614929 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fece0059780 con 0x7fece80cf4e0 2024-03-26T06:17:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data_ec' created 2024-03-26T06:17:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.534+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fecc806bbd0 msgr2=0x7fecc806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.534+0000 7fecee000640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fecc806bbd0 0x7fecc806e090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fecd8035000 tx=0x7fecd8030000 comp rx=0 tx=0).stop 2024-03-26T06:17:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.534+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece80cf4e0 msgr2=0x7fece80c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:01.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.534+0000 7fecee000640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece80cf4e0 0x7fece80c7d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fece000c7f0 tx=0x7fece000ccb0 comp rx=0 tx=0).stop 2024-03-26T06:17:01.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.535+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 shutdown_connections 2024-03-26T06:17:01.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.535+0000 7fecee000640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fecc806bbd0 0x7fecc806e090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.535+0000 7fecee000640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fece80cf4e0 0x7fece80c7d00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.535+0000 7fecee000640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fece80cd860 0x7fece80c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.535+0000 7fecee000640 1 --2- 172.21.15.63:0/742614929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fece806ac90 0x7fece8149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.535+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 >> 172.21.15.63:0/742614929 conn(0x7fece8099a70 msgr2=0x7fece815a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.536+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 shutdown_connections 2024-03-26T06:17:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.536+0000 7fecee000640 1 -- 172.21.15.63:0/742614929 wait complete. 2024-03-26T06:17:01.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-26T06:17:01.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.762+0000 7fa11f800640 1 Processor -- start 2024-03-26T06:17:01.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.762+0000 7fa11f800640 1 -- start start 2024-03-26T06:17:01.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.763+0000 7fa11f800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1181451b0 0x7fa1180b4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:01.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.763+0000 7fa11f800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180b32b0 con 0x7fa1180cef00 2024-03-26T06:17:01.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.763+0000 7fa11f800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180b3590 con 0x7fa11806afc0 2024-03-26T06:17:01.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.763+0000 7fa11f800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1180b3060 con 0x7fa1181451b0 2024-03-26T06:17:01.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.764+0000 7fa11ce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1181451b0 0x7fa1180b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:01.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.764+0000 7fa11d800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa1180cef00 0x7fa11815bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51518/0 (socket says 172.21.15.63:51518) 2024-03-26T06:17:01.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.764+0000 7fa11d800640 1 -- 172.21.15.63:0/3651548227 learned_addr learned my addr 172.21.15.63:0/3651548227 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:01.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.764+0000 7fa11ce00640 1 -- 172.21.15.63:0/3651548227 >> v1:172.21.15.204:6789/0 conn(0x7fa11806afc0 legacy=0x7fa1180ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:01.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.764+0000 7fa11ce00640 1 -- 172.21.15.63:0/3651548227 >> v1:172.21.15.63:6789/0 conn(0x7fa1180cef00 legacy=0x7fa11815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:01.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.764+0000 7fa11ce00640 1 -- 172.21.15.63:0/3651548227 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1180b3870 con 0x7fa1181451b0 2024-03-26T06:17:01.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.764+0000 7fa117400640 1 -- 172.21.15.63:0/3651548227 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117044331 0 0) 0x7fa1180b32b0 con 0x7fa1180cef00 2024-03-26T06:17:01.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.766+0000 7fa11ce00640 1 --2- 172.21.15.63:0/3651548227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1181451b0 0x7fa1180b4350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0097a0 tx=0x7fa10c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d43f1035a10bef server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:01.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.766+0000 7fa117400640 1 -- 172.21.15.63:0/3651548227 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c034070 con 0x7fa1181451b0 2024-03-26T06:17:01.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.766+0000 7fa117400640 1 -- 172.21.15.63:0/3651548227 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c030610 con 0x7fa1181451b0 2024-03-26T06:17:01.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.766+0000 7fa117400640 1 -- 172.21.15.63:0/3651548227 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0309e0 con 0x7fa1181451b0 2024-03-26T06:17:01.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.767+0000 7fa11f800640 1 -- 172.21.15.63:0/3651548227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1181451b0 msgr2=0x7fa1180b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:01.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.767+0000 7fa11f800640 1 --2- 172.21.15.63:0/3651548227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1181451b0 0x7fa1180b4350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0097a0 tx=0x7fa10c02b960 comp rx=0 tx=0).stop 2024-03-26T06:17:01.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.767+0000 7fa11f800640 1 -- 172.21.15.63:0/3651548227 shutdown_connections 2024-03-26T06:17:01.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.767+0000 7fa11f800640 1 --2- 172.21.15.63:0/3651548227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1181451b0 0x7fa1180b4350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:01.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.767+0000 7fa11f800640 1 -- 172.21.15.63:0/3651548227 >> 172.21.15.63:0/3651548227 conn(0x7fa1180cf670 msgr2=0x7fa1180cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:01.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.767+0000 7fa11f800640 1 -- 172.21.15.63:0/3651548227 shutdown_connections 2024-03-26T06:17:01.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.767+0000 7fa11f800640 1 -- 172.21.15.63:0/3651548227 wait complete. 2024-03-26T06:17:01.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.768+0000 7fa11f800640 1 Processor -- start 2024-03-26T06:17:01.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.769+0000 7fa11f800640 1 -- start start 2024-03-26T06:17:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.769+0000 7fa11f800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa11806afc0 0x7fa11806ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.769+0000 7fa11f800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1180cef00 0x7fa1180c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa11f800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1181451b0 0x7fa1180ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa11f800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa118145590 con 0x7fa1180cef00 2024-03-26T06:17:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa11f800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180b3e30 con 0x7fa1181451b0 2024-03-26T06:17:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa11f800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa118145710 con 0x7fa11806afc0 2024-03-26T06:17:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa117e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1180cef00 0x7fa1180c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa117e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1180cef00 0x7fa1180c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58316/0 (socket says 172.21.15.63:58316) 2024-03-26T06:17:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa117e00640 1 -- 172.21.15.63:0/2805089019 learned_addr learned my addr 172.21.15.63:0/2805089019 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa11ce00640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa11806afc0 0x7fa11806ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa117e00640 1 -- 172.21.15.63:0/2805089019 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa11806afc0 msgr2=0x7fa11806ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa117e00640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa11806afc0 0x7fa11806ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa117e00640 1 -- 172.21.15.63:0/2805089019 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1181451b0 msgr2=0x7fa1180ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa117e00640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1181451b0 0x7fa1180ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.770+0000 7fa117e00640 1 -- 172.21.15.63:0/2805089019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1180ac980 con 0x7fa1180cef00 2024-03-26T06:17:01.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.771+0000 7fa117e00640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1180cef00 0x7fa1180c5760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c450 tx=0x7fa10400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:01.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.771+0000 7fa114c00640 1 -- 172.21.15.63:0/2805089019 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040052d0 con 0x7fa1180cef00 2024-03-26T06:17:01.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.771+0000 7fa114c00640 1 -- 172.21.15.63:0/2805089019 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104005470 con 0x7fa1180cef00 2024-03-26T06:17:01.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.771+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1180acc20 con 0x7fa1180cef00 2024-03-26T06:17:01.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.771+0000 7fa114c00640 1 -- 172.21.15.63:0/2805089019 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104012870 con 0x7fa1180cef00 2024-03-26T06:17:01.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.771+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1180ad4c0 con 0x7fa1180cef00 2024-03-26T06:17:01.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.772+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa118074810 con 0x7fa1180cef00 2024-03-26T06:17:01.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.773+0000 7fa114c00640 1 -- 172.21.15.63:0/2805089019 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa104012a10 con 0x7fa1180cef00 2024-03-26T06:17:01.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.774+0000 7fa114c00640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0f806bbd0 0x7fa0f806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:01.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.774+0000 7fa114c00640 1 -- 172.21.15.63:0/2805089019 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa10408a9d0 con 0x7fa1180cef00 2024-03-26T06:17:01.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.775+0000 7fa11ce00640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0f806bbd0 0x7fa0f806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:01.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.775+0000 7fa11ce00640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0f806bbd0 0x7fa0f806e090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa10c036000 tx=0x7fa10c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:01.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.780+0000 7fa114c00640 1 -- 172.21.15.63:0/2805089019 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa104059190 con 0x7fa1180cef00 2024-03-26T06:17:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:01.983+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa1181415e0 con 0x7fa1180cef00 2024-03-26T06:17:02.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.540+0000 7fa114c00640 1 -- 172.21.15.63:0/2805089019 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa104058a90 con 0x7fa1180cef00 2024-03-26T06:17:02.541 INFO:teuthology.orchestra.run.smithi063.stderr:set pool 4 allow_ec_overwrites to true 2024-03-26T06:17:02.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.544+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0f806bbd0 msgr2=0x7fa0f806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:02.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.544+0000 7fa11f800640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0f806bbd0 0x7fa0f806e090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa10c036000 tx=0x7fa10c008030 comp rx=0 tx=0).stop 2024-03-26T06:17:02.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.544+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1180cef00 msgr2=0x7fa1180c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:02.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.544+0000 7fa11f800640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1180cef00 0x7fa1180c5760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c450 tx=0x7fa10400c910 comp rx=0 tx=0).stop 2024-03-26T06:17:02.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.545+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 shutdown_connections 2024-03-26T06:17:02.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.545+0000 7fa11f800640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0f806bbd0 0x7fa0f806e090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:02.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.545+0000 7fa11f800640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1181451b0 0x7fa1180ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:02.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.545+0000 7fa11f800640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1180cef00 0x7fa1180c5760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:02.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.545+0000 7fa11f800640 1 --2- 172.21.15.63:0/2805089019 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa11806afc0 0x7fa11806ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:02.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.545+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 >> 172.21.15.63:0/2805089019 conn(0x7fa1180cf670 msgr2=0x7fa1180cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:02.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.545+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 shutdown_connections 2024-03-26T06:17:02.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.546+0000 7fa11f800640 1 -- 172.21.15.63:0/2805089019 wait complete. 2024-03-26T06:17:02.588 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-26T06:17:02.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.773+0000 7f9038a00640 1 Processor -- start 2024-03-26T06:17:02.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.773+0000 7f9038a00640 1 -- start start 2024-03-26T06:17:02.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.775+0000 7f9038a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903415dca0 0x7f90340d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:02.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.775+0000 7f9038a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90340d22d0 con 0x7f90340d3840 2024-03-26T06:17:02.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.775+0000 7f9038a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90340d25b0 con 0x7f90340b9320 2024-03-26T06:17:02.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.775+0000 7f9038a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90340d2890 con 0x7f903415dca0 2024-03-26T06:17:02.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.775+0000 7f9032800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f90340d3840 0x7f90340d3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51530/0 (socket says 172.21.15.63:51530) 2024-03-26T06:17:02.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.775+0000 7f9032800640 1 -- 172.21.15.63:0/2818775769 learned_addr learned my addr 172.21.15.63:0/2818775769 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.775+0000 7f9031e00640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903415dca0 0x7f90340d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564174994 0 0) 0x7f90340d22d0 con 0x7f90340d3840 2024-03-26T06:17:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9014003520 con 0x7f90340d3840 2024-03-26T06:17:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1374846379 0 0) 0x7f9014003520 con 0x7f90340d3840 2024-03-26T06:17:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903415dca0 msgr2=0x7f90340d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903415dca0 0x7f90340d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 >> v1:172.21.15.204:6789/0 conn(0x7f90340b9320 legacy=0x7f90340b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340d2b70 con 0x7f90340d3840 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f9024001670 con 0x7f90340d3840 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 >> v1:172.21.15.63:6789/0 conn(0x7f90340d3840 legacy=0x7f90340d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903415dca0 0x7f90140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014003f60 0x7f9014004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9014004d40 0x7f90140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340d2890 con 0x7f9014004d40 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901400baa0 con 0x7f9014003f60 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901400bca0 con 0x7f903415dca0 2024-03-26T06:17:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.776+0000 7f9033200640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9014004d40 0x7f90140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.777+0000 7f9032800640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903415dca0 0x7f90140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.777+0000 7f9031e00640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014003f60 0x7f9014004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.777+0000 7f9033200640 1 -- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903415dca0 msgr2=0x7f90140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.777+0000 7f9033200640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903415dca0 0x7f90140039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.777+0000 7f9033200640 1 -- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014003f60 msgr2=0x7f9014004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.777+0000 7f9033200640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014003f60 0x7f9014004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.777+0000 7f9033200640 1 -- 172.21.15.63:0/2818775769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9014003520 con 0x7f9014004d40 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.778+0000 7f9033200640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9014004d40 0x7f90140051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f902c001720 tx=0x7f9014005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fea1551c2c7f34 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.778+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c001370 con 0x7f9014004d40 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.778+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c0052d0 con 0x7f9014004d40 2024-03-26T06:17:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.778+0000 7f9031400640 1 -- 172.21.15.63:0/2818775769 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c003830 con 0x7f9014004d40 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.779+0000 7f9038a00640 1 -- 172.21.15.63:0/2818775769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9014004d40 msgr2=0x7f90140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.779+0000 7f9038a00640 1 --2- 172.21.15.63:0/2818775769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9014004d40 0x7f90140051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f902c001720 tx=0x7f9014005830 comp rx=0 tx=0).stop 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.779+0000 7f9033200640 1 -- 172.21.15.63:0/2818775769 reap_dead start 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.779+0000 7f9038a00640 1 -- 172.21.15.63:0/2818775769 shutdown_connections 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.779+0000 7f9038a00640 1 -- 172.21.15.63:0/2818775769 >> 172.21.15.63:0/2818775769 conn(0x7f903406c570 msgr2=0x7f903406c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.779+0000 7f9038a00640 1 -- 172.21.15.63:0/2818775769 shutdown_connections 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.779+0000 7f9038a00640 1 -- 172.21.15.63:0/2818775769 wait complete. 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.781+0000 7f9038a00640 1 Processor -- start 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.781+0000 7f9038a00640 1 -- start start 2024-03-26T06:17:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.782+0000 7f9038a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014004d40 0x7f90340c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.782+0000 7f9038a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90340cd630 0x7f90340cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.782+0000 7f9038a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90341f33d0 0x7f90341f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.782+0000 7f9038a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340d34f0 con 0x7f90340cd630 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.782+0000 7f9038a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340d3370 con 0x7f9014004d40 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.782+0000 7f9038a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90340d3670 con 0x7f90341f33d0 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.782+0000 7f9031e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90340cd630 0x7f90340cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.782+0000 7f9031e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90340cd630 0x7f90340cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58336/0 (socket says 172.21.15.63:58336) 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.782+0000 7f9031e00640 1 -- 172.21.15.63:0/1855386331 learned_addr learned my addr 172.21.15.63:0/1855386331 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9032800640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014004d40 0x7f90340c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9031e00640 1 -- 172.21.15.63:0/1855386331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90341f33d0 msgr2=0x7f90341f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9033200640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90341f33d0 0x7f90341f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9031e00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90341f33d0 0x7f90341f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9031e00640 1 -- 172.21.15.63:0/1855386331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014004d40 msgr2=0x7f90340c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9031e00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014004d40 0x7f90340c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9031e00640 1 -- 172.21.15.63:0/1855386331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90341f3da0 con 0x7f90340cd630 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9032800640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014004d40 0x7f90340c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9031e00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90340cd630 0x7f90340cb390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f901c007f60 tx=0x7f901c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f902aa00640 1 -- 172.21.15.63:0/1855386331 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c01a020 con 0x7f90340cd630 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f902aa00640 1 -- 172.21.15.63:0/1855386331 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c016470 con 0x7f90340cd630 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f902aa00640 1 -- 172.21.15.63:0/1855386331 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c016860 con 0x7f90340cd630 2024-03-26T06:17:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.783+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90340cbd00 con 0x7f90340cd630 2024-03-26T06:17:02.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.784+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90341f4680 con 0x7f90340cd630 2024-03-26T06:17:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.785+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903404f0c0 con 0x7f90340cd630 2024-03-26T06:17:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.786+0000 7f902aa00640 1 -- 172.21.15.63:0/1855386331 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f901c005d10 con 0x7f90340cd630 2024-03-26T06:17:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.786+0000 7f902aa00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f901006bbd0 0x7f901006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.787+0000 7f902aa00640 1 -- 172.21.15.63:0/1855386331 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f901c08bf00 con 0x7f90340cd630 2024-03-26T06:17:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.787+0000 7f9032800640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f901006bbd0 0x7f901006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.787+0000 7f9032800640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f901006bbd0 0x7f901006e090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9024001050 tx=0x7f9024001d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:02.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:02.791+0000 7f902aa00640 1 -- 172.21.15.63:0/1855386331 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f901c024030 con 0x7f90340cd630 2024-03-26T06:17:03.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.048+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f903415bf40 con 0x7f90340cd630 2024-03-26T06:17:03.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.557+0000 7f902aa00640 1 -- 172.21.15.63:0/1855386331 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f901c05a6c0 con 0x7f90340cd630 2024-03-26T06:17:03.558 INFO:teuthology.orchestra.run.smithi063.stderr:added data pool 4 to fsmap 2024-03-26T06:17:03.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.561+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f901006bbd0 msgr2=0x7f901006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:03.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.561+0000 7f9038a00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f901006bbd0 0x7f901006e090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9024001050 tx=0x7f9024001d50 comp rx=0 tx=0).stop 2024-03-26T06:17:03.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.561+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90340cd630 msgr2=0x7f90340cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:03.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.561+0000 7f9038a00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90340cd630 0x7f90340cb390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f901c007f60 tx=0x7f901c007f90 comp rx=0 tx=0).stop 2024-03-26T06:17:03.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.562+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 shutdown_connections 2024-03-26T06:17:03.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.562+0000 7f9038a00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f901006bbd0 0x7f901006e090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.562+0000 7f9038a00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90341f33d0 0x7f90341f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.562+0000 7f9038a00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90340cd630 0x7f90340cb390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.562+0000 7f9038a00640 1 --2- 172.21.15.63:0/1855386331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9014004d40 0x7f90340c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.562+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 >> 172.21.15.63:0/1855386331 conn(0x7f903406c570 msgr2=0x7f90340d3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:03.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.562+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 shutdown_connections 2024-03-26T06:17:03.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.562+0000 7f9038a00640 1 -- 172.21.15.63:0/1855386331 wait complete. 2024-03-26T06:17:03.584 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:17:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.788+0000 7fb531e00640 1 Processor -- start 2024-03-26T06:17:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.788+0000 7fb531e00640 1 -- start start 2024-03-26T06:17:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb531e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb52c15dc30 0x7fb52c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb531e00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb52c161810 0x7fb52c0d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb531e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52c0d38f0 con 0x7fb52c0d0a20 2024-03-26T06:17:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb531e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb52c0d0e70 con 0x7fb52c15dc30 2024-03-26T06:17:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb531e00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb52c0d1ed0 con 0x7fb52c161810 2024-03-26T06:17:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb52aa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb52c15dc30 0x7fb52c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb52aa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb52c15dc30 0x7fb52c0ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58342/0 (socket says 172.21.15.63:58342) 2024-03-26T06:17:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb52aa00640 1 -- 172.21.15.63:0/2978531315 learned_addr learned my addr 172.21.15.63:0/2978531315 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb52aa00640 1 -- 172.21.15.63:0/2978531315 >> v2:172.21.15.204:3300/0 conn(0x7fb52c161810 msgr2=0x7fb52c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb52aa00640 1 --2- 172.21.15.63:0/2978531315 >> v2:172.21.15.204:3300/0 conn(0x7fb52c161810 0x7fb52c0d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb52aa00640 1 -- 172.21.15.63:0/2978531315 >> v1:172.21.15.204:6789/0 conn(0x7fb52c0d0a20 legacy=0x7fb52c06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.790+0000 7fb52aa00640 1 -- 172.21.15.63:0/2978531315 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c0cf3b0 con 0x7fb52c15dc30 2024-03-26T06:17:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.792+0000 7fb52aa00640 1 --2- 172.21.15.63:0/2978531315 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 0x7fb52c0ce450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0b65c0 tx=0x7fb51c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff544a61f082299 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.792+0000 7fb529600640 1 -- 172.21.15.63:0/2978531315 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c02ca80 con 0x7fb52c15dc30 2024-03-26T06:17:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.792+0000 7fb529600640 1 -- 172.21.15.63:0/2978531315 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c02cc20 con 0x7fb52c15dc30 2024-03-26T06:17:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.792+0000 7fb529600640 1 -- 172.21.15.63:0/2978531315 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0343f0 con 0x7fb52c15dc30 2024-03-26T06:17:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.793+0000 7fb531e00640 1 -- 172.21.15.63:0/2978531315 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 msgr2=0x7fb52c0ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.793+0000 7fb531e00640 1 --2- 172.21.15.63:0/2978531315 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 0x7fb52c0ce450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0b65c0 tx=0x7fb51c02bee0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.793+0000 7fb531e00640 1 -- 172.21.15.63:0/2978531315 shutdown_connections 2024-03-26T06:17:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.793+0000 7fb531e00640 1 --2- 172.21.15.63:0/2978531315 >> v2:172.21.15.204:3300/0 conn(0x7fb52c161810 0x7fb52c0d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.793+0000 7fb531e00640 1 --2- 172.21.15.63:0/2978531315 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 0x7fb52c0ce450 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.793+0000 7fb531e00640 1 -- 172.21.15.63:0/2978531315 >> 172.21.15.63:0/2978531315 conn(0x7fb52c0729f0 msgr2=0x7fb52c0b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.793+0000 7fb531e00640 1 -- 172.21.15.63:0/2978531315 shutdown_connections 2024-03-26T06:17:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.793+0000 7fb531e00640 1 -- 172.21.15.63:0/2978531315 wait complete. 2024-03-26T06:17:03.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.795+0000 7fb531e00640 1 Processor -- start 2024-03-26T06:17:03.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.795+0000 7fb531e00640 1 -- start start 2024-03-26T06:17:03.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb531e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb52c0d0a20 0x7fb52c151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb531e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 0x7fb52c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb531e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb52c161810 0x7fb52c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb531e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c0cf0d0 con 0x7fb52c15dc30 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb531e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c0cedf0 con 0x7fb52c161810 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb531e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c0d3370 con 0x7fb52c0d0a20 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb52a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 0x7fb52c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb52a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 0x7fb52c155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58344/0 (socket says 172.21.15.63:58344) 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb52a000640 1 -- 172.21.15.63:0/3590066613 learned_addr learned my addr 172.21.15.63:0/3590066613 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb52a000640 1 -- 172.21.15.63:0/3590066613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb52c0d0a20 msgr2=0x7fb52c151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb52aa00640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb52c0d0a20 0x7fb52c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb52a000640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb52c0d0a20 0x7fb52c151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb52b400640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb52c161810 0x7fb52c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:03.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.796+0000 7fb52a000640 1 -- 172.21.15.63:0/3590066613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb52c161810 msgr2=0x7fb52c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:03.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.797+0000 7fb52a000640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb52c161810 0x7fb52c156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:03.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.797+0000 7fb52a000640 1 -- 172.21.15.63:0/3590066613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c155ae0 con 0x7fb52c15dc30 2024-03-26T06:17:03.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.797+0000 7fb52a000640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 0x7fb52c155090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb51400b4a0 tx=0x7fb51400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:03.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.797+0000 7fb523400640 1 -- 172.21.15.63:0/3590066613 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514014070 con 0x7fb52c15dc30 2024-03-26T06:17:03.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.797+0000 7fb523400640 1 -- 172.21.15.63:0/3590066613 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb514010610 con 0x7fb52c15dc30 2024-03-26T06:17:03.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.797+0000 7fb523400640 1 -- 172.21.15.63:0/3590066613 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514010a00 con 0x7fb52c15dc30 2024-03-26T06:17:03.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.797+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52c155dc0 con 0x7fb52c15dc30 2024-03-26T06:17:03.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.797+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52c156380 con 0x7fb52c15dc30 2024-03-26T06:17:03.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.798+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52c074730 con 0x7fb52c15dc30 2024-03-26T06:17:03.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.799+0000 7fb523400640 1 -- 172.21.15.63:0/3590066613 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb514017070 con 0x7fb52c15dc30 2024-03-26T06:17:03.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.800+0000 7fb523400640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb50806bbd0 0x7fb50806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:03.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.800+0000 7fb523400640 1 -- 172.21.15.63:0/3590066613 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb51408a8a0 con 0x7fb52c15dc30 2024-03-26T06:17:03.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.801+0000 7fb52aa00640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb50806bbd0 0x7fb50806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:03.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.801+0000 7fb52aa00640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb50806bbd0 0x7fb50806e090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb51c035000 tx=0x7fb51c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:03.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:03.805+0000 7fb523400640 1 -- 172.21.15.63:0/3590066613 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb514058fb0 con 0x7fb52c15dc30 2024-03-26T06:17:04.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.046+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb52c15a220 con 0x7fb52c15dc30 2024-03-26T06:17:04.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.047+0000 7fb523400640 1 -- 172.21.15.63:0/3590066613 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4937 (secure 0 0 0) 0x7fb5140588b0 con 0x7fb52c15dc30 2024-03-26T06:17:04.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:04.047 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:03.050105+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-26T06:17:04.047 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2024-03-26T06:17:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb50806bbd0 msgr2=0x7fb50806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb50806bbd0 0x7fb50806e090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb51c035000 tx=0x7fb51c030000 comp rx=0 tx=0).stop 2024-03-26T06:17:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 msgr2=0x7fb52c155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 0x7fb52c155090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb51400b4a0 tx=0x7fb51400b960 comp rx=0 tx=0).stop 2024-03-26T06:17:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 shutdown_connections 2024-03-26T06:17:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb50806bbd0 0x7fb50806e090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb52c161810 0x7fb52c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb52c15dc30 0x7fb52c155090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 --2- 172.21.15.63:0/3590066613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb52c0d0a20 0x7fb52c151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.049+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 >> 172.21.15.63:0/3590066613 conn(0x7fb52c0729f0 msgr2=0x7fb52c15cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:04.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.050+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 shutdown_connections 2024-03-26T06:17:04.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.050+0000 7fb531e00640 1 -- 172.21.15.63:0/3590066613 wait complete. 2024-03-26T06:17:04.068 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:04.179 INFO:tasks.ceph.mds.d.smithi204.stderr:2024-03-26T06:17:04.178+0000 7f3ee8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-26T06:17:04.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.292+0000 7fd129a00640 1 Processor -- start 2024-03-26T06:17:04.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.292+0000 7fd129a00640 1 -- start start 2024-03-26T06:17:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.294+0000 7fd129a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd124071350 0x7fd1240717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.294+0000 7fd129a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12415bf80 con 0x7fd124145100 2024-03-26T06:17:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.294+0000 7fd129a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12406e2f0 con 0x7fd1240cc3f0 2024-03-26T06:17:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.294+0000 7fd129a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1240a86e0 con 0x7fd124071350 2024-03-26T06:17:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.295+0000 7fd122a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd124145100 0x7fd12406ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51544/0 (socket says 172.21.15.63:51544) 2024-03-26T06:17:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.295+0000 7fd122a00640 1 -- 172.21.15.63:0/4141212421 learned_addr learned my addr 172.21.15.63:0/4141212421 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.295+0000 7fd11a000640 1 --2- 172.21.15.63:0/4141212421 >> v2:172.21.15.204:3300/0 conn(0x7fd124071350 0x7fd1240717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.295+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695060572 0 0) 0x7fd12415bf80 con 0x7fd124145100 2024-03-26T06:17:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.295+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd108003520 con 0x7fd124145100 2024-03-26T06:17:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518092283 0 0) 0x7fd108003520 con 0x7fd124145100 2024-03-26T06:17:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 >> v2:172.21.15.204:3300/0 conn(0x7fd124071350 msgr2=0x7fd1240717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 --2- 172.21.15.63:0/4141212421 >> v2:172.21.15.204:3300/0 conn(0x7fd124071350 0x7fd1240717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 >> v1:172.21.15.204:6789/0 conn(0x7fd1240cc3f0 legacy=0x7fd1240cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12406d770 con 0x7fd124145100 2024-03-26T06:17:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fd114001a10 con 0x7fd124145100 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 >> v1:172.21.15.63:6789/0 conn(0x7fd124145100 legacy=0x7fd12406ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd108003a00 0x7fd108003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd108004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1080051c0 0x7fd10800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10800c090 con 0x7fd108004800 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10800c240 con 0x7fd1080051c0 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10800c440 con 0x7fd108003a00 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd11a000640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd108004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd122a00640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd108003a00 0x7fd108003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.296+0000 7fd123400640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1080051c0 0x7fd10800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.297+0000 7fd11a000640 1 -- 172.21.15.63:0/4141212421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd108003a00 msgr2=0x7fd108003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.297+0000 7fd11a000640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd108003a00 0x7fd108003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.297+0000 7fd11a000640 1 -- 172.21.15.63:0/4141212421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1080051c0 msgr2=0x7fd10800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.297+0000 7fd11a000640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1080051c0 0x7fd10800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.297+0000 7fd11a000640 1 -- 172.21.15.63:0/4141212421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108003520 con 0x7fd108004800 2024-03-26T06:17:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.297+0000 7fd123400640 1 -- 172.21.15.63:0/4141212421 reap_dead start 2024-03-26T06:17:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.298+0000 7fd11a000640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd108004c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009ac0 tx=0x7fd108005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f7ef73813506d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.298+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c039070 con 0x7fd108004800 2024-03-26T06:17:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.298+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c02c6b0 con 0x7fd108004800 2024-03-26T06:17:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.298+0000 7fd122000640 1 -- 172.21.15.63:0/4141212421 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c009690 con 0x7fd108004800 2024-03-26T06:17:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.299+0000 7fd129a00640 1 -- 172.21.15.63:0/4141212421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 msgr2=0x7fd108004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.299+0000 7fd129a00640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd108004c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009ac0 tx=0x7fd108005830 comp rx=0 tx=0).stop 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.299+0000 7fd129a00640 1 -- 172.21.15.63:0/4141212421 shutdown_connections 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.299+0000 7fd129a00640 1 --2- 172.21.15.63:0/4141212421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd108004c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.299+0000 7fd129a00640 1 -- 172.21.15.63:0/4141212421 >> 172.21.15.63:0/4141212421 conn(0x7fd12406ac90 msgr2=0x7fd12406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.299+0000 7fd129a00640 1 -- 172.21.15.63:0/4141212421 shutdown_connections 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.299+0000 7fd129a00640 1 -- 172.21.15.63:0/4141212421 wait complete. 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.301+0000 7fd129a00640 1 Processor -- start 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.301+0000 7fd129a00640 1 -- start start 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd129a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd124137e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd129a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12415c640 0x7fd12415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd129a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12415ef40 0x7fd12415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd129a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12406e010 con 0x7fd108004800 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd129a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12406dd30 con 0x7fd12415ef40 2024-03-26T06:17:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd129a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1241454e0 con 0x7fd12415c640 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd122a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd124137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd122a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd124137e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58360/0 (socket says 172.21.15.63:58360) 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd122a00640 1 -- 172.21.15.63:0/673662946 learned_addr learned my addr 172.21.15.63:0/673662946 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd122a00640 1 -- 172.21.15.63:0/673662946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12415c640 msgr2=0x7fd12415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd122a00640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12415c640 0x7fd12415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd122a00640 1 -- 172.21.15.63:0/673662946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12415ef40 msgr2=0x7fd12415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd123400640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12415ef40 0x7fd12415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd122a00640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12415ef40 0x7fd12415cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd122a00640 1 -- 172.21.15.63:0/673662946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1241400a0 con 0x7fd108004800 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.302+0000 7fd123400640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12415ef40 0x7fd12415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.303+0000 7fd122a00640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd124137e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd114001f90 tx=0x7fd11400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.303+0000 7fd11b400640 1 -- 172.21.15.63:0/673662946 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400ee50 con 0x7fd108004800 2024-03-26T06:17:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.303+0000 7fd11b400640 1 -- 172.21.15.63:0/673662946 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114018070 con 0x7fd108004800 2024-03-26T06:17:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.303+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd124140380 con 0x7fd108004800 2024-03-26T06:17:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.303+0000 7fd11b400640 1 -- 172.21.15.63:0/673662946 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114013660 con 0x7fd108004800 2024-03-26T06:17:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.303+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd124140940 con 0x7fd108004800 2024-03-26T06:17:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.304+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd124074730 con 0x7fd108004800 2024-03-26T06:17:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.305+0000 7fd11b400640 1 -- 172.21.15.63:0/673662946 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd114013800 con 0x7fd108004800 2024-03-26T06:17:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.306+0000 7fd11b400640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd10006bd70 0x7fd10006e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.306+0000 7fd11b400640 1 -- 172.21.15.63:0/673662946 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd11408b650 con 0x7fd108004800 2024-03-26T06:17:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.306+0000 7fd11a000640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd10006bd70 0x7fd10006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.307+0000 7fd11a000640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd10006bd70 0x7fd10006e230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd10c036000 tx=0x7fd10c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.311+0000 7fd11b400640 1 -- 172.21.15.63:0/673662946 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fd114059df0 con 0x7fd108004800 2024-03-26T06:17:04.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.514+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1240b0aa0 con 0x7fd108004800 2024-03-26T06:17:04.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.517+0000 7fd11b400640 1 -- 172.21.15.63:0/673662946 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7fd1140596f0 con 0x7fd108004800 2024-03-26T06:17:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:04.518 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd10006bd70 msgr2=0x7fd10006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd10006bd70 0x7fd10006e230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd10c036000 tx=0x7fd10c02e000 comp rx=0 tx=0).stop 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 msgr2=0x7fd124137e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd124137e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd114001f90 tx=0x7fd11400e530 comp rx=0 tx=0).stop 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 shutdown_connections 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd10006bd70 0x7fd10006e230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12415ef40 0x7fd12415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12415c640 0x7fd12415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 --2- 172.21.15.63:0/673662946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd108004800 0x7fd124137e20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.520+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 >> 172.21.15.63:0/673662946 conn(0x7fd12406ac90 msgr2=0x7fd1240af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.521+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 shutdown_connections 2024-03-26T06:17:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.521+0000 7fd129a00640 1 -- 172.21.15.63:0/673662946 wait complete. 2024-03-26T06:17:04.538 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.748+0000 7f4c67200640 1 Processor -- start 2024-03-26T06:17:04.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.749+0000 7f4c67200640 1 -- start start 2024-03-26T06:17:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.750+0000 7f4c67200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c600cdf10 0x7f4c600ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.750+0000 7f4c67200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4c6015fe40 0x7f4c600cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.750+0000 7f4c67200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 0x7f4c600c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c67200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600ce830 con 0x7f4c600cdf10 2024-03-26T06:17:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c67200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600cfd50 con 0x7f4c6015fe40 2024-03-26T06:17:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c67200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600d0030 con 0x7f4c600cf8d0 2024-03-26T06:17:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5fe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c600cdf10 0x7f4c600ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5fe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c600cdf10 0x7f4c600ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58364/0 (socket says 172.21.15.63:58364) 2024-03-26T06:17:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5fe00640 1 -- 172.21.15.63:0/4247944111 learned_addr learned my addr 172.21.15.63:0/4247944111 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c65200640 1 --2- 172.21.15.63:0/4247944111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 0x7f4c600c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5f400640 1 --2- 172.21.15.63:0/4247944111 >> v2:172.21.15.204:3300/0 conn(0x7f4c6015fe40 0x7f4c600cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5fe00640 1 -- 172.21.15.63:0/4247944111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 msgr2=0x7f4c600c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5fe00640 1 --2- 172.21.15.63:0/4247944111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 0x7f4c600c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5fe00640 1 -- 172.21.15.63:0/4247944111 >> v2:172.21.15.204:3300/0 conn(0x7f4c6015fe40 msgr2=0x7f4c600cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5fe00640 1 --2- 172.21.15.63:0/4247944111 >> v2:172.21.15.204:3300/0 conn(0x7f4c6015fe40 0x7f4c600cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5fe00640 1 -- 172.21.15.63:0/4247944111 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600d0310 con 0x7f4c600cdf10 2024-03-26T06:17:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.751+0000 7f4c5f400640 1 --2- 172.21.15.63:0/4247944111 >> v2:172.21.15.204:3300/0 conn(0x7f4c6015fe40 0x7f4c600cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.753+0000 7f4c5fe00640 1 --2- 172.21.15.63:0/4247944111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 0x7f4c600ce2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c600c8730 tx=0x7f4c5002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da47319186f538f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.753+0000 7f4c5ea00640 1 -- 172.21.15.63:0/4247944111 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50035020 con 0x7f4c600cdf10 2024-03-26T06:17:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.753+0000 7f4c5ea00640 1 -- 172.21.15.63:0/4247944111 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50031870 con 0x7f4c600cdf10 2024-03-26T06:17:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.753+0000 7f4c5ea00640 1 -- 172.21.15.63:0/4247944111 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50031c40 con 0x7f4c600cdf10 2024-03-26T06:17:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.754+0000 7f4c67200640 1 -- 172.21.15.63:0/4247944111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 msgr2=0x7f4c600ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.754+0000 7f4c67200640 1 --2- 172.21.15.63:0/4247944111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 0x7f4c600ce2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c600c8730 tx=0x7f4c5002b910 comp rx=0 tx=0).stop 2024-03-26T06:17:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.754+0000 7f4c67200640 1 -- 172.21.15.63:0/4247944111 shutdown_connections 2024-03-26T06:17:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.754+0000 7f4c67200640 1 --2- 172.21.15.63:0/4247944111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 0x7f4c600c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.754+0000 7f4c67200640 1 --2- 172.21.15.63:0/4247944111 >> v2:172.21.15.204:3300/0 conn(0x7f4c6015fe40 0x7f4c600cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.754+0000 7f4c67200640 1 --2- 172.21.15.63:0/4247944111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 0x7f4c600ce2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.754+0000 7f4c67200640 1 -- 172.21.15.63:0/4247944111 >> 172.21.15.63:0/4247944111 conn(0x7f4c600b3410 msgr2=0x7f4c600b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.754+0000 7f4c67200640 1 -- 172.21.15.63:0/4247944111 shutdown_connections 2024-03-26T06:17:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.754+0000 7f4c67200640 1 -- 172.21.15.63:0/4247944111 wait complete. 2024-03-26T06:17:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.756+0000 7f4c67200640 1 Processor -- start 2024-03-26T06:17:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.756+0000 7f4c67200640 1 -- start start 2024-03-26T06:17:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c67200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 0x7f4c600b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c67200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 0x7f4c601e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c67200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c6015fe40 0x7f4c600ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c67200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c601602c0 con 0x7f4c600cdf10 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c67200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600cdb70 con 0x7f4c6015fe40 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c67200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600b53e0 con 0x7f4c600cf8d0 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 0x7f4c600b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 0x7f4c600b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58366/0 (socket says 172.21.15.63:58366) 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5fe00640 1 -- 172.21.15.63:0/2892639960 learned_addr learned my addr 172.21.15.63:0/2892639960 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5fe00640 1 -- 172.21.15.63:0/2892639960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 msgr2=0x7f4c601e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5f400640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 0x7f4c601e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c65200640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c6015fe40 0x7f4c600ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5fe00640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 0x7f4c601e70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5fe00640 1 -- 172.21.15.63:0/2892639960 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c6015fe40 msgr2=0x7f4c600ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5fe00640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c6015fe40 0x7f4c600ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5fe00640 1 -- 172.21.15.63:0/2892639960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600b56c0 con 0x7f4c600cdf10 2024-03-26T06:17:04.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.757+0000 7f4c5f400640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 0x7f4c601e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:04.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.758+0000 7f4c5fe00640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 0x7f4c600b61a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c5002b950 tx=0x7f4c500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:04.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.758+0000 7f4c57e00640 1 -- 172.21.15.63:0/2892639960 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50040070 con 0x7f4c600cdf10 2024-03-26T06:17:04.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.758+0000 7f4c57e00640 1 -- 172.21.15.63:0/2892639960 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5003a420 con 0x7f4c600cdf10 2024-03-26T06:17:04.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.758+0000 7f4c57e00640 1 -- 172.21.15.63:0/2892639960 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50035040 con 0x7f4c600cdf10 2024-03-26T06:17:04.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.758+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c600b59a0 con 0x7f4c600cdf10 2024-03-26T06:17:04.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.758+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c601e7b90 con 0x7f4c600cdf10 2024-03-26T06:17:04.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.760+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c60074730 con 0x7f4c600cdf10 2024-03-26T06:17:04.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.760+0000 7f4c57e00640 1 -- 172.21.15.63:0/2892639960 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4c5004b060 con 0x7f4c600cdf10 2024-03-26T06:17:04.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.761+0000 7f4c57e00640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4c3c06bbd0 0x7f4c3c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:04.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.761+0000 7f4c57e00640 1 -- 172.21.15.63:0/2892639960 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4c500acc10 con 0x7f4c600cdf10 2024-03-26T06:17:04.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.762+0000 7f4c5f400640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4c3c06bbd0 0x7f4c3c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:04.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.762+0000 7f4c5f400640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4c3c06bbd0 0x7f4c3c06e090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c6006d3a0 tx=0x7f4c48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:04.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.766+0000 7f4c57e00640 1 -- 172.21.15.63:0/2892639960 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f4c5007b450 con 0x7f4c600cdf10 2024-03-26T06:17:04.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.969+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c600b4210 con 0x7f4c600cdf10 2024-03-26T06:17:04.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.972+0000 7f4c57e00640 1 -- 172.21.15.63:0/2892639960 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f4c5007ad50 con 0x7f4c600cdf10 2024-03-26T06:17:04.972 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:04.972 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:04.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.974+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4c3c06bbd0 msgr2=0x7f4c3c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.974+0000 7f4c67200640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4c3c06bbd0 0x7f4c3c06e090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c6006d3a0 tx=0x7f4c48008040 comp rx=0 tx=0).stop 2024-03-26T06:17:04.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.974+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 msgr2=0x7f4c600b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:04.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.974+0000 7f4c67200640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 0x7f4c600b61a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c5002b950 tx=0x7f4c500046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.975+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 shutdown_connections 2024-03-26T06:17:04.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.975+0000 7f4c67200640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4c3c06bbd0 0x7f4c3c06e090 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.975+0000 7f4c67200640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c6015fe40 0x7f4c600ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.975+0000 7f4c67200640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c600cf8d0 0x7f4c601e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.975+0000 7f4c67200640 1 --2- 172.21.15.63:0/2892639960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c600cdf10 0x7f4c600b61a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:04.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.975+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 >> 172.21.15.63:0/2892639960 conn(0x7f4c600b3410 msgr2=0x7f4c600c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:04.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.975+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 shutdown_connections 2024-03-26T06:17:04.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:04.975+0000 7f4c67200640 1 -- 172.21.15.63:0/2892639960 wait complete. 2024-03-26T06:17:05.008 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:17:05.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.231+0000 7fc316200640 1 Processor -- start 2024-03-26T06:17:05.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.231+0000 7fc316200640 1 -- start start 2024-03-26T06:17:05.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.233+0000 7fc316200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc3100b4c50 0x7fc3100ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.233+0000 7fc316200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 0x7fc31015f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.233+0000 7fc316200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc31015f880 0x7fc310144b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.233+0000 7fc316200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3100cc070 con 0x7fc31015f880 2024-03-26T06:17:05.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.233+0000 7fc316200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31015fde0 con 0x7fc3100b4c50 2024-03-26T06:17:05.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.233+0000 7fc316200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3101600c0 con 0x7fc3100b5030 2024-03-26T06:17:05.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.233+0000 7fc315800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc31015f880 0x7fc310144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.233+0000 7fc315800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc31015f880 0x7fc310144b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58382/0 (socket says 172.21.15.63:58382) 2024-03-26T06:17:05.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.233+0000 7fc315800640 1 -- 172.21.15.63:0/3061369277 learned_addr learned my addr 172.21.15.63:0/3061369277 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:05.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.234+0000 7fc30fe00640 1 --2- 172.21.15.63:0/3061369277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 0x7fc31015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.234+0000 7fc314e00640 1 --2- 172.21.15.63:0/3061369277 >> v2:172.21.15.204:3300/0 conn(0x7fc3100b4c50 0x7fc3100ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.234+0000 7fc315800640 1 -- 172.21.15.63:0/3061369277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 msgr2=0x7fc31015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:05.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.234+0000 7fc315800640 1 --2- 172.21.15.63:0/3061369277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 0x7fc31015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.234+0000 7fc315800640 1 -- 172.21.15.63:0/3061369277 >> v2:172.21.15.204:3300/0 conn(0x7fc3100b4c50 msgr2=0x7fc3100ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:05.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.234+0000 7fc315800640 1 --2- 172.21.15.63:0/3061369277 >> v2:172.21.15.204:3300/0 conn(0x7fc3100b4c50 0x7fc3100ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.234+0000 7fc315800640 1 -- 172.21.15.63:0/3061369277 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100cc310 con 0x7fc31015f880 2024-03-26T06:17:05.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.235+0000 7fc315800640 1 --2- 172.21.15.63:0/3061369277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc31015f880 0x7fc310144b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc3100cd4f0 tx=0x7fc30802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de42ab115cd2dc08 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:05.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.235+0000 7fc30f400640 1 -- 172.21.15.63:0/3061369277 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30802cb00 con 0x7fc31015f880 2024-03-26T06:17:05.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.235+0000 7fc30f400640 1 -- 172.21.15.63:0/3061369277 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30802cca0 con 0x7fc31015f880 2024-03-26T06:17:05.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.235+0000 7fc30f400640 1 -- 172.21.15.63:0/3061369277 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308034610 con 0x7fc31015f880 2024-03-26T06:17:05.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.236+0000 7fc316200640 1 -- 172.21.15.63:0/3061369277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc31015f880 msgr2=0x7fc310144b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.236+0000 7fc316200640 1 --2- 172.21.15.63:0/3061369277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc31015f880 0x7fc310144b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc3100cd4f0 tx=0x7fc30802bf60 comp rx=0 tx=0).stop 2024-03-26T06:17:05.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.236+0000 7fc316200640 1 -- 172.21.15.63:0/3061369277 shutdown_connections 2024-03-26T06:17:05.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.236+0000 7fc316200640 1 --2- 172.21.15.63:0/3061369277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc31015f880 0x7fc310144b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.236+0000 7fc316200640 1 --2- 172.21.15.63:0/3061369277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 0x7fc31015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.236+0000 7fc316200640 1 --2- 172.21.15.63:0/3061369277 >> v2:172.21.15.204:3300/0 conn(0x7fc3100b4c50 0x7fc3100ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.236+0000 7fc316200640 1 -- 172.21.15.63:0/3061369277 >> 172.21.15.63:0/3061369277 conn(0x7fc3100b13d0 msgr2=0x7fc3100b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:05.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.236+0000 7fc316200640 1 -- 172.21.15.63:0/3061369277 shutdown_connections 2024-03-26T06:17:05.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.236+0000 7fc316200640 1 -- 172.21.15.63:0/3061369277 wait complete. 2024-03-26T06:17:05.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.239+0000 7fc316200640 1 Processor -- start 2024-03-26T06:17:05.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.239+0000 7fc316200640 1 -- start start 2024-03-26T06:17:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.240+0000 7fc316200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3100b4c50 0x7fc31015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.240+0000 7fc316200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 0x7fc31015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.240+0000 7fc316200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc31015f880 0x7fc31013b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.240+0000 7fc316200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310145090 con 0x7fc3100b4c50 2024-03-26T06:17:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.240+0000 7fc316200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31006eb70 con 0x7fc31015f880 2024-03-26T06:17:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.240+0000 7fc316200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc310145210 con 0x7fc3100b5030 2024-03-26T06:17:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.240+0000 7fc314e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3100b4c50 0x7fc31015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.240+0000 7fc314e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3100b4c50 0x7fc31015cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58392/0 (socket says 172.21.15.63:58392) 2024-03-26T06:17:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.240+0000 7fc314e00640 1 -- 172.21.15.63:0/1848378576 learned_addr learned my addr 172.21.15.63:0/1848378576 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.241+0000 7fc30fe00640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 0x7fc31015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.241+0000 7fc315800640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc31015f880 0x7fc31013b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.241+0000 7fc314e00640 1 -- 172.21.15.63:0/1848378576 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 msgr2=0x7fc31015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.241+0000 7fc314e00640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 0x7fc31015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.241+0000 7fc314e00640 1 -- 172.21.15.63:0/1848378576 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc31015f880 msgr2=0x7fc31013b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.241+0000 7fc314e00640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc31015f880 0x7fc31013b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.241+0000 7fc314e00640 1 -- 172.21.15.63:0/1848378576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31015bf10 con 0x7fc3100b4c50 2024-03-26T06:17:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.241+0000 7fc314e00640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3100b4c50 0x7fc31015cc90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc30400d800 tx=0x7fc30400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.242+0000 7fc30cc00640 1 -- 172.21.15.63:0/1848378576 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304018020 con 0x7fc3100b4c50 2024-03-26T06:17:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.242+0000 7fc30cc00640 1 -- 172.21.15.63:0/1848378576 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3040096a0 con 0x7fc3100b4c50 2024-03-26T06:17:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.242+0000 7fc30cc00640 1 -- 172.21.15.63:0/1848378576 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304009a70 con 0x7fc3100b4c50 2024-03-26T06:17:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.242+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31015c1b0 con 0x7fc3100b4c50 2024-03-26T06:17:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.242+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31015c770 con 0x7fc3100b4c50 2024-03-26T06:17:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.243+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31004f050 con 0x7fc3100b4c50 2024-03-26T06:17:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.244+0000 7fc30cc00640 1 -- 172.21.15.63:0/1848378576 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc30401b020 con 0x7fc3100b4c50 2024-03-26T06:17:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.245+0000 7fc30cc00640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2f006bbd0 0x7fc2f006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.245+0000 7fc30cc00640 1 -- 172.21.15.63:0/1848378576 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc30408afa0 con 0x7fc3100b4c50 2024-03-26T06:17:05.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.245+0000 7fc30fe00640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2f006bbd0 0x7fc2f006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.246+0000 7fc30fe00640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2f006bbd0 0x7fc2f006e090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc31013de80 tx=0x7fc2fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:05.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.249+0000 7fc30cc00640 1 -- 172.21.15.63:0/1848378576 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc304022030 con 0x7fc3100b4c50 2024-03-26T06:17:05.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.481+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc31006e400 con 0x7fc3100b4c50 2024-03-26T06:17:05.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.482+0000 7fc30cc00640 1 -- 172.21.15.63:0/1848378576 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4937 (secure 0 0 0) 0x7fc304059750 con 0x7fc3100b4c50 2024-03-26T06:17:05.483 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:05.483 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:03.050105+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-26T06:17:05.483 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2024-03-26T06:17:05.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2f006bbd0 msgr2=0x7fc2f006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2f006bbd0 0x7fc2f006e090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc31013de80 tx=0x7fc2fc008040 comp rx=0 tx=0).stop 2024-03-26T06:17:05.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3100b4c50 msgr2=0x7fc31015cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3100b4c50 0x7fc31015cc90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc30400d800 tx=0x7fc30400dcc0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 shutdown_connections 2024-03-26T06:17:05.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2f006bbd0 0x7fc2f006e090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc31015f880 0x7fc31013b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3100b5030 0x7fc31015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 --2- 172.21.15.63:0/1848378576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3100b4c50 0x7fc31015cc90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 >> 172.21.15.63:0/1848378576 conn(0x7fc3100b13d0 msgr2=0x7fc3100b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:05.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 shutdown_connections 2024-03-26T06:17:05.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.485+0000 7fc316200640 1 -- 172.21.15.63:0/1848378576 wait complete. 2024-03-26T06:17:05.505 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:05.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.714+0000 7f2065600640 1 Processor -- start 2024-03-26T06:17:05.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.715+0000 7f2065600640 1 -- start start 2024-03-26T06:17:05.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.716+0000 7f2065600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2060071350 0x7f20600717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.716+0000 7f2065600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20600cc3f0 0x7f20600cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.716+0000 7f2065600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206015bf80 con 0x7f2060145100 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.716+0000 7f2065600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20600a86e0 con 0x7f2060071350 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.716+0000 7f2065600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206006e2f0 con 0x7f20600cc3f0 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f2057e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2060071350 0x7f20600717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f205ea00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2060145100 0x7f206006ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51552/0 (socket says 172.21.15.63:51552) 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f205ea00640 1 -- 172.21.15.63:0/3586752026 learned_addr learned my addr 172.21.15.63:0/3586752026 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f205f400640 1 --2- 172.21.15.63:0/3586752026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20600cc3f0 0x7f20600cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f205e000640 1 -- 172.21.15.63:0/3586752026 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010282350 0 0) 0x7f206015bf80 con 0x7f2060145100 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f205e000640 1 -- 172.21.15.63:0/3586752026 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2044003520 con 0x7f2060145100 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f2057e00640 1 -- 172.21.15.63:0/3586752026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20600cc3f0 msgr2=0x7f20600cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f2057e00640 1 --2- 172.21.15.63:0/3586752026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20600cc3f0 0x7f20600cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f2057e00640 1 -- 172.21.15.63:0/3586752026 >> v1:172.21.15.63:6789/0 conn(0x7f2060145100 legacy=0x7f206006ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f2057e00640 1 -- 172.21.15.63:0/3586752026 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206006d770 con 0x7f2060071350 2024-03-26T06:17:05.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.717+0000 7f205f400640 1 --2- 172.21.15.63:0/3586752026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20600cc3f0 0x7f20600cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:05.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.719+0000 7f2057e00640 1 --2- 172.21.15.63:0/3586752026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 0x7f20600717e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f20480097a0 tx=0x7f204802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb9a72fec38a88a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:05.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.719+0000 7f205e000640 1 -- 172.21.15.63:0/3586752026 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048035020 con 0x7f2060071350 2024-03-26T06:17:05.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.719+0000 7f205e000640 1 -- 172.21.15.63:0/3586752026 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048031810 con 0x7f2060071350 2024-03-26T06:17:05.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.719+0000 7f205e000640 1 -- 172.21.15.63:0/3586752026 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048031be0 con 0x7f2060071350 2024-03-26T06:17:05.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.720+0000 7f2065600640 1 -- 172.21.15.63:0/3586752026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 msgr2=0x7f20600717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.720+0000 7f2065600640 1 --2- 172.21.15.63:0/3586752026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 0x7f20600717e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f20480097a0 tx=0x7f204802b8b0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.720+0000 7f2065600640 1 -- 172.21.15.63:0/3586752026 shutdown_connections 2024-03-26T06:17:05.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.720+0000 7f2065600640 1 --2- 172.21.15.63:0/3586752026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 0x7f20600717e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.720+0000 7f2065600640 1 --2- 172.21.15.63:0/3586752026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20600cc3f0 0x7f20600cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.720+0000 7f2065600640 1 -- 172.21.15.63:0/3586752026 >> 172.21.15.63:0/3586752026 conn(0x7f206006ac90 msgr2=0x7f206006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:05.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.720+0000 7f2065600640 1 -- 172.21.15.63:0/3586752026 shutdown_connections 2024-03-26T06:17:05.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.720+0000 7f2065600640 1 -- 172.21.15.63:0/3586752026 wait complete. 2024-03-26T06:17:05.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.722+0000 7f2065600640 1 Processor -- start 2024-03-26T06:17:05.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.722+0000 7f2065600640 1 -- start start 2024-03-26T06:17:05.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f2065600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 0x7f206013cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f2065600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20600cc3f0 0x7f20600ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f2065600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2060145100 0x7f20600adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f2065600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206006e010 con 0x7f2060071350 2024-03-26T06:17:05.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f2065600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206006dd30 con 0x7f20600cc3f0 2024-03-26T06:17:05.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f2065600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20601454e0 con 0x7f2060145100 2024-03-26T06:17:05.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f205ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 0x7f206013cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f205ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 0x7f206013cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58404/0 (socket says 172.21.15.63:58404) 2024-03-26T06:17:05.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f205ea00640 1 -- 172.21.15.63:0/3103436623 learned_addr learned my addr 172.21.15.63:0/3103436623 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f205ea00640 1 -- 172.21.15.63:0/3103436623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2060145100 msgr2=0x7f20600adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f205ea00640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2060145100 0x7f20600adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f205ea00640 1 -- 172.21.15.63:0/3103436623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20600cc3f0 msgr2=0x7f20600ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f205ea00640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20600cc3f0 0x7f20600ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.723+0000 7f205ea00640 1 -- 172.21.15.63:0/3103436623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600ae630 con 0x7f2060071350 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.724+0000 7f205ea00640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 0x7f206013cc40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20500010e0 tx=0x7f205000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.724+0000 7f2056a00640 1 -- 172.21.15.63:0/3103436623 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050017070 con 0x7f2060071350 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.724+0000 7f2056a00640 1 -- 172.21.15.63:0/3103436623 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2050005ce0 con 0x7f2060071350 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.724+0000 7f2056a00640 1 -- 172.21.15.63:0/3103436623 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050007290 con 0x7f2060071350 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.724+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20600b4430 con 0x7f2060071350 2024-03-26T06:17:05.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.724+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20600ace90 con 0x7f2060071350 2024-03-26T06:17:05.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.725+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20600acc80 con 0x7f2060071350 2024-03-26T06:17:05.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.726+0000 7f2056a00640 1 -- 172.21.15.63:0/3103436623 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f205001a070 con 0x7f2060071350 2024-03-26T06:17:05.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.727+0000 7f2056a00640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f203c06bbd0 0x7f203c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:05.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.727+0000 7f2056a00640 1 -- 172.21.15.63:0/3103436623 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f205008a1c0 con 0x7f2060071350 2024-03-26T06:17:05.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.728+0000 7f2057e00640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f203c06bbd0 0x7f203c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:05.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.728+0000 7f2057e00640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f203c06bbd0 0x7f203c06e090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2048036000 tx=0x7f2048030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:05.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.732+0000 7f2056a00640 1 -- 172.21.15.63:0/3103436623 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2050058960 con 0x7f2060071350 2024-03-26T06:17:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.937+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2060074730 con 0x7f2060071350 2024-03-26T06:17:05.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.939+0000 7f2056a00640 1 -- 172.21.15.63:0/3103436623 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f2050058260 con 0x7f2060071350 2024-03-26T06:17:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:05.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f203c06bbd0 msgr2=0x7f203c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f203c06bbd0 0x7f203c06e090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2048036000 tx=0x7f2048030000 comp rx=0 tx=0).stop 2024-03-26T06:17:05.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 msgr2=0x7f206013cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:05.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 0x7f206013cc40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20500010e0 tx=0x7f205000c960 comp rx=0 tx=0).stop 2024-03-26T06:17:05.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 shutdown_connections 2024-03-26T06:17:05.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f203c06bbd0 0x7f203c06e090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2060145100 0x7f20600adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20600cc3f0 0x7f20600ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 --2- 172.21.15.63:0/3103436623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2060071350 0x7f206013cc40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:05.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 >> 172.21.15.63:0/3103436623 conn(0x7f206006ac90 msgr2=0x7f2060142fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:05.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 shutdown_connections 2024-03-26T06:17:05.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:05.942+0000 7f2065600640 1 -- 172.21.15.63:0/3103436623 wait complete. 2024-03-26T06:17:06.364 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-26T06:16:57.955344+0000', 'modified': '2024-03-26T06:17:03.050105+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6835/135702470', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6834', 'nonce': 135702470}, {'type': 'v1', 'addr': '172.21.15.204:6835', 'nonce': 135702470}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-03-26T06:17:06.364 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-26T06:17:06.364 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-26T06:17:06.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.599+0000 7f0535000640 1 Processor -- start 2024-03-26T06:17:06.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.600+0000 7f0535000640 1 -- start start 2024-03-26T06:17:06.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.601+0000 7f0535000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05300cc8a0 0x7f05300cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.601+0000 7f0535000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f05300cad10 0x7f05300cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.601+0000 7f0535000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05300ce440 con 0x7f05300cc060 2024-03-26T06:17:06.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.601+0000 7f0535000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05300cd740 con 0x7f05300cad10 2024-03-26T06:17:06.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.601+0000 7f0535000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05300cda20 con 0x7f05300cc8a0 2024-03-26T06:17:06.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.601+0000 7f052de00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f05300cc060 0x7f053006b350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51560/0 (socket says 172.21.15.63:51560) 2024-03-26T06:17:06.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.601+0000 7f052de00640 1 -- 172.21.15.63:0/4289078979 learned_addr learned my addr 172.21.15.63:0/4289078979 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:06.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052e800640 1 --2- 172.21.15.63:0/4289078979 >> v2:172.21.15.204:3300/0 conn(0x7f05300cad10 0x7f05300cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052d400640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05300cc8a0 0x7f05300cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284878075 0 0) 0x7f05300ce440 con 0x7f05300cc060 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0514003520 con 0x7f05300cc060 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 290170665 0 0) 0x7f0514003520 con 0x7f05300cc060 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05300cc8a0 msgr2=0x7f05300cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05300cc8a0 0x7f05300cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 >> v2:172.21.15.204:3300/0 conn(0x7f05300cad10 msgr2=0x7f05300cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 --2- 172.21.15.63:0/4289078979 >> v2:172.21.15.204:3300/0 conn(0x7f05300cad10 0x7f05300cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05300cdd00 con 0x7f05300cc060 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f0518001670 con 0x7f05300cc060 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 >> v1:172.21.15.63:6789/0 conn(0x7f05300cc060 legacy=0x7f053006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05140039b0 0x7f0514003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0514004800 0x7f0514004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05300cc8a0 0x7f05140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05300cd740 con 0x7f05140039b0 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.602+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05300cda20 con 0x7f0514004800 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.603+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051400b9c0 con 0x7f05300cc8a0 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.603+0000 7f052de00640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05140039b0 0x7f0514003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.603+0000 7f052e800640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05300cc8a0 0x7f05140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.603+0000 7f052d400640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0514004800 0x7f0514004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.603+0000 7f052de00640 1 -- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05300cc8a0 msgr2=0x7f05140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.603+0000 7f052de00640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05300cc8a0 0x7f05140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.603+0000 7f052de00640 1 -- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0514004800 msgr2=0x7f0514004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.603+0000 7f052de00640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0514004800 0x7f0514004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.603+0000 7f052de00640 1 -- 172.21.15.63:0/4289078979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514003520 con 0x7f05140039b0 2024-03-26T06:17:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.604+0000 7f052de00640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05140039b0 0x7f0514003dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f051800c190 tx=0x7f0514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476d9af4bbfb380a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.604+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518007c80 con 0x7f05140039b0 2024-03-26T06:17:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.605+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518030070 con 0x7f05140039b0 2024-03-26T06:17:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.605+0000 7f052ca00640 1 -- 172.21.15.63:0/4289078979 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518005d30 con 0x7f05140039b0 2024-03-26T06:17:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.605+0000 7f0535000640 1 -- 172.21.15.63:0/4289078979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05140039b0 msgr2=0x7f0514003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.605+0000 7f0535000640 1 --2- 172.21.15.63:0/4289078979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05140039b0 0x7f0514003dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f051800c190 tx=0x7f0514005830 comp rx=0 tx=0).stop 2024-03-26T06:17:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.605+0000 7f052e800640 1 -- 172.21.15.63:0/4289078979 reap_dead start 2024-03-26T06:17:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.605+0000 7f0535000640 1 -- 172.21.15.63:0/4289078979 shutdown_connections 2024-03-26T06:17:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.605+0000 7f0535000640 1 -- 172.21.15.63:0/4289078979 >> 172.21.15.63:0/4289078979 conn(0x7f05300b2250 msgr2=0x7f05300b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:06.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.605+0000 7f0535000640 1 -- 172.21.15.63:0/4289078979 shutdown_connections 2024-03-26T06:17:06.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.605+0000 7f0535000640 1 -- 172.21.15.63:0/4289078979 wait complete. 2024-03-26T06:17:06.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.607+0000 7f0535000640 1 Processor -- start 2024-03-26T06:17:06.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.607+0000 7f0535000640 1 -- start start 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.608+0000 7f0535000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05140039b0 0x7f053009d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.608+0000 7f0535000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0530159c60 0x7f053009a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.608+0000 7f0535000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05300b54a0 0x7f05300b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.608+0000 7f0535000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053006ba60 con 0x7f05300b54a0 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.608+0000 7f0535000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05300cc440 con 0x7f05140039b0 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.608+0000 7f0535000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05300cd040 con 0x7f0530159c60 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.608+0000 7f052e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05300b54a0 0x7f05300b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.608+0000 7f052e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05300b54a0 0x7f05300b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58422/0 (socket says 172.21.15.63:58422) 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.608+0000 7f052e800640 1 -- 172.21.15.63:0/1198299957 learned_addr learned my addr 172.21.15.63:0/1198299957 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.609+0000 7f052d400640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0530159c60 0x7f053009a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.609+0000 7f052de00640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05140039b0 0x7f053009d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.609+0000 7f052e800640 1 -- 172.21.15.63:0/1198299957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0530159c60 msgr2=0x7f053009a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.609+0000 7f052e800640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0530159c60 0x7f053009a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.609+0000 7f052e800640 1 -- 172.21.15.63:0/1198299957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05140039b0 msgr2=0x7f053009d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.609+0000 7f052e800640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05140039b0 0x7f053009d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.609+0000 7f052e800640 1 -- 172.21.15.63:0/1198299957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053009d920 con 0x7f05300b54a0 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.609+0000 7f052e800640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05300b54a0 0x7f05300b5900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0530070df0 tx=0x7f0528009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.609+0000 7f0526000640 1 -- 172.21.15.63:0/1198299957 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528019020 con 0x7f05300b54a0 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.610+0000 7f0526000640 1 -- 172.21.15.63:0/1198299957 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528004440 con 0x7f05300b54a0 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.610+0000 7f0526000640 1 -- 172.21.15.63:0/1198299957 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528003850 con 0x7f05300b54a0 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.610+0000 7f0535000640 1 -- 172.21.15.63:0/1198299957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053009dc00 con 0x7f05300b54a0 2024-03-26T06:17:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.610+0000 7f0535000640 1 -- 172.21.15.63:0/1198299957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053009e1c0 con 0x7f05300b54a0 2024-03-26T06:17:06.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.612+0000 7f0526000640 1 -- 172.21.15.63:0/1198299957 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f052801c020 con 0x7f05300b54a0 2024-03-26T06:17:06.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.613+0000 7f0526000640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f050c06bc20 0x7f050c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.613+0000 7f0526000640 1 -- 172.21.15.63:0/1198299957 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f052808b3d0 con 0x7f05300b54a0 2024-03-26T06:17:06.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.613+0000 7f052de00640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f050c06bc20 0x7f050c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.614+0000 7f0537d89740 1 Processor -- start 2024-03-26T06:17:06.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.614+0000 7f0537d89740 1 -- start start 2024-03-26T06:17:06.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.614+0000 7f052de00640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f050c06bc20 0x7f050c06e0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0518034000 tx=0x7f0518007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f0537d89740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e3d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f0537d89740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e6d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f0537d89740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e3db20 0x555ec0e6d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f0537d89740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec0da76f0 con 0x555ec0e6a640 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f0537d89740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec0d509e0 con 0x555ec0e3db20 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f0537d89740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ec0da3790 con 0x555ec0e6aa20 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e3d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e3d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58430/0 (socket says 172.21.15.63:58430) 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052de00640 1 -- 172.21.15.63:0/3555074503 learned_addr learned my addr 172.21.15.63:0/3555074503 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052d400640 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e6d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052e800640 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e3db20 0x555ec0e6d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052de00640 1 -- 172.21.15.63:0/3555074503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 msgr2=0x555ec0e6d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052de00640 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e6d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052de00640 1 -- 172.21.15.63:0/3555074503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e3db20 msgr2=0x555ec0e6d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052de00640 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e3db20 0x555ec0e6d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052de00640 1 -- 172.21.15.63:0/3555074503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ec0d44720 con 0x555ec0e6a640 2024-03-26T06:17:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.615+0000 7f052d400640 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e6d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.616+0000 7f052de00640 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e3d5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f051802c510 tx=0x7f051802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb01c6ad173155bb server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.616+0000 7f051ea00640 1 -- 172.21.15.63:0/3555074503 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051802cd90 con 0x555ec0e6a640 2024-03-26T06:17:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.616+0000 7f051ea00640 1 -- 172.21.15.63:0/3555074503 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518030040 con 0x555ec0e6a640 2024-03-26T06:17:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.616+0000 7f051ea00640 1 -- 172.21.15.63:0/3555074503 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518005e40 con 0x555ec0e6a640 2024-03-26T06:17:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.616+0000 7f0537d89740 1 -- 172.21.15.63:0/3555074503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 msgr2=0x555ec0e3d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.616+0000 7f0537d89740 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e3d5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f051802c510 tx=0x7f051802e000 comp rx=0 tx=0).stop 2024-03-26T06:17:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.617+0000 7f0537d89740 1 -- 172.21.15.63:0/3555074503 shutdown_connections 2024-03-26T06:17:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.617+0000 7f0537d89740 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e3db20 0x555ec0e6d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.617+0000 7f0537d89740 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e6d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.617+0000 7f0537d89740 1 --2- 172.21.15.63:0/3555074503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e3d5e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.617+0000 7f0537d89740 1 -- 172.21.15.63:0/3555074503 >> 172.21.15.63:0/3555074503 conn(0x555ec0e3f850 msgr2=0x555ec0e883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.617+0000 7f0537d89740 1 -- 172.21.15.63:0/3555074503 shutdown_connections 2024-03-26T06:17:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.617+0000 7f0537d89740 1 -- 172.21.15.63:0/3555074503 wait complete. 2024-03-26T06:17:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.618+0000 7f0537d89740 1 -- start start 2024-03-26T06:17:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.618+0000 7f0537d89740 1 Processor -- start 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f0537d89740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e70d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f0537d89740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e67b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f0537d89740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e73fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f0537d89740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec0e41df0 con 0x555ec0e68230 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f0537d89740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec0d63e20 con 0x555ec0e6a640 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f0537d89740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ec0e411e0 con 0x555ec0e6aa20 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f0537d89740 10 client.0 _ll_register_callbacks cb 0x555ec0d9e8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f052e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e73fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f052e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e73fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58442/0 (socket says 172.21.15.63:58442) 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f052e800640 1 -- 172.21.15.63:0/2099004988 learned_addr learned my addr 172.21.15.63:0/2099004988 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.619+0000 7f052d400640 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e67b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f052de00640 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e70d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f052e800640 1 -- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 msgr2=0x555ec0e67b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f052e800640 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e67b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f052e800640 1 -- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 msgr2=0x555ec0e70d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f052e800640 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e70d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f052e800640 1 -- 172.21.15.63:0/2099004988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ec0abc2d0 con 0x555ec0e68230 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f052de00640 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e70d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f052e800640 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e73fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05280895d0 tx=0x7f0528059d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db0acb11d7236ec server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f0513400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f0513400640 1 -- 172.21.15.63:0/2099004988 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528061c00 con 0x555ec0e68230 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f0513400640 1 -- 172.21.15.63:0/2099004988 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f052808b030 con 0x555ec0e68230 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f0537d89740 1 -- 172.21.15.63:0/2099004988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0518030040 con 0x555ec0e68230 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f0513400640 1 -- 172.21.15.63:0/2099004988 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0528089050 con 0x555ec0e68230 2024-03-26T06:17:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f0537d89740 10 client.4413 fetch_fsmap learned FSMap version 7 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.620+0000 7f0537d89740 1 -- 172.21.15.63:0/2099004988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555ec0b866b0 con 0x555ec0e68230 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.621+0000 7f0513400640 1 -- 172.21.15.63:0/2099004988 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518030040 con 0x555ec0e68230 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.621+0000 7f0513400640 1 -- 172.21.15.63:0/2099004988 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f0528071170 con 0x555ec0e68230 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.621+0000 7f0537d89740 10 client.4413 fetch_fsmap finished waiting for FSMap version 7 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.621+0000 7f0537d89740 10 client.4413 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.621+0000 7f0537d89740 20 client.4413 populate_metadata read hostname 'smithi063' 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.621+0000 7f0537d89740 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x555ec0e9b990 0x555ec0e9bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.621+0000 7f0537d89740 4 client.4413 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.621+0000 7f0537d89740 1 -- 172.21.15.63:0/2099004988 --> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ec0db4c30 con 0x555ec0e9b990 2024-03-26T06:17:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.622+0000 7f052de00640 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x555ec0e9b990 0x555ec0e9bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.622+0000 7f052de00640 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x555ec0e9b990 0x555ec0e9bd70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68a3a891fe9323c8 server_cookie=a2b8b7958f5945d1 in_seq=0 out_seq=0 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.622+0000 7f0513400640 10 client.4413 ms_handle_connect on v2:172.21.15.204:6834/135702470 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.624+0000 7f0513400640 1 -- 172.21.15.63:0/2099004988 <== mds.0 v2:172.21.15.204:6834/135702470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555ec0db4c30 con 0x555ec0e9b990 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.624+0000 7f0513400640 10 client.4413 handle_command_reply: tid=0 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 client.4413 shutdown 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 -- 172.21.15.63:0/2099004988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 msgr2=0x555ec0e73fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e73fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05280895d0 tx=0x7f0528059d30 comp rx=0 tx=0).stop 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 -- 172.21.15.63:0/2099004988 shutdown_connections 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x555ec0e9b990 0x555ec0e9bd70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e73fa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e67b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 --2- 172.21.15.63:0/2099004988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e70d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0513400640 0 client.4413 ms_handle_reset on v2:172.21.15.204:6834/135702470 2024-03-26T06:17:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 -- 172.21.15.63:0/2099004988 >> 172.21.15.63:0/2099004988 conn(0x555ec0e3db20 msgr2=0x555ec0e6d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 -- 172.21.15.63:0/2099004988 shutdown_connections 2024-03-26T06:17:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 1 -- 172.21.15.63:0/2099004988 wait complete. 2024-03-26T06:17:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.625+0000 7f0537d89740 20 client.4413 trim_cache size 0 max 16384 2024-03-26T06:17:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.642+0000 7f0537d89740 1 Processor -- start 2024-03-26T06:17:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.643+0000 7f0537d89740 1 -- start start 2024-03-26T06:17:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.643+0000 7f0537d89740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.643+0000 7f0537d89740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e6d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.643+0000 7f0537d89740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e64700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.643+0000 7f0537d89740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0530200ba0 con 0x555ec0e68230 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.643+0000 7f0537d89740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05300ca1c0 con 0x555ec0e6a640 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.643+0000 7f0537d89740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05302005a0 con 0x555ec0e6aa20 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e388b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58458/0 (socket says 172.21.15.63:58458) 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052de00640 1 -- 172.21.15.63:0/2104331868 learned_addr learned my addr 172.21.15.63:0/2104331868 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052e800640 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e64700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052d400640 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e6d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052de00640 1 -- 172.21.15.63:0/2104331868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 msgr2=0x555ec0e64700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052de00640 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e64700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052de00640 1 -- 172.21.15.63:0/2104331868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 msgr2=0x555ec0e6d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052de00640 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e6d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052de00640 1 -- 172.21.15.63:0/2104331868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ec0d46570 con 0x555ec0e68230 2024-03-26T06:17:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052d400640 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e6d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.644+0000 7f052de00640 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e388b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f051800c280 tx=0x7f051803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ce9067a19c6517 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f051e000640 1 -- 172.21.15.63:0/2104331868 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518001430 con 0x555ec0e68230 2024-03-26T06:17:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f051e000640 1 -- 172.21.15.63:0/2104331868 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518030070 con 0x555ec0e68230 2024-03-26T06:17:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f051e000640 1 -- 172.21.15.63:0/2104331868 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518055d00 con 0x555ec0e68230 2024-03-26T06:17:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f0537d89740 1 -- 172.21.15.63:0/2104331868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 msgr2=0x555ec0e388b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f0537d89740 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e388b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f051800c280 tx=0x7f051803f000 comp rx=0 tx=0).stop 2024-03-26T06:17:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f0537d89740 1 -- 172.21.15.63:0/2104331868 shutdown_connections 2024-03-26T06:17:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f0537d89740 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e64700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f0537d89740 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e6a640 0x555ec0e6d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f0537d89740 1 --2- 172.21.15.63:0/2104331868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e68230 0x555ec0e388b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f0537d89740 1 -- 172.21.15.63:0/2104331868 >> 172.21.15.63:0/2104331868 conn(0x555ec0e3db20 msgr2=0x555ec0e70ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f0537d89740 1 -- 172.21.15.63:0/2104331868 shutdown_connections 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.645+0000 7f0537d89740 1 -- 172.21.15.63:0/2104331868 wait complete. 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.646+0000 7f0537d89740 1 -- start start 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.646+0000 7f0537d89740 1 Processor -- start 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f0537d89740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e68230 0x555ec0ef5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f0537d89740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e6e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f0537d89740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e6e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f0537d89740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec0e72c70 con 0x555ec0e6a640 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f0537d89740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec0e6f300 con 0x555ec0e68230 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f0537d89740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ec0e72410 con 0x555ec0e6aa20 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f0537d89740 10 client.0 _ll_register_callbacks cb 0x7f05140036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f052d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e6e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f052d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e6e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58468/0 (socket says 172.21.15.63:58468) 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.647+0000 7f052d400640 1 -- 172.21.15.63:0/1318996253 learned_addr learned my addr 172.21.15.63:0/1318996253 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f052e800640 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e6e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f052de00640 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e68230 0x555ec0ef5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f052d400640 1 -- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 msgr2=0x555ec0e6e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f052d400640 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e6e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f052d400640 1 -- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e68230 msgr2=0x555ec0ef5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f052d400640 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e68230 0x555ec0ef5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f052d400640 1 -- 172.21.15.63:0/1318996253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ec0e68f60 con 0x555ec0e6a640 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f052d400640 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e6e290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0520004070 tx=0x7f0520004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc74baf0d5770e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f0513400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.648+0000 7f0513400640 1 -- 172.21.15.63:0/1318996253 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052001e070 con 0x555ec0e6a640 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0513400640 1 -- 172.21.15.63:0/1318996253 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0520016840 con 0x555ec0e6a640 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0537d89740 1 -- 172.21.15.63:0/1318996253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0518030070 con 0x555ec0e6a640 2024-03-26T06:17:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0513400640 1 -- 172.21.15.63:0/1318996253 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0520029050 con 0x555ec0e6a640 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0537d89740 10 client.4419 fetch_fsmap learned FSMap version 7 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0537d89740 1 -- 172.21.15.63:0/1318996253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555ec0e69520 con 0x555ec0e6a640 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0513400640 1 -- 172.21.15.63:0/1318996253 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518030070 con 0x555ec0e6a640 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0513400640 1 -- 172.21.15.63:0/1318996253 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f052002c020 con 0x555ec0e6a640 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0537d89740 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0537d89740 10 client.4419 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0537d89740 20 client.4419 populate_metadata read hostname 'smithi063' 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0537d89740 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x555ec0e976f0 0x555ec0e9e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0537d89740 4 client.4419 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-26T06:17:06.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.649+0000 7f0537d89740 1 -- 172.21.15.63:0/1318996253 --> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555ec0daef80 con 0x555ec0e976f0 2024-03-26T06:17:06.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.650+0000 7f052de00640 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x555ec0e976f0 0x555ec0e9e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.651+0000 7f052de00640 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x555ec0e976f0 0x555ec0e9e4d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd2a4f5e94df15a server_cookie=d39d4c9da9b02794 in_seq=0 out_seq=0 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.651+0000 7f0513400640 10 client.4419 ms_handle_connect on v2:172.21.15.204:6834/135702470 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.651+0000 7f0513400640 1 -- 172.21.15.63:0/1318996253 <== mds.0 v2:172.21.15.204:6834/135702470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x555ec0daef80 con 0x555ec0e976f0 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.651+0000 7f0513400640 10 client.4419 handle_command_reply: tid=0 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.651+0000 7f0537d89740 1 client.4419 shutdown 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 -- 172.21.15.63:0/1318996253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 msgr2=0x555ec0e6e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e6e290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0520004070 tx=0x7f0520004530 comp rx=0 tx=0).stop 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 -- 172.21.15.63:0/1318996253 shutdown_connections 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x555ec0e976f0 0x555ec0e9e4d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555ec0e6aa20 0x555ec0e6e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555ec0e6a640 0x555ec0e6e290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 --2- 172.21.15.63:0/1318996253 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555ec0e68230 0x555ec0ef5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 -- 172.21.15.63:0/1318996253 >> 172.21.15.63:0/1318996253 conn(0x555ec0e3db20 msgr2=0x555ec0e388b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0513400640 0 client.4419 ms_handle_reset on v2:172.21.15.204:6834/135702470 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 -- 172.21.15.63:0/1318996253 shutdown_connections 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 1 -- 172.21.15.63:0/1318996253 wait complete. 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.652+0000 7f0537d89740 20 client.4419 trim_cache size 0 max 16384 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "82863fce-9065-4f8e-a61f-944fd870ef74", 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4278, 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-03-26T06:17:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-03-26T06:17:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-03-26T06:17:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 8.1406989410000001, 2024-03-26T06:17:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 7, 2024-03-26T06:17:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 25, 2024-03-26T06:17:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 25, 2024-03-26T06:17:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 13.471435806000001 2024-03-26T06:17:06.656 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 -- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f050c06bc20 msgr2=0x7f050c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f050c06bc20 0x7f050c06e0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0518034000 tx=0x7f0518007000 comp rx=0 tx=0).stop 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 -- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05300b54a0 msgr2=0x7f05300b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05300b54a0 0x7f05300b5900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0530070df0 tx=0x7f0528009f90 comp rx=0 tx=0).stop 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 -- 172.21.15.63:0/1198299957 shutdown_connections 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f050c06bc20 0x7f050c06e0e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05300b54a0 0x7f05300b5900 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0530159c60 0x7f053009a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 --2- 172.21.15.63:0/1198299957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05140039b0 0x7f053009d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 -- 172.21.15.63:0/1198299957 >> 172.21.15.63:0/1198299957 conn(0x7f05300b2250 msgr2=0x7f05300af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:06.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 -- 172.21.15.63:0/1198299957 shutdown_connections 2024-03-26T06:17:06.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.653+0000 7f0535000640 1 -- 172.21.15.63:0/1198299957 wait complete. 2024-03-26T06:17:06.670 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-26T06:17:06.670 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-26T06:17:06.670 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-26T06:17:06.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.876+0000 7faf06e00640 1 Processor -- start 2024-03-26T06:17:06.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.876+0000 7faf06e00640 1 -- start start 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.878+0000 7faf06e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf000b5030 0x7faf000ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.878+0000 7faf06e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf000cc070 con 0x7faf00144b50 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.878+0000 7faf06e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0015fde0 con 0x7faf000b4c50 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.878+0000 7faf06e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf001600c0 con 0x7faf000b5030 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.878+0000 7faf05000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf000b5030 0x7faf000ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.878+0000 7faf06400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7faf00144b50 0x7faf0006d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51566/0 (socket says 172.21.15.63:51566) 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.878+0000 7faf06400640 1 -- 172.21.15.63:0/2691835203 learned_addr learned my addr 172.21.15.63:0/2691835203 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.879+0000 7faf05000640 1 -- 172.21.15.63:0/2691835203 >> v1:172.21.15.204:6789/0 conn(0x7faf000b4c50 legacy=0x7faf0015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.879+0000 7faf05000640 1 -- 172.21.15.63:0/2691835203 >> v1:172.21.15.63:6789/0 conn(0x7faf00144b50 legacy=0x7faf0006d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.879+0000 7faf05000640 1 -- 172.21.15.63:0/2691835203 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000cc310 con 0x7faf000b5030 2024-03-26T06:17:06.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.880+0000 7faf05000640 1 --2- 172.21.15.63:0/2691835203 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b5030 0x7faf000ccaf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faeec0097d0 tx=0x7faeec02b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7d75a9b97d74d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.880+0000 7faeffe00640 1 -- 172.21.15.63:0/2691835203 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec034070 con 0x7faf000b5030 2024-03-26T06:17:06.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.880+0000 7faeffe00640 1 -- 172.21.15.63:0/2691835203 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec030890 con 0x7faf000b5030 2024-03-26T06:17:06.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.880+0000 7faeffe00640 1 -- 172.21.15.63:0/2691835203 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec030c60 con 0x7faf000b5030 2024-03-26T06:17:06.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.881+0000 7faf06e00640 1 -- 172.21.15.63:0/2691835203 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b5030 msgr2=0x7faf000ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.881+0000 7faf06e00640 1 --2- 172.21.15.63:0/2691835203 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b5030 0x7faf000ccaf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faeec0097d0 tx=0x7faeec02b9d0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.881+0000 7faf06e00640 1 -- 172.21.15.63:0/2691835203 shutdown_connections 2024-03-26T06:17:06.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.881+0000 7faf06e00640 1 --2- 172.21.15.63:0/2691835203 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b5030 0x7faf000ccaf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.881+0000 7faf06e00640 1 -- 172.21.15.63:0/2691835203 >> 172.21.15.63:0/2691835203 conn(0x7faf000b13d0 msgr2=0x7faf000b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:06.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.881+0000 7faf06e00640 1 -- 172.21.15.63:0/2691835203 shutdown_connections 2024-03-26T06:17:06.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.881+0000 7faf06e00640 1 -- 172.21.15.63:0/2691835203 wait complete. 2024-03-26T06:17:06.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.883+0000 7faf06e00640 1 Processor -- start 2024-03-26T06:17:06.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.883+0000 7faf06e00640 1 -- start start 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf06e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b4c50 0x7faf0015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf06e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf000b5030 0x7faf001e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf06e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf00144b50 0x7faf001e6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf06e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0015fa50 con 0x7faf000b4c50 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf06e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0006eb70 con 0x7faf00144b50 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf06e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf00144fe0 con 0x7faf000b5030 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf05a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b4c50 0x7faf0015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf05a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b4c50 0x7faf0015ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58482/0 (socket says 172.21.15.63:58482) 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf05a00640 1 -- 172.21.15.63:0/2885065592 learned_addr learned my addr 172.21.15.63:0/2885065592 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.884+0000 7faf06400640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf00144b50 0x7faf001e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faf05000640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf000b5030 0x7faf001e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faf05a00640 1 -- 172.21.15.63:0/2885065592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf000b5030 msgr2=0x7faf001e5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faf05a00640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf000b5030 0x7faf001e5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faf05a00640 1 -- 172.21.15.63:0/2885065592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf00144b50 msgr2=0x7faf001e6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:06.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faf05a00640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf00144b50 0x7faf001e6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:06.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faf05a00640 1 -- 172.21.15.63:0/2885065592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00131020 con 0x7faf000b4c50 2024-03-26T06:17:06.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faf05a00640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b4c50 0x7faf0015ad20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faef400c8a0 tx=0x7faef400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faefd600640 1 -- 172.21.15.63:0/2885065592 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4003b70 con 0x7faf000b4c50 2024-03-26T06:17:06.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faefd600640 1 -- 172.21.15.63:0/2885065592 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4003d30 con 0x7faf000b4c50 2024-03-26T06:17:06.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faefd600640 1 -- 172.21.15.63:0/2885065592 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef400aa90 con 0x7faf000b4c50 2024-03-26T06:17:06.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.885+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf00131300 con 0x7faf000b4c50 2024-03-26T06:17:06.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.886+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf001318c0 con 0x7faf000b4c50 2024-03-26T06:17:06.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.887+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0004f050 con 0x7faf000b4c50 2024-03-26T06:17:06.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.888+0000 7faefd600640 1 -- 172.21.15.63:0/2885065592 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7faef400ac30 con 0x7faf000b4c50 2024-03-26T06:17:06.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.889+0000 7faefd600640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faee006bbd0 0x7faee006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:06.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.889+0000 7faefd600640 1 -- 172.21.15.63:0/2885065592 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faef408ae00 con 0x7faf000b4c50 2024-03-26T06:17:06.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.889+0000 7faf05000640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faee006bbd0 0x7faee006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:06.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.890+0000 7faf05000640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faee006bbd0 0x7faee006e090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faeec036000 tx=0x7faeec03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:06.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:06.894+0000 7faefd600640 1 -- 172.21.15.63:0/2885065592 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7faef4059510 con 0x7faf000b4c50 2024-03-26T06:17:07.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.135+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faf0006e400 con 0x7faf000b4c50 2024-03-26T06:17:07.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.135+0000 7faefd600640 1 -- 172.21.15.63:0/2885065592 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7faef4058e10 con 0x7faf000b4c50 2024-03-26T06:17:07.139 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faee006bbd0 msgr2=0x7faee006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faee006bbd0 0x7faee006e090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faeec036000 tx=0x7faeec03b040 comp rx=0 tx=0).stop 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b4c50 msgr2=0x7faf0015ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b4c50 0x7faf0015ad20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faef400c8a0 tx=0x7faef400cd60 comp rx=0 tx=0).stop 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 shutdown_connections 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faee006bbd0 0x7faee006e090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf00144b50 0x7faf001e6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf000b5030 0x7faf001e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 --2- 172.21.15.63:0/2885065592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf000b4c50 0x7faf0015ad20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 >> 172.21.15.63:0/2885065592 conn(0x7faf000b13d0 msgr2=0x7faf0006ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:07.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 shutdown_connections 2024-03-26T06:17:07.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:07.138+0000 7faf06e00640 1 -- 172.21.15.63:0/2885065592 wait complete. 2024-03-26T06:17:07.156 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-26T06:17:07.156 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-26T06:17:07.156 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-03-26T06:17:07.156 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-26T06:17:07.157 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-26T06:17:07.157 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-26T06:17:07.157 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-26T06:17:07.157 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-26T06:17:07.157 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-26T06:17:07.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:07.157 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-03-26T06:17:07.209 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:07.210 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-03-26T06:17:07.211 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:07.211 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:07.211 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-26T06:17:07.211 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:07.211 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-26T06:17:07.211 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42525sec preferred_lft 42525sec 2024-03-26T06:17:07.211 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2024-03-26T06:17:07.211 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:07.212 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-26T06:17:07.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:07.213 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:07.213 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:07.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-03-26T06:17:07.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-03-26T06:17:07.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-03-26T06:17:07.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-26T06:17:07.213 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:07.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:07.656 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-26T06:17:07.733 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-03-26T06:17:07.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:07.736 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-03-26T06:17:08.389 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-03-26T06:17:08.389 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-26T06:17:08.389 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-26T06:17:08.389 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-26T06:17:08.389 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-26T06:17:08.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:08.391 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:08.391 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:08.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-26T06:17:08.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-26T06:17:08.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-26T06:17:08.391 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:09.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:09.492 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-03-26T06:17:09.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:09.552 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-03-26T06:17:09.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:09.611 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:09.611 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:09.611 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-26T06:17:09.611 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-26T06:17:09.611 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:09.762 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-26T06:17:09.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:09.762 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:09.762 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:09.762 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-26T06:17:09.762 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-26T06:17:09.762 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-26T06:17:09.762 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-26T06:17:09.762 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-26T06:17:09.762 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:10.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:10.087 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:10.087 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:10.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-03-26T06:17:10.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-03-26T06:17:10.087 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:10.266 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-26T06:17:10.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:10.266 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-26T06:17:10.315 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-26T06:17:10.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:10.316 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-26T06:17:10.414 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-03-26T06:17:10.511 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-03-26T06:17:10.561 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/selinux 2024-03-26T06:17:10.562 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysctl.service 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/nfs/rpc_pipefs 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-03-26T06:17:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2024-03-26T06:17:10.564 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2024-03-26T06:17:10.564 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2024-03-26T06:17:10.564 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2024-03-26T06:17:10.564 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-03-26T06:17:10.564 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-26T06:17:10.564 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-26T06:17:10.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:10.565 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-03-26T06:17:10.615 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-26T06:17:10.615 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-26T06:17:10.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-03-26T06:17:10.698 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-03-26T06:17:10.740 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-03-26T06:17:10.741 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/selinux 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysctl.service 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/nfs/rpc_pipefs 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-03-26T06:17:10.742 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-03-26T06:17:10.743 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2024-03-26T06:17:10.743 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2024-03-26T06:17:10.743 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2024-03-26T06:17:10.743 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2024-03-26T06:17:10.743 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-03-26T06:17:10.743 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-26T06:17:10.743 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-26T06:17:10.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:10.744 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-03-26T06:17:10.809 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:2024-03-26T06:17:10.809+0000 7f1bec20c480 -1 init, newargv = 0x55fd128c80a0 newargc=15 2024-03-26T06:17:10.809 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[43706]: starting ceph client 2024-03-26T06:17:10.826 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[43706]: starting fuse 2024-03-26T06:17:10.829 INFO:teuthology.orchestra.run.smithi063.stdout:41 2024-03-26T06:17:10.829 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> sudo stdin-killer -- python3 -c ' 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> import glob 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> import re 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> import os 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> import subprocess 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> def _find_admin_socket(client_name): 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2024-03-26T06:17:10.830 DEBUG:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> return files[0] 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> for f in files: 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> contents = proc_f.read() 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> if mountpoint in contents: 2024-03-26T06:17:10.831 DEBUG:teuthology.orchestra.run.smithi063:> return f 2024-03-26T06:17:10.832 DEBUG:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-26T06:17:10.832 DEBUG:teuthology.orchestra.run.smithi063:> 2024-03-26T06:17:10.832 DEBUG:teuthology.orchestra.run.smithi063:> print(_find_admin_socket("client.admin")) 2024-03-26T06:17:10.832 DEBUG:teuthology.orchestra.run.smithi063:> ' 2024-03-26T06:17:11.038 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.admin.43706.asok 2024-03-26T06:17:11.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-26T06:17:11.056 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43706.asok 2024-03-26T06:17:11.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:11.056 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43706.asok status 2024-03-26T06:17:11.296 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "7e98f5f6b535defc7fa715b456904ffc0500aa9f", 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 19.0.0-1964-g7e98f5f6 (7e98f5f6b535defc7fa715b456904ffc0500aa9f) squid (dev)", 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "admin", 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "43706", 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2024-03-26T06:17:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4437, 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 4437 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4004122489 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-03-26T06:17:11.298 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4004122489 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.4437 192.168.0.1:0/4004122489", 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/4004122489", 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 7, 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 25, 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklisted": false, 2024-03-26T06:17:11.299 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs" 2024-03-26T06:17:11.300 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-03-26T06:17:11.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:11.312 DEBUG:teuthology.orchestra.run.smithi063:> stat --file-system '--printf=%T 2024-03-26T06:17:11.312 DEBUG:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-26T06:17:11.366 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2024-03-26T06:17:11.366 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-26T06:17:11.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:11.366 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-26T06:17:11.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:11.467 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-26T06:17:11.569 INFO:teuthology.orchestra.run.smithi063.stdout:# file: . 2024-03-26T06:17:11.569 INFO:teuthology.orchestra.run.smithi063.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-26T06:17:11.569 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:11.571 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:17:11.571 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:17:11.626 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:11.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.843+0000 7f0fdf000640 1 Processor -- start 2024-03-26T06:17:11.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.843+0000 7f0fdf000640 1 -- start start 2024-03-26T06:17:11.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.845+0000 7f0fdf000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8145100 0x7f0fd806ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:11.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.845+0000 7f0fdf000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0fd8071a60 0x7f0fd80cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:11.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.845+0000 7f0fdf000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd815bf80 con 0x7f0fd806ef70 2024-03-26T06:17:11.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.845+0000 7f0fdf000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd80a86e0 con 0x7f0fd8071a60 2024-03-26T06:17:11.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.845+0000 7f0fdf000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd806e2f0 con 0x7f0fd8145100 2024-03-26T06:17:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.846+0000 7f0fd7e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8145100 0x7f0fd806ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.846+0000 7f0fd7e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8145100 0x7f0fd806ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:57864/0 (socket says 172.21.15.63:57864) 2024-03-26T06:17:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.846+0000 7f0fd7e00640 1 -- 172.21.15.63:0/4144420512 learned_addr learned my addr 172.21.15.63:0/4144420512 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.846+0000 7f0fdd000640 1 --2- 172.21.15.63:0/4144420512 >> v2:172.21.15.204:3300/0 conn(0x7f0fd8071a60 0x7f0fd80cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.846+0000 7f0fd7e00640 1 -- 172.21.15.63:0/4144420512 >> v2:172.21.15.204:3300/0 conn(0x7f0fd8071a60 msgr2=0x7f0fd80cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.846+0000 7f0fd7e00640 1 --2- 172.21.15.63:0/4144420512 >> v2:172.21.15.204:3300/0 conn(0x7f0fd8071a60 0x7f0fd80cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.846+0000 7f0fd7e00640 1 -- 172.21.15.63:0/4144420512 >> v1:172.21.15.204:6789/0 conn(0x7f0fd806ef70 legacy=0x7f0fd8071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.846+0000 7f0fd7e00640 1 -- 172.21.15.63:0/4144420512 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd806d770 con 0x7f0fd8145100 2024-03-26T06:17:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.848+0000 7f0fd7e00640 1 --2- 172.21.15.63:0/4144420512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8145100 0x7f0fd806ea30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0fd806e4d0 tx=0x7f0fc802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3964c7e2296b6d25 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:11.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.848+0000 7f0fd6a00640 1 -- 172.21.15.63:0/4144420512 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8034070 con 0x7f0fd8145100 2024-03-26T06:17:11.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.848+0000 7f0fd6a00640 1 -- 172.21.15.63:0/4144420512 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc8030840 con 0x7f0fd8145100 2024-03-26T06:17:11.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.848+0000 7f0fd6a00640 1 -- 172.21.15.63:0/4144420512 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8030c10 con 0x7f0fd8145100 2024-03-26T06:17:11.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.849+0000 7f0fdf000640 1 -- 172.21.15.63:0/4144420512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8145100 msgr2=0x7f0fd806ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:11.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.849+0000 7f0fdf000640 1 --2- 172.21.15.63:0/4144420512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8145100 0x7f0fd806ea30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0fd806e4d0 tx=0x7f0fc802b980 comp rx=0 tx=0).stop 2024-03-26T06:17:11.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.849+0000 7f0fdf000640 1 -- 172.21.15.63:0/4144420512 shutdown_connections 2024-03-26T06:17:11.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.849+0000 7f0fdf000640 1 --2- 172.21.15.63:0/4144420512 >> v2:172.21.15.204:3300/0 conn(0x7f0fd8071a60 0x7f0fd80cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:11.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.849+0000 7f0fdf000640 1 --2- 172.21.15.63:0/4144420512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8145100 0x7f0fd806ea30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:11.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.849+0000 7f0fdf000640 1 -- 172.21.15.63:0/4144420512 >> 172.21.15.63:0/4144420512 conn(0x7f0fd806ac90 msgr2=0x7f0fd806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:11.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.849+0000 7f0fdf000640 1 -- 172.21.15.63:0/4144420512 shutdown_connections 2024-03-26T06:17:11.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.849+0000 7f0fdf000640 1 -- 172.21.15.63:0/4144420512 wait complete. 2024-03-26T06:17:11.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.851+0000 7f0fdf000640 1 Processor -- start 2024-03-26T06:17:11.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.851+0000 7f0fdf000640 1 -- start start 2024-03-26T06:17:11.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.852+0000 7f0fdf000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fd806ef70 0x7f0fd81f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:11.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.852+0000 7f0fdf000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8071a60 0x7f0fd8142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:11.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.852+0000 7f0fdf000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fd8145100 0x7f0fd8140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:11.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.852+0000 7f0fdf000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd806e010 con 0x7f0fd8145100 2024-03-26T06:17:11.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.852+0000 7f0fdf000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd806dd30 con 0x7f0fd806ef70 2024-03-26T06:17:11.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.852+0000 7f0fdf000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd81454e0 con 0x7f0fd8071a60 2024-03-26T06:17:11.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fdd000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fd8145100 0x7f0fd8140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:11.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fdd000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fd8145100 0x7f0fd8140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57348/0 (socket says 172.21.15.63:57348) 2024-03-26T06:17:11.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fdd000640 1 -- 172.21.15.63:0/31457649 learned_addr learned my addr 172.21.15.63:0/31457649 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fd7e00640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fd806ef70 0x7f0fd81f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fd7400640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8071a60 0x7f0fd8142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fdd000640 1 -- 172.21.15.63:0/31457649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8071a60 msgr2=0x7f0fd8142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fdd000640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8071a60 0x7f0fd8142070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fdd000640 1 -- 172.21.15.63:0/31457649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fd806ef70 msgr2=0x7f0fd81f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fdd000640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fd806ef70 0x7f0fd81f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fdd000640 1 -- 172.21.15.63:0/31457649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd8142aa0 con 0x7f0fd8145100 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fd7e00640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fd806ef70 0x7f0fd81f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.853+0000 7f0fdd000640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fd8145100 0x7f0fd8140000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000ef90 tx=0x7f0fd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.854+0000 7f0fcfe00640 1 -- 172.21.15.63:0/31457649 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0018020 con 0x7f0fd8145100 2024-03-26T06:17:11.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.854+0000 7f0fcfe00640 1 -- 172.21.15.63:0/31457649 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd0014480 con 0x7f0fd8145100 2024-03-26T06:17:11.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.854+0000 7f0fcfe00640 1 -- 172.21.15.63:0/31457649 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0014870 con 0x7f0fd8145100 2024-03-26T06:17:11.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.854+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd8142d80 con 0x7f0fd8145100 2024-03-26T06:17:11.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.854+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd8143340 con 0x7f0fd8145100 2024-03-26T06:17:11.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.855+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd8074730 con 0x7f0fd8145100 2024-03-26T06:17:11.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.856+0000 7f0fcfe00640 1 -- 172.21.15.63:0/31457649 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0fd0005d10 con 0x7f0fd8145100 2024-03-26T06:17:11.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.857+0000 7f0fcfe00640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0fb806bbd0 0x7f0fb806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:11.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.857+0000 7f0fcfe00640 1 -- 172.21.15.63:0/31457649 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0fd008bd10 con 0x7f0fd8145100 2024-03-26T06:17:11.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.857+0000 7f0fd7e00640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0fb806bbd0 0x7f0fb806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:11.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.858+0000 7f0fd7e00640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0fb806bbd0 0x7f0fb806e090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8036000 tx=0x7f0fc803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:11.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:11.862+0000 7f0fcfe00640 1 -- 172.21.15.63:0/31457649 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f0fd0091020 con 0x7f0fd8145100 2024-03-26T06:17:12.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.065+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fd815f200 con 0x7f0fd8145100 2024-03-26T06:17:12.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.068+0000 7f0fcfe00640 1 -- 172.21.15.63:0/31457649 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f0fd0022030 con 0x7f0fd8145100 2024-03-26T06:17:12.069 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:12.069 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.072+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0fb806bbd0 msgr2=0x7f0fb806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.072+0000 7f0fdf000640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0fb806bbd0 0x7f0fb806e090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8036000 tx=0x7f0fc803b040 comp rx=0 tx=0).stop 2024-03-26T06:17:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.072+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fd8145100 msgr2=0x7f0fd8140000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.072+0000 7f0fdf000640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fd8145100 0x7f0fd8140000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000ef90 tx=0x7f0fd000c490 comp rx=0 tx=0).stop 2024-03-26T06:17:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.073+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 shutdown_connections 2024-03-26T06:17:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.073+0000 7f0fdf000640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0fb806bbd0 0x7f0fb806e090 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.073+0000 7f0fdf000640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fd8145100 0x7f0fd8140000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.073+0000 7f0fdf000640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0fd8071a60 0x7f0fd8142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.073+0000 7f0fdf000640 1 --2- 172.21.15.63:0/31457649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fd806ef70 0x7f0fd81f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.073+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 >> 172.21.15.63:0/31457649 conn(0x7f0fd806ac90 msgr2=0x7f0fd80b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:12.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.073+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 shutdown_connections 2024-03-26T06:17:12.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.073+0000 7f0fdf000640 1 -- 172.21.15.63:0/31457649 wait complete. 2024-03-26T06:17:12.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:17:12.092 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:17:12.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.318+0000 7fdc9e000640 1 Processor -- start 2024-03-26T06:17:12.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.318+0000 7fdc9e000640 1 -- start start 2024-03-26T06:17:12.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.320+0000 7fdc9e000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdc980d3840 0x7fdc980d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.320+0000 7fdc9e000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc980d4160 con 0x7fdc9815dca0 2024-03-26T06:17:12.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.320+0000 7fdc9e000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc980d22d0 con 0x7fdc980b9320 2024-03-26T06:17:12.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.320+0000 7fdc9e000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc980d2070 con 0x7fdc980d3840 2024-03-26T06:17:12.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.320+0000 7fdc9cc00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdc980d3840 0x7fdc980d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.320+0000 7fdc97e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdc9815dca0 0x7fdc980d1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40452/0 (socket says 172.21.15.63:40452) 2024-03-26T06:17:12.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.320+0000 7fdc97e00640 1 -- 172.21.15.63:0/3616974600 learned_addr learned my addr 172.21.15.63:0/3616974600 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:12.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.321+0000 7fdc9cc00640 1 -- 172.21.15.63:0/3616974600 >> v1:172.21.15.204:6789/0 conn(0x7fdc980b9320 legacy=0x7fdc980b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.321+0000 7fdc9cc00640 1 -- 172.21.15.63:0/3616974600 >> v1:172.21.15.63:6789/0 conn(0x7fdc9815dca0 legacy=0x7fdc980d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.321+0000 7fdc9cc00640 1 -- 172.21.15.63:0/3616974600 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980d25b0 con 0x7fdc980d3840 2024-03-26T06:17:12.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.321+0000 7fdc97400640 1 -- 172.21.15.63:0/3616974600 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488669346 0 0) 0x7fdc980d4160 con 0x7fdc9815dca0 2024-03-26T06:17:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.322+0000 7fdc9cc00640 1 --2- 172.21.15.63:0/3616974600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980d3840 0x7fdc980d3c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0097a0 tx=0x7fdc8c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ecb5f9158dcfda server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.322+0000 7fdc97400640 1 -- 172.21.15.63:0/3616974600 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c034070 con 0x7fdc980d3840 2024-03-26T06:17:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.323+0000 7fdc97400640 1 -- 172.21.15.63:0/3616974600 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c030610 con 0x7fdc980d3840 2024-03-26T06:17:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.323+0000 7fdc97400640 1 -- 172.21.15.63:0/3616974600 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0309e0 con 0x7fdc980d3840 2024-03-26T06:17:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.323+0000 7fdc9e000640 1 -- 172.21.15.63:0/3616974600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980d3840 msgr2=0x7fdc980d3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.323+0000 7fdc9e000640 1 --2- 172.21.15.63:0/3616974600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980d3840 0x7fdc980d3c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0097a0 tx=0x7fdc8c02b960 comp rx=0 tx=0).stop 2024-03-26T06:17:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.323+0000 7fdc9e000640 1 -- 172.21.15.63:0/3616974600 shutdown_connections 2024-03-26T06:17:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.323+0000 7fdc9e000640 1 --2- 172.21.15.63:0/3616974600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980d3840 0x7fdc980d3c20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.323+0000 7fdc9e000640 1 -- 172.21.15.63:0/3616974600 >> 172.21.15.63:0/3616974600 conn(0x7fdc9806c570 msgr2=0x7fdc9806c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.323+0000 7fdc9e000640 1 -- 172.21.15.63:0/3616974600 shutdown_connections 2024-03-26T06:17:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.323+0000 7fdc9e000640 1 -- 172.21.15.63:0/3616974600 wait complete. 2024-03-26T06:17:12.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.325+0000 7fdc9e000640 1 Processor -- start 2024-03-26T06:17:12.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.325+0000 7fdc9e000640 1 -- start start 2024-03-26T06:17:12.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.326+0000 7fdc9e000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc980b9320 0x7fdc98141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.326+0000 7fdc9e000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc980d3840 0x7fdc981f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.326+0000 7fdc9e000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc9815dca0 0x7fdc981f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.326+0000 7fdc9e000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980d2e50 con 0x7fdc9815dca0 2024-03-26T06:17:12.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.326+0000 7fdc9e000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980d2b70 con 0x7fdc980d3840 2024-03-26T06:17:12.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.326+0000 7fdc9e000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980d3370 con 0x7fdc980b9320 2024-03-26T06:17:12.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9d600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc9815dca0 0x7fdc981f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9d600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc9815dca0 0x7fdc981f6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57372/0 (socket says 172.21.15.63:57372) 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9d600640 1 -- 172.21.15.63:0/2060314822 learned_addr learned my addr 172.21.15.63:0/2060314822 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9cc00640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc980b9320 0x7fdc98141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc97e00640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc980d3840 0x7fdc981f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9d600640 1 -- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc980b9320 msgr2=0x7fdc98141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9d600640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc980b9320 0x7fdc98141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9d600640 1 -- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc980d3840 msgr2=0x7fdc981f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9d600640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc980d3840 0x7fdc981f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9d600640 1 -- 172.21.15.63:0/2060314822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980cb6b0 con 0x7fdc9815dca0 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc97e00640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc980d3840 0x7fdc981f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:12.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.327+0000 7fdc9cc00640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc980b9320 0x7fdc98141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:12.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.328+0000 7fdc9d600640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc9815dca0 0x7fdc981f6a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c7a0 tx=0x7fdc9000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:12.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.328+0000 7fdc94c00640 1 -- 172.21.15.63:0/2060314822 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90003b70 con 0x7fdc9815dca0 2024-03-26T06:17:12.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.328+0000 7fdc94c00640 1 -- 172.21.15.63:0/2060314822 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc90003d30 con 0x7fdc9815dca0 2024-03-26T06:17:12.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.328+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc980cb990 con 0x7fdc9815dca0 2024-03-26T06:17:12.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.328+0000 7fdc94c00640 1 -- 172.21.15.63:0/2060314822 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000aa90 con 0x7fdc9815dca0 2024-03-26T06:17:12.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.328+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc980cbf50 con 0x7fdc9815dca0 2024-03-26T06:17:12.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.329+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9804f0c0 con 0x7fdc9815dca0 2024-03-26T06:17:12.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.330+0000 7fdc94c00640 1 -- 172.21.15.63:0/2060314822 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fdc9000ac30 con 0x7fdc9815dca0 2024-03-26T06:17:12.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.331+0000 7fdc94c00640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc7806bbd0 0x7fdc7806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.331+0000 7fdc94c00640 1 -- 172.21.15.63:0/2060314822 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdc9008ad80 con 0x7fdc9815dca0 2024-03-26T06:17:12.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.331+0000 7fdc9cc00640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc7806bbd0 0x7fdc7806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.332+0000 7fdc9cc00640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc7806bbd0 0x7fdc7806e090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c036000 tx=0x7fdc8c03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:12.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.336+0000 7fdc94c00640 1 -- 172.21.15.63:0/2060314822 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fdc900594a0 con 0x7fdc9815dca0 2024-03-26T06:17:12.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.533+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc9806b090 con 0x7fdc9815dca0 2024-03-26T06:17:12.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.534+0000 7fdc94c00640 1 -- 172.21.15.63:0/2060314822 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc90058da0 con 0x7fdc9815dca0 2024-03-26T06:17:12.534 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:17:12.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc7806bbd0 msgr2=0x7fdc7806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc7806bbd0 0x7fdc7806e090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c036000 tx=0x7fdc8c03b040 comp rx=0 tx=0).stop 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc9815dca0 msgr2=0x7fdc981f6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc9815dca0 0x7fdc981f6a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c7a0 tx=0x7fdc9000cc60 comp rx=0 tx=0).stop 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 shutdown_connections 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc7806bbd0 0x7fdc7806e090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc9815dca0 0x7fdc981f6a20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc980d3840 0x7fdc981f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 --2- 172.21.15.63:0/2060314822 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc980b9320 0x7fdc98141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 >> 172.21.15.63:0/2060314822 conn(0x7fdc9806c570 msgr2=0x7fdc980b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 shutdown_connections 2024-03-26T06:17:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.537+0000 7fdc9e000640 1 -- 172.21.15.63:0/2060314822 wait complete. 2024-03-26T06:17:12.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:17:12.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.773+0000 7f70d3e00640 1 Processor -- start 2024-03-26T06:17:12.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.773+0000 7f70d3e00640 1 -- start start 2024-03-26T06:17:12.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.775+0000 7f70d3e00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f70d4071850 0x7f70d406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.775+0000 7f70d3e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 0x7f70d415e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.775+0000 7f70d3e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d415e8b0 con 0x7f70d4143eb0 2024-03-26T06:17:12.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.775+0000 7f70d3e00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d4144290 con 0x7f70d4071850 2024-03-26T06:17:12.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.775+0000 7f70d3e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d415ee60 con 0x7f70d415dec0 2024-03-26T06:17:12.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.776+0000 7f70d3400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 0x7f70d415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.776+0000 7f70d2000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f70d4071850 0x7f70d406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.776+0000 7f70d3400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 0x7f70d415e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:57892/0 (socket says 172.21.15.63:57892) 2024-03-26T06:17:12.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.776+0000 7f70d3400640 1 -- 172.21.15.63:0/1634744600 learned_addr learned my addr 172.21.15.63:0/1634744600 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:12.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.776+0000 7f70d2a00640 1 --1- 172.21.15.63:0/1634744600 >> v1:172.21.15.204:6789/0 conn(0x7f70d4143eb0 0x7f70d4071140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:47736/0 (socket says 172.21.15.63:47736) 2024-03-26T06:17:12.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.776+0000 7f70d2000640 1 -- 172.21.15.63:0/1634744600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 msgr2=0x7f70d415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:12.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.776+0000 7f70d2000640 1 --2- 172.21.15.63:0/1634744600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 0x7f70d415e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.776+0000 7f70d2000640 1 -- 172.21.15.63:0/1634744600 >> v1:172.21.15.204:6789/0 conn(0x7f70d4143eb0 legacy=0x7f70d4071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.776+0000 7f70d2000640 1 -- 172.21.15.63:0/1634744600 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d415eb80 con 0x7f70d4071850 2024-03-26T06:17:12.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.778+0000 7f70d2000640 1 --2- 172.21.15.63:0/1634744600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d4071850 0x7f70d406dd80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70c00097a0 tx=0x7f70c002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23940dfd0bf529ed server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:12.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.778+0000 7f70d1600640 1 -- 172.21.15.63:0/1634744600 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0031780 con 0x7f70d4071850 2024-03-26T06:17:12.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.778+0000 7f70d1600640 1 -- 172.21.15.63:0/1634744600 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0037070 con 0x7f70d4071850 2024-03-26T06:17:12.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.778+0000 7f70d1600640 1 -- 172.21.15.63:0/1634744600 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0031b40 con 0x7f70d4071850 2024-03-26T06:17:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.778+0000 7f70d3e00640 1 -- 172.21.15.63:0/1634744600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d4071850 msgr2=0x7f70d406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.778+0000 7f70d3e00640 1 --2- 172.21.15.63:0/1634744600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d4071850 0x7f70d406dd80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70c00097a0 tx=0x7f70c002b820 comp rx=0 tx=0).stop 2024-03-26T06:17:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.779+0000 7f70d3e00640 1 -- 172.21.15.63:0/1634744600 shutdown_connections 2024-03-26T06:17:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.779+0000 7f70d3e00640 1 --2- 172.21.15.63:0/1634744600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 0x7f70d415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.779+0000 7f70d3e00640 1 --2- 172.21.15.63:0/1634744600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d4071850 0x7f70d406dd80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.779+0000 7f70d3e00640 1 -- 172.21.15.63:0/1634744600 >> 172.21.15.63:0/1634744600 conn(0x7f70d40670b0 msgr2=0x7f70d40b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.779+0000 7f70d3e00640 1 -- 172.21.15.63:0/1634744600 shutdown_connections 2024-03-26T06:17:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.779+0000 7f70d3e00640 1 -- 172.21.15.63:0/1634744600 wait complete. 2024-03-26T06:17:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.780+0000 7f70d3e00640 1 Processor -- start 2024-03-26T06:17:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.780+0000 7f70d3e00640 1 -- start start 2024-03-26T06:17:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.781+0000 7f70d3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70d4071850 0x7f70d4146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.781+0000 7f70d3e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d4143eb0 0x7f70d41450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.781+0000 7f70d3e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 0x7f70d40b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.781+0000 7f70d3e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d406d860 con 0x7f70d4071850 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.781+0000 7f70d3e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d406d580 con 0x7f70d4143eb0 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.781+0000 7f70d3e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d40adbc0 con 0x7f70d415dec0 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70d4071850 0x7f70d4146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70d4071850 0x7f70d4146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57378/0 (socket says 172.21.15.63:57378) 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d2a00640 1 -- 172.21.15.63:0/4032828634 learned_addr learned my addr 172.21.15.63:0/4032828634 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d2000640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d4143eb0 0x7f70d41450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d3400640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 0x7f70d40b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d2a00640 1 -- 172.21.15.63:0/4032828634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 msgr2=0x7f70d40b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d2a00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 0x7f70d40b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d2a00640 1 -- 172.21.15.63:0/4032828634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d4143eb0 msgr2=0x7f70d41450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d2a00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d4143eb0 0x7f70d41450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.782+0000 7f70d2a00640 1 -- 172.21.15.63:0/4032828634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d4147290 con 0x7f70d4071850 2024-03-26T06:17:12.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.783+0000 7f70d2a00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70d4071850 0x7f70d4146c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c400 tx=0x7f70c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:12.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.783+0000 7f70caa00640 1 -- 172.21.15.63:0/4032828634 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40074e0 con 0x7f70d4071850 2024-03-26T06:17:12.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.783+0000 7f70caa00640 1 -- 172.21.15.63:0/4032828634 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4007680 con 0x7f70d4071850 2024-03-26T06:17:12.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.783+0000 7f70caa00640 1 -- 172.21.15.63:0/4032828634 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4004a00 con 0x7f70d4071850 2024-03-26T06:17:12.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.783+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d413ce90 con 0x7f70d4071850 2024-03-26T06:17:12.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.783+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d413d450 con 0x7f70d4071850 2024-03-26T06:17:12.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.784+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d404f0c0 con 0x7f70d4071850 2024-03-26T06:17:12.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.785+0000 7f70caa00640 1 -- 172.21.15.63:0/4032828634 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f70c401a020 con 0x7f70d4071850 2024-03-26T06:17:12.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.786+0000 7f70caa00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70b406bbd0 0x7f70b406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:12.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.786+0000 7f70caa00640 1 -- 172.21.15.63:0/4032828634 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f70c408a5f0 con 0x7f70d4071850 2024-03-26T06:17:12.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.787+0000 7f70d2000640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70b406bbd0 0x7f70b406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:12.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.787+0000 7f70d2000640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70b406bbd0 0x7f70b406e090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70c0036000 tx=0x7f70c003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:12.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.792+0000 7f70caa00640 1 -- 172.21.15.63:0/4032828634 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f70c4010300 con 0x7f70d4071850 2024-03-26T06:17:12.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.984+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70d406e6b0 con 0x7f70d4071850 2024-03-26T06:17:12.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.985+0000 7f70caa00640 1 -- 172.21.15.63:0/4032828634 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70c4058d90 con 0x7f70d4071850 2024-03-26T06:17:12.986 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70b406bbd0 msgr2=0x7f70b406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70b406bbd0 0x7f70b406e090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70c0036000 tx=0x7f70c003d040 comp rx=0 tx=0).stop 2024-03-26T06:17:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70d4071850 msgr2=0x7f70d4146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70d4071850 0x7f70d4146c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c400 tx=0x7f70c400c8c0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 shutdown_connections 2024-03-26T06:17:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70b406bbd0 0x7f70b406e090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d415dec0 0x7f70d40b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d4143eb0 0x7f70d41450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 --2- 172.21.15.63:0/4032828634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70d4071850 0x7f70d4146c20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 >> 172.21.15.63:0/4032828634 conn(0x7f70d40670b0 msgr2=0x7f70d4140d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 shutdown_connections 2024-03-26T06:17:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:12.988+0000 7f70d3e00640 1 -- 172.21.15.63:0/4032828634 wait complete. 2024-03-26T06:17:13.006 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:17:13.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.218+0000 7f9ec1e00640 1 Processor -- start 2024-03-26T06:17:13.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.219+0000 7f9ec1e00640 1 -- start start 2024-03-26T06:17:13.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.220+0000 7f9ec1e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9ebc15dca0 0x7f9ebc0d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.220+0000 7f9ec1e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 0x7f9ebc0b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.220+0000 7f9ec1e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ebc0d22d0 con 0x7f9ebc0d3840 2024-03-26T06:17:13.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.220+0000 7f9ec1e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ebc0d25b0 con 0x7f9ebc15dca0 2024-03-26T06:17:13.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.220+0000 7f9ec1e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0d2890 con 0x7f9ebc0b9320 2024-03-26T06:17:13.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.221+0000 7f9ebbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9ebc15dca0 0x7f9ebc0d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.221+0000 7f9ebbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9ebc15dca0 0x7f9ebc0d1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57388/0 (socket says 172.21.15.63:57388) 2024-03-26T06:17:13.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.221+0000 7f9ebbe00640 1 -- 172.21.15.63:0/1497333097 learned_addr learned my addr 172.21.15.63:0/1497333097 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:13.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.221+0000 7f9ec1400640 1 --2- 172.21.15.63:0/1497333097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 0x7f9ebc0b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.221+0000 7f9ebbe00640 1 -- 172.21.15.63:0/1497333097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 msgr2=0x7f9ebc0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:13.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.221+0000 7f9ebbe00640 1 --2- 172.21.15.63:0/1497333097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 0x7f9ebc0b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.221+0000 7f9ebbe00640 1 -- 172.21.15.63:0/1497333097 >> v1:172.21.15.204:6789/0 conn(0x7f9ebc0d3840 legacy=0x7f9ebc0d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.221+0000 7f9ebbe00640 1 -- 172.21.15.63:0/1497333097 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc0d2b70 con 0x7f9ebc15dca0 2024-03-26T06:17:13.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.221+0000 7f9ec1400640 1 --2- 172.21.15.63:0/1497333097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 0x7f9ebc0b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:13.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.222+0000 7f9ebbe00640 1 --2- 172.21.15.63:0/1497333097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc15dca0 0x7f9ebc0d1960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009870 tx=0x7f9ea402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fdc308ec2c2b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:13.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.222+0000 7f9ebb400640 1 -- 172.21.15.63:0/1497333097 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4034070 con 0x7f9ebc15dca0 2024-03-26T06:17:13.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ebb400640 1 -- 172.21.15.63:0/1497333097 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea4030840 con 0x7f9ebc15dca0 2024-03-26T06:17:13.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ebb400640 1 -- 172.21.15.63:0/1497333097 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4030c10 con 0x7f9ebc15dca0 2024-03-26T06:17:13.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ec1e00640 1 -- 172.21.15.63:0/1497333097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc15dca0 msgr2=0x7f9ebc0d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ec1e00640 1 --2- 172.21.15.63:0/1497333097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc15dca0 0x7f9ebc0d1960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009870 tx=0x7f9ea402b980 comp rx=0 tx=0).stop 2024-03-26T06:17:13.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ec1e00640 1 -- 172.21.15.63:0/1497333097 shutdown_connections 2024-03-26T06:17:13.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ec1e00640 1 --2- 172.21.15.63:0/1497333097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 0x7f9ebc0b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ec1e00640 1 --2- 172.21.15.63:0/1497333097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc15dca0 0x7f9ebc0d1960 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ec1e00640 1 -- 172.21.15.63:0/1497333097 >> 172.21.15.63:0/1497333097 conn(0x7f9ebc06c570 msgr2=0x7f9ebc06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:13.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ec1e00640 1 -- 172.21.15.63:0/1497333097 shutdown_connections 2024-03-26T06:17:13.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.223+0000 7f9ec1e00640 1 -- 172.21.15.63:0/1497333097 wait complete. 2024-03-26T06:17:13.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.225+0000 7f9ec1e00640 1 Processor -- start 2024-03-26T06:17:13.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.225+0000 7f9ec1e00640 1 -- start start 2024-03-26T06:17:13.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.226+0000 7f9ec1e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 0x7f9ebc1f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.226+0000 7f9ec1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc0d3840 0x7f9ebc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.226+0000 7f9ec1e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ebc15dca0 0x7f9ebc0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.226+0000 7f9ec1e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0d2020 con 0x7f9ebc0d3840 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.226+0000 7f9ec1e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0d1ea0 con 0x7f9ebc15dca0 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.226+0000 7f9ec1e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0d3370 con 0x7f9ebc0b9320 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.226+0000 7f9ebbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc0d3840 0x7f9ebc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.226+0000 7f9ebbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc0d3840 0x7f9ebc0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57404/0 (socket says 172.21.15.63:57404) 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ebbe00640 1 -- 172.21.15.63:0/937090186 learned_addr learned my addr 172.21.15.63:0/937090186 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ec0a00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 0x7f9ebc1f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ec1400640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ebc15dca0 0x7f9ebc0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ebbe00640 1 -- 172.21.15.63:0/937090186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 msgr2=0x7f9ebc1f6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ebbe00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 0x7f9ebc1f6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ebbe00640 1 -- 172.21.15.63:0/937090186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ebc15dca0 msgr2=0x7f9ebc0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ebbe00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ebc15dca0 0x7f9ebc0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ebbe00640 1 -- 172.21.15.63:0/937090186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc0c9290 con 0x7f9ebc0d3840 2024-03-26T06:17:13.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ec1400640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ebc15dca0 0x7f9ebc0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:13.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.227+0000 7f9ebbe00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc0d3840 0x7f9ebc0cbc50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40097c0 tx=0x7f9ea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:13.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.228+0000 7f9eb8c00640 1 -- 172.21.15.63:0/937090186 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4034040 con 0x7f9ebc0d3840 2024-03-26T06:17:13.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.228+0000 7f9eb8c00640 1 -- 172.21.15.63:0/937090186 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea403ada0 con 0x7f9ebc0d3840 2024-03-26T06:17:13.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.228+0000 7f9eb8c00640 1 -- 172.21.15.63:0/937090186 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4044630 con 0x7f9ebc0d3840 2024-03-26T06:17:13.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.228+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc0c9570 con 0x7f9ebc0d3840 2024-03-26T06:17:13.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.228+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc0c9b30 con 0x7f9ebc0d3840 2024-03-26T06:17:13.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.229+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc04f0c0 con 0x7f9ebc0d3840 2024-03-26T06:17:13.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.230+0000 7f9eb8c00640 1 -- 172.21.15.63:0/937090186 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9ea404b060 con 0x7f9ebc0d3840 2024-03-26T06:17:13.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.231+0000 7f9eb8c00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9e9806bbd0 0x7f9e9806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.231+0000 7f9eb8c00640 1 -- 172.21.15.63:0/937090186 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9ea40acfe0 con 0x7f9ebc0d3840 2024-03-26T06:17:13.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.231+0000 7f9ec0a00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9e9806bbd0 0x7f9e9806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.232+0000 7f9ec0a00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9e9806bbd0 0x7f9e9806e090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000f60 tx=0x7f9eac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:13.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.235+0000 7f9eb8c00640 1 -- 172.21.15.63:0/937090186 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f9ea403f070 con 0x7f9ebc0d3840 2024-03-26T06:17:13.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.435+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ebc154880 con 0x7f9ebc0d3840 2024-03-26T06:17:13.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.436+0000 7f9eb8c00640 1 -- 172.21.15.63:0/937090186 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ea407b780 con 0x7f9ebc0d3840 2024-03-26T06:17:13.437 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:17:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.440+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9e9806bbd0 msgr2=0x7f9e9806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9e9806bbd0 0x7f9e9806e090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000f60 tx=0x7f9eac009040 comp rx=0 tx=0).stop 2024-03-26T06:17:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc0d3840 msgr2=0x7f9ebc0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc0d3840 0x7f9ebc0cbc50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40097c0 tx=0x7f9ea40046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 shutdown_connections 2024-03-26T06:17:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9e9806bbd0 0x7f9e9806e090 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ebc15dca0 0x7f9ebc0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ebc0d3840 0x7f9ebc0cbc50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 --2- 172.21.15.63:0/937090186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ebc0b9320 0x7f9ebc1f6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 >> 172.21.15.63:0/937090186 conn(0x7f9ebc06c570 msgr2=0x7f9ebc0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 shutdown_connections 2024-03-26T06:17:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.441+0000 7f9ec1e00640 1 -- 172.21.15.63:0/937090186 wait complete. 2024-03-26T06:17:13.460 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:17:13.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.675+0000 7fdea1000640 1 Processor -- start 2024-03-26T06:17:13.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.675+0000 7fdea1000640 1 -- start start 2024-03-26T06:17:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.677+0000 7fdea1000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 0x7fde9c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.677+0000 7fdea1000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fde9c1450d0 0x7fde9c071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.677+0000 7fdea1000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9c0d0140 con 0x7fde9c0cfd60 2024-03-26T06:17:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.677+0000 7fdea1000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9c0b3530 con 0x7fde9c1450d0 2024-03-26T06:17:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.677+0000 7fdea1000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c0b3810 con 0x7fde9c144c70 2024-03-26T06:17:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.677+0000 7fde99400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 0x7fde9c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.677+0000 7fde9a800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fde9c1450d0 0x7fde9c071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.678+0000 7fde99400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 0x7fde9c0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:57936/0 (socket says 172.21.15.63:57936) 2024-03-26T06:17:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.678+0000 7fde99400640 1 -- 172.21.15.63:0/767397162 learned_addr learned my addr 172.21.15.63:0/767397162 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.678+0000 7fde9a800640 1 -- 172.21.15.63:0/767397162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 msgr2=0x7fde9c0712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.678+0000 7fde9a800640 1 --2- 172.21.15.63:0/767397162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 0x7fde9c0712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.678+0000 7fde9a800640 1 -- 172.21.15.63:0/767397162 >> v1:172.21.15.204:6789/0 conn(0x7fde9c0cfd60 legacy=0x7fde9c0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.678+0000 7fde9a800640 1 -- 172.21.15.63:0/767397162 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c0b3af0 con 0x7fde9c1450d0 2024-03-26T06:17:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.680+0000 7fde9a800640 1 --2- 172.21.15.63:0/767397162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c1450d0 0x7fde9c071830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde9402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1d4dce174925359 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.680+0000 7fde98a00640 1 -- 172.21.15.63:0/767397162 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94039070 con 0x7fde9c1450d0 2024-03-26T06:17:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.680+0000 7fde98a00640 1 -- 172.21.15.63:0/767397162 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9402cc60 con 0x7fde9c1450d0 2024-03-26T06:17:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.680+0000 7fde98a00640 1 -- 172.21.15.63:0/767397162 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94034660 con 0x7fde9c1450d0 2024-03-26T06:17:13.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.681+0000 7fdea1000640 1 -- 172.21.15.63:0/767397162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c1450d0 msgr2=0x7fde9c071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.681+0000 7fdea1000640 1 --2- 172.21.15.63:0/767397162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c1450d0 0x7fde9c071830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde9402beb0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.681+0000 7fdea1000640 1 -- 172.21.15.63:0/767397162 shutdown_connections 2024-03-26T06:17:13.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.681+0000 7fdea1000640 1 --2- 172.21.15.63:0/767397162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c1450d0 0x7fde9c071830 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.681+0000 7fdea1000640 1 --2- 172.21.15.63:0/767397162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 0x7fde9c0712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.681+0000 7fdea1000640 1 -- 172.21.15.63:0/767397162 >> 172.21.15.63:0/767397162 conn(0x7fde9c06ac90 msgr2=0x7fde9c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:13.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.681+0000 7fdea1000640 1 -- 172.21.15.63:0/767397162 shutdown_connections 2024-03-26T06:17:13.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.681+0000 7fdea1000640 1 -- 172.21.15.63:0/767397162 wait complete. 2024-03-26T06:17:13.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.683+0000 7fdea1000640 1 Processor -- start 2024-03-26T06:17:13.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.683+0000 7fdea1000640 1 -- start start 2024-03-26T06:17:13.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fdea1000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c0cfd60 0x7fde9c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fdea1000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 0x7fde9c0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fdea1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde9c1450d0 0x7fde9c0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fdea1000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c0b31c0 con 0x7fde9c1450d0 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fdea1000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c0b40b0 con 0x7fde9c0cfd60 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fdea1000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c0ce670 con 0x7fde9c144c70 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fde9a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde9c1450d0 0x7fde9c0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fde9a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde9c1450d0 0x7fde9c0b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57410/0 (socket says 172.21.15.63:57410) 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fde9a800640 1 -- 172.21.15.63:0/669480635 learned_addr learned my addr 172.21.15.63:0/669480635 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fde99400640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 0x7fde9c0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.684+0000 7fde99e00640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c0cfd60 0x7fde9c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde9a800640 1 -- 172.21.15.63:0/669480635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 msgr2=0x7fde9c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde9a800640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 0x7fde9c0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde9a800640 1 -- 172.21.15.63:0/669480635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c0cfd60 msgr2=0x7fde9c15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde9a800640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c0cfd60 0x7fde9c15b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde9a800640 1 -- 172.21.15.63:0/669480635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c1f47b0 con 0x7fde9c1450d0 2024-03-26T06:17:13.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde99e00640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c0cfd60 0x7fde9c15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:13.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde9a800640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde9c1450d0 0x7fde9c0b0a50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:13.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde92000640 1 -- 172.21.15.63:0/669480635 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94039050 con 0x7fde9c1450d0 2024-03-26T06:17:13.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde92000640 1 -- 172.21.15.63:0/669480635 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94045070 con 0x7fde9c1450d0 2024-03-26T06:17:13.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fde92000640 1 -- 172.21.15.63:0/669480635 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9403e830 con 0x7fde9c1450d0 2024-03-26T06:17:13.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.685+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c1f3a10 con 0x7fde9c1450d0 2024-03-26T06:17:13.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.686+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9c1f3fb0 con 0x7fde9c1450d0 2024-03-26T06:17:13.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.687+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9c074730 con 0x7fde9c1450d0 2024-03-26T06:17:13.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.688+0000 7fde92000640 1 -- 172.21.15.63:0/669480635 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fde9403e9d0 con 0x7fde9c1450d0 2024-03-26T06:17:13.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.689+0000 7fde92000640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fde7c06bbd0 0x7fde7c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:13.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.690+0000 7fde92000640 1 -- 172.21.15.63:0/669480635 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fde940add30 con 0x7fde9c1450d0 2024-03-26T06:17:13.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.690+0000 7fde99e00640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fde7c06bbd0 0x7fde7c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:13.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.690+0000 7fde99e00640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fde7c06bbd0 0x7fde7c06e090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0ac950 tx=0x7fde8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:13.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.696+0000 7fde92000640 1 -- 172.21.15.63:0/669480635 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fde94032e20 con 0x7fde9c1450d0 2024-03-26T06:17:13.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.896+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fde9c15f1d0 con 0x7fde9c1450d0 2024-03-26T06:17:13.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.896+0000 7fde92000640 1 -- 172.21.15.63:0/669480635 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fde9407c5f0 con 0x7fde9c1450d0 2024-03-26T06:17:13.897 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:13.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fde7c06bbd0 msgr2=0x7fde7c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fde7c06bbd0 0x7fde7c06e090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0ac950 tx=0x7fde8c009040 comp rx=0 tx=0).stop 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde9c1450d0 msgr2=0x7fde9c0b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde9c1450d0 0x7fde9c0b0a50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde94004a40 comp rx=0 tx=0).stop 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 shutdown_connections 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fde7c06bbd0 0x7fde7c06e090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde9c1450d0 0x7fde9c0b0a50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9c144c70 0x7fde9c0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 --2- 172.21.15.63:0/669480635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde9c0cfd60 0x7fde9c15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 >> 172.21.15.63:0/669480635 conn(0x7fde9c06ac90 msgr2=0x7fde9c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 shutdown_connections 2024-03-26T06:17:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:13.899+0000 7fdea1000640 1 -- 172.21.15.63:0/669480635 wait complete. 2024-03-26T06:17:13.919 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-26T06:17:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.144+0000 7ffa1be00640 1 Processor -- start 2024-03-26T06:17:14.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.144+0000 7ffa1be00640 1 -- start start 2024-03-26T06:17:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.146+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c0cea40 0x7ffa1c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.146+0000 7ffa1be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa1c06e280 0x7ffa1c06e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.146+0000 7ffa1be00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c143cb0 con 0x7ffa1c1438d0 2024-03-26T06:17:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.146+0000 7ffa1be00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c0ccef0 con 0x7ffa1c06e280 2024-03-26T06:17:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.146+0000 7ffa1be00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c06ebf0 con 0x7ffa1c0cea40 2024-03-26T06:17:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.146+0000 7ffa1b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa1c06e280 0x7ffa1c06e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.147+0000 7ffa1b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa1c06e280 0x7ffa1c06e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57426/0 (socket says 172.21.15.63:57426) 2024-03-26T06:17:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.147+0000 7ffa1b400640 1 -- 172.21.15.63:0/2901068877 learned_addr learned my addr 172.21.15.63:0/2901068877 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.147+0000 7ffa13e00640 1 --2- 172.21.15.63:0/2901068877 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c0cea40 0x7ffa1c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.147+0000 7ffa1b400640 1 -- 172.21.15.63:0/2901068877 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c0cea40 msgr2=0x7ffa1c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:14.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.147+0000 7ffa1b400640 1 --2- 172.21.15.63:0/2901068877 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c0cea40 0x7ffa1c15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.147+0000 7ffa1b400640 1 -- 172.21.15.63:0/2901068877 >> v1:172.21.15.204:6789/0 conn(0x7ffa1c1438d0 legacy=0x7ffa1c0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.147+0000 7ffa1b400640 1 -- 172.21.15.63:0/2901068877 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0ceed0 con 0x7ffa1c06e280 2024-03-26T06:17:14.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.148+0000 7ffa1b400640 1 --2- 172.21.15.63:0/2901068877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 0x7ffa1c06e6b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009e50 tx=0x7ffa1402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc00738d1386c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:14.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.148+0000 7ffa1a000640 1 -- 172.21.15.63:0/2901068877 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1402cb00 con 0x7ffa1c06e280 2024-03-26T06:17:14.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1a000640 1 -- 172.21.15.63:0/2901068877 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1402cca0 con 0x7ffa1c06e280 2024-03-26T06:17:14.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1a000640 1 -- 172.21.15.63:0/2901068877 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14034610 con 0x7ffa1c06e280 2024-03-26T06:17:14.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1be00640 1 -- 172.21.15.63:0/2901068877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 msgr2=0x7ffa1c06e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1be00640 1 --2- 172.21.15.63:0/2901068877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 0x7ffa1c06e6b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009e50 tx=0x7ffa1402bf60 comp rx=0 tx=0).stop 2024-03-26T06:17:14.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1be00640 1 -- 172.21.15.63:0/2901068877 shutdown_connections 2024-03-26T06:17:14.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1be00640 1 --2- 172.21.15.63:0/2901068877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 0x7ffa1c06e6b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1be00640 1 --2- 172.21.15.63:0/2901068877 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c0cea40 0x7ffa1c15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1be00640 1 -- 172.21.15.63:0/2901068877 >> 172.21.15.63:0/2901068877 conn(0x7ffa1c0670b0 msgr2=0x7ffa1c0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:14.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1be00640 1 -- 172.21.15.63:0/2901068877 shutdown_connections 2024-03-26T06:17:14.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.149+0000 7ffa1be00640 1 -- 172.21.15.63:0/2901068877 wait complete. 2024-03-26T06:17:14.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.151+0000 7ffa1be00640 1 Processor -- start 2024-03-26T06:17:14.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.151+0000 7ffa1be00640 1 -- start start 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.152+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 0x7ffa1c13ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.152+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c1438d0 0x7ffa1c0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.152+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa1c0af610 0x7ffa1c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.152+0000 7ffa1be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c15e5a0 con 0x7ffa1c06e280 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.152+0000 7ffa1be00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c15e2c0 con 0x7ffa1c0af610 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.152+0000 7ffa1be00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c15e880 con 0x7ffa1c1438d0 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa1aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 0x7ffa1c13ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa1aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 0x7ffa1c13ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57440/0 (socket says 172.21.15.63:57440) 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa1aa00640 1 -- 172.21.15.63:0/4159877069 learned_addr learned my addr 172.21.15.63:0/4159877069 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa13e00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c1438d0 0x7ffa1c0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa1b400640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa1c0af610 0x7ffa1c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa1aa00640 1 -- 172.21.15.63:0/4159877069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c1438d0 msgr2=0x7ffa1c0af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa1aa00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c1438d0 0x7ffa1c0af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa1aa00640 1 -- 172.21.15.63:0/4159877069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa1c0af610 msgr2=0x7ffa1c15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa1aa00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa1c0af610 0x7ffa1c15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.153+0000 7ffa1aa00640 1 -- 172.21.15.63:0/4159877069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c15ae30 con 0x7ffa1c06e280 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.154+0000 7ffa1aa00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 0x7ffa1c13ac20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00c400 tx=0x7ffa0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.154+0000 7ffa12a00640 1 -- 172.21.15.63:0/4159877069 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c017070 con 0x7ffa1c06e280 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.154+0000 7ffa12a00640 1 -- 172.21.15.63:0/4159877069 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0052d0 con 0x7ffa1c06e280 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.154+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c15b110 con 0x7ffa1c06e280 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.154+0000 7ffa12a00640 1 -- 172.21.15.63:0/4159877069 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c003830 con 0x7ffa1c06e280 2024-03-26T06:17:14.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.154+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c15b6d0 con 0x7ffa1c06e280 2024-03-26T06:17:14.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.155+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c0afa20 con 0x7ffa1c06e280 2024-03-26T06:17:14.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.156+0000 7ffa12a00640 1 -- 172.21.15.63:0/4159877069 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ffa0c01a070 con 0x7ffa1c06e280 2024-03-26T06:17:14.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.157+0000 7ffa12a00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9f806bbd0 0x7ff9f806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.158+0000 7ffa12a00640 1 -- 172.21.15.63:0/4159877069 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffa0c08a080 con 0x7ffa1c06e280 2024-03-26T06:17:14.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.158+0000 7ffa13e00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9f806bbd0 0x7ff9f806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.158+0000 7ffa13e00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9f806bbd0 0x7ff9f806e090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c06dc10 tx=0x7ffa04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:14.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.162+0000 7ffa12a00640 1 -- 172.21.15.63:0/4159877069 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7ffa1c0afa20 con 0x7ffa1c06e280 2024-03-26T06:17:14.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.379+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffa1c0b0940 con 0x7ffa1c06e280 2024-03-26T06:17:14.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.380+0000 7ffa12a00640 1 -- 172.21.15.63:0/4159877069 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffa0c0581d0 con 0x7ffa1c06e280 2024-03-26T06:17:14.380 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.382+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9f806bbd0 msgr2=0x7ff9f806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.382+0000 7ffa1be00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9f806bbd0 0x7ff9f806e090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c06dc10 tx=0x7ffa04008040 comp rx=0 tx=0).stop 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.382+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 msgr2=0x7ffa1c13ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.382+0000 7ffa1be00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 0x7ffa1c13ac20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00c400 tx=0x7ffa0c00c8c0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.383+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 shutdown_connections 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.383+0000 7ffa1be00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9f806bbd0 0x7ff9f806e090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.383+0000 7ffa1be00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa1c0af610 0x7ffa1c15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.383+0000 7ffa1be00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa1c1438d0 0x7ffa1c0af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.383+0000 7ffa1be00640 1 --2- 172.21.15.63:0/4159877069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa1c06e280 0x7ffa1c13ac20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.383+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 >> 172.21.15.63:0/4159877069 conn(0x7ffa1c0670b0 msgr2=0x7ffa1c0b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.383+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 shutdown_connections 2024-03-26T06:17:14.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.383+0000 7ffa1be00640 1 -- 172.21.15.63:0/4159877069 wait complete. 2024-03-26T06:17:14.403 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:17:14.403 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:17:14.456 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:14.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.681+0000 7fcd30c00640 1 Processor -- start 2024-03-26T06:17:14.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.681+0000 7fcd30c00640 1 -- start start 2024-03-26T06:17:14.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.683+0000 7fcd30c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcd2c06ebd0 0x7fcd2c165720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.683+0000 7fcd30c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c071930 con 0x7fcd2c1440a0 2024-03-26T06:17:14.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.683+0000 7fcd30c00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c071c10 con 0x7fcd2c071350 2024-03-26T06:17:14.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.683+0000 7fcd30c00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b33f0 con 0x7fcd2c06ebd0 2024-03-26T06:17:14.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.683+0000 7fcd29e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcd2c1440a0 0x7fcd2c0cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40456/0 (socket says 172.21.15.63:40456) 2024-03-26T06:17:14.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.683+0000 7fcd29e00640 1 -- 172.21.15.63:0/1752554442 learned_addr learned my addr 172.21.15.63:0/1752554442 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:14.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd2a800640 1 --2- 172.21.15.63:0/1752554442 >> v2:172.21.15.204:3300/0 conn(0x7fcd2c06ebd0 0x7fcd2c165720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944252210 0 0) 0x7fcd2c071930 con 0x7fcd2c1440a0 2024-03-26T06:17:14.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd10003520 con 0x7fcd2c1440a0 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1373627151 0 0) 0x7fcd10003520 con 0x7fcd2c1440a0 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 >> v2:172.21.15.204:3300/0 conn(0x7fcd2c06ebd0 msgr2=0x7fcd2c165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 --2- 172.21.15.63:0/1752554442 >> v2:172.21.15.204:3300/0 conn(0x7fcd2c06ebd0 0x7fcd2c165720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 >> v1:172.21.15.204:6789/0 conn(0x7fcd2c071350 legacy=0x7fcd2c06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c071ef0 con 0x7fcd2c1440a0 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fcd1c001670 con 0x7fcd2c1440a0 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 >> v1:172.21.15.63:6789/0 conn(0x7fcd2c1440a0 legacy=0x7fcd2c0cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd10004800 0x7fcd10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd100051c0 0x7fcd1000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b33f0 con 0x7fcd100039b0 2024-03-26T06:17:14.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1000e370 con 0x7fcd100051c0 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1000e570 con 0x7fcd10004800 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.684+0000 7fcd29e00640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.685+0000 7fcd29e00640 1 -- 172.21.15.63:0/1752554442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd10004800 msgr2=0x7fcd10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.685+0000 7fcd2a800640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd100051c0 0x7fcd1000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.685+0000 7fcd29e00640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd10004800 0x7fcd10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.685+0000 7fcd29e00640 1 -- 172.21.15.63:0/1752554442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd100051c0 msgr2=0x7fcd1000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.685+0000 7fcd29e00640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd100051c0 0x7fcd1000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.685+0000 7fcd29e00640 1 -- 172.21.15.63:0/1752554442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10003520 con 0x7fcd100039b0 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.685+0000 7fcd2a800640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd100051c0 0x7fcd1000dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:14.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.685+0000 7fcd2a800640 1 -- 172.21.15.63:0/1752554442 reap_dead start 2024-03-26T06:17:14.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.686+0000 7fcd29e00640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd10003dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c240 tx=0x7fcd10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3724ad2bb77a53 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:14.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.686+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c007cf0 con 0x7fcd100039b0 2024-03-26T06:17:14.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.686+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c030070 con 0x7fcd100039b0 2024-03-26T06:17:14.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.686+0000 7fcd29400640 1 -- 172.21.15.63:0/1752554442 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c005d70 con 0x7fcd100039b0 2024-03-26T06:17:14.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.687+0000 7fcd30c00640 1 -- 172.21.15.63:0/1752554442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 msgr2=0x7fcd10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.687+0000 7fcd30c00640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd10003dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c240 tx=0x7fcd10005830 comp rx=0 tx=0).stop 2024-03-26T06:17:14.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.687+0000 7fcd30c00640 1 -- 172.21.15.63:0/1752554442 shutdown_connections 2024-03-26T06:17:14.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.687+0000 7fcd30c00640 1 --2- 172.21.15.63:0/1752554442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd10003dd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.687+0000 7fcd30c00640 1 -- 172.21.15.63:0/1752554442 >> 172.21.15.63:0/1752554442 conn(0x7fcd2c06ac90 msgr2=0x7fcd2c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:14.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.687+0000 7fcd30c00640 1 -- 172.21.15.63:0/1752554442 shutdown_connections 2024-03-26T06:17:14.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.687+0000 7fcd30c00640 1 -- 172.21.15.63:0/1752554442 wait complete. 2024-03-26T06:17:14.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.689+0000 7fcd30c00640 1 Processor -- start 2024-03-26T06:17:14.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.689+0000 7fcd30c00640 1 -- start start 2024-03-26T06:17:14.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.690+0000 7fcd30c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd2c1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.690+0000 7fcd30c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd2c0b1590 0x7fcd2c0b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.690+0000 7fcd30c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2c0af180 0x7fcd2c0af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.690+0000 7fcd30c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0cce00 con 0x7fcd100039b0 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.690+0000 7fcd30c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c144480 con 0x7fcd2c0b1590 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.690+0000 7fcd30c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0ccf80 con 0x7fcd2c0af180 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.690+0000 7fcd29e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd2c1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.690+0000 7fcd29e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd2c1575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57468/0 (socket says 172.21.15.63:57468) 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.690+0000 7fcd29e00640 1 -- 172.21.15.63:0/1073931093 learned_addr learned my addr 172.21.15.63:0/1073931093 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd2a800640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2c0af180 0x7fcd2c0af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd29e00640 1 -- 172.21.15.63:0/1073931093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2c0af180 msgr2=0x7fcd2c0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd29e00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2c0af180 0x7fcd2c0af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd21400640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd2c0b1590 0x7fcd2c0b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd29e00640 1 -- 172.21.15.63:0/1073931093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd2c0b1590 msgr2=0x7fcd2c0b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd29e00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd2c0b1590 0x7fcd2c0b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd29e00640 1 -- 172.21.15.63:0/1073931093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c0afe70 con 0x7fcd100039b0 2024-03-26T06:17:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd21400640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd2c0b1590 0x7fcd2c0b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd29e00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd2c1575d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c001970 tx=0x7fcd2c071de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd22a00640 1 -- 172.21.15.63:0/1073931093 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c045070 con 0x7fcd100039b0 2024-03-26T06:17:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd22a00640 1 -- 172.21.15.63:0/1073931093 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c004bf0 con 0x7fcd100039b0 2024-03-26T06:17:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd22a00640 1 -- 172.21.15.63:0/1073931093 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c001c30 con 0x7fcd100039b0 2024-03-26T06:17:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.691+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c0b0150 con 0x7fcd100039b0 2024-03-26T06:17:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.692+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c0b0710 con 0x7fcd100039b0 2024-03-26T06:17:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.693+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c074730 con 0x7fcd100039b0 2024-03-26T06:17:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.694+0000 7fcd22a00640 1 -- 172.21.15.63:0/1073931093 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fcd1c007070 con 0x7fcd100039b0 2024-03-26T06:17:14.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.695+0000 7fcd22a00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0806bbd0 0x7fcd0806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:14.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.695+0000 7fcd22a00640 1 -- 172.21.15.63:0/1073931093 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcd1c0abca0 con 0x7fcd100039b0 2024-03-26T06:17:14.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.695+0000 7fcd21400640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0806bbd0 0x7fcd0806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:14.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.696+0000 7fcd21400640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0806bbd0 0x7fcd0806e090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0b3fd0 tx=0x7fcd14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:14.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.700+0000 7fcd22a00640 1 -- 172.21.15.63:0/1073931093 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fcd1c079d60 con 0x7fcd100039b0 2024-03-26T06:17:14.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.902+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd2c0aeba0 con 0x7fcd100039b0 2024-03-26T06:17:14.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.904+0000 7fcd22a00640 1 -- 172.21.15.63:0/1073931093 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7fcd1c07de00 con 0x7fcd100039b0 2024-03-26T06:17:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:14.905 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:14.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.906+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0806bbd0 msgr2=0x7fcd0806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.906+0000 7fcd30c00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0806bbd0 0x7fcd0806e090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0b3fd0 tx=0x7fcd14009040 comp rx=0 tx=0).stop 2024-03-26T06:17:14.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.906+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 msgr2=0x7fcd2c1575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.906+0000 7fcd30c00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd2c1575d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c001970 tx=0x7fcd2c071de0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.907+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 shutdown_connections 2024-03-26T06:17:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.907+0000 7fcd30c00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0806bbd0 0x7fcd0806e090 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.907+0000 7fcd30c00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2c0af180 0x7fcd2c0af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.907+0000 7fcd30c00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd2c0b1590 0x7fcd2c0b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.907+0000 7fcd30c00640 1 --2- 172.21.15.63:0/1073931093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd100039b0 0x7fcd2c1575d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.907+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 >> 172.21.15.63:0/1073931093 conn(0x7fcd2c06ac90 msgr2=0x7fcd2c0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.907+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 shutdown_connections 2024-03-26T06:17:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:14.907+0000 7fcd30c00640 1 -- 172.21.15.63:0/1073931093 wait complete. 2024-03-26T06:17:14.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:17:14.927 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:17:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.143+0000 7f8fe8c00640 1 Processor -- start 2024-03-26T06:17:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.144+0000 7f8fe8c00640 1 -- start start 2024-03-26T06:17:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.145+0000 7f8fe8c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8fe4143eb0 0x7f8fe406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.145+0000 7f8fe8c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4071140 0x7f8fe40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.145+0000 7f8fe8c00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe415eb80 con 0x7f8fe415dec0 2024-03-26T06:17:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.145+0000 7f8fe8c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe4144290 con 0x7f8fe4143eb0 2024-03-26T06:17:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.145+0000 7f8fe8c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe415ee60 con 0x7f8fe4071140 2024-03-26T06:17:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.146+0000 7f8fe3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8fe4143eb0 0x7f8fe406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.146+0000 7f8fe3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8fe4143eb0 0x7f8fe406dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57480/0 (socket says 172.21.15.63:57480) 2024-03-26T06:17:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.146+0000 7f8fe3400640 1 -- 172.21.15.63:0/1222778515 learned_addr learned my addr 172.21.15.63:0/1222778515 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.146+0000 7f8fdbe00640 1 --2- 172.21.15.63:0/1222778515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4071140 0x7f8fe40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.146+0000 7f8fe3400640 1 -- 172.21.15.63:0/1222778515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4071140 msgr2=0x7f8fe40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:15.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.146+0000 7f8fe3400640 1 --2- 172.21.15.63:0/1222778515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4071140 0x7f8fe40715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.146+0000 7f8fe3400640 1 -- 172.21.15.63:0/1222778515 >> v1:172.21.15.204:6789/0 conn(0x7f8fe415dec0 legacy=0x7f8fe415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:15.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.146+0000 7f8fe3400640 1 -- 172.21.15.63:0/1222778515 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe406d2a0 con 0x7f8fe4143eb0 2024-03-26T06:17:15.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.146+0000 7f8fdbe00640 1 --2- 172.21.15.63:0/1222778515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4071140 0x7f8fe40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:15.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.147+0000 7f8fe3400640 1 --2- 172.21.15.63:0/1222778515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe4143eb0 0x7f8fe406dd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009870 tx=0x7f8fd402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb95ec2fd14f799 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:15.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.147+0000 7f8fe2a00640 1 -- 172.21.15.63:0/1222778515 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40317c0 con 0x7f8fe4143eb0 2024-03-26T06:17:15.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe2a00640 1 -- 172.21.15.63:0/1222778515 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4037070 con 0x7f8fe4143eb0 2024-03-26T06:17:15.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe2a00640 1 -- 172.21.15.63:0/1222778515 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4031b80 con 0x7f8fe4143eb0 2024-03-26T06:17:15.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe8c00640 1 -- 172.21.15.63:0/1222778515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe4143eb0 msgr2=0x7f8fe406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe8c00640 1 --2- 172.21.15.63:0/1222778515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe4143eb0 0x7f8fe406dd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009870 tx=0x7f8fd402b860 comp rx=0 tx=0).stop 2024-03-26T06:17:15.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe8c00640 1 -- 172.21.15.63:0/1222778515 shutdown_connections 2024-03-26T06:17:15.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe8c00640 1 --2- 172.21.15.63:0/1222778515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4071140 0x7f8fe40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe8c00640 1 --2- 172.21.15.63:0/1222778515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe4143eb0 0x7f8fe406dd80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe8c00640 1 -- 172.21.15.63:0/1222778515 >> 172.21.15.63:0/1222778515 conn(0x7f8fe40670b0 msgr2=0x7f8fe40b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:15.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe8c00640 1 -- 172.21.15.63:0/1222778515 shutdown_connections 2024-03-26T06:17:15.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.148+0000 7f8fe8c00640 1 -- 172.21.15.63:0/1222778515 wait complete. 2024-03-26T06:17:15.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.150+0000 7f8fe8c00640 1 Processor -- start 2024-03-26T06:17:15.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.150+0000 7f8fe8c00640 1 -- start start 2024-03-26T06:17:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.151+0000 7f8fe8c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fe4071140 0x7f8fe40b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.151+0000 7f8fe8c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4143eb0 0x7f8fe415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.151+0000 7f8fe8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe415dec0 0x7f8fe41f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.151+0000 7f8fe8c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40adbc0 con 0x7f8fe415dec0 2024-03-26T06:17:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.151+0000 7f8fe8c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe406d860 con 0x7f8fe4071140 2024-03-26T06:17:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.151+0000 7f8fe8c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40add40 con 0x7f8fe4143eb0 2024-03-26T06:17:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.151+0000 7f8fe3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe415dec0 0x7f8fe41f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.151+0000 7f8fe3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe415dec0 0x7f8fe41f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57492/0 (socket says 172.21.15.63:57492) 2024-03-26T06:17:15.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.151+0000 7f8fe3e00640 1 -- 172.21.15.63:0/619610511 learned_addr learned my addr 172.21.15.63:0/619610511 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fe3e00640 1 -- 172.21.15.63:0/619610511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4143eb0 msgr2=0x7f8fe415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fe3e00640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4143eb0 0x7f8fe415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fe3e00640 1 -- 172.21.15.63:0/619610511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fe4071140 msgr2=0x7f8fe40b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fe3e00640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fe4071140 0x7f8fe40b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fe3e00640 1 -- 172.21.15.63:0/619610511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe40af960 con 0x7f8fe415dec0 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fe3e00640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe415dec0 0x7f8fe41f7ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00b970 tx=0x7f8fdc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fdb400640 1 -- 172.21.15.63:0/619610511 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc019070 con 0x7f8fe415dec0 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fdb400640 1 -- 172.21.15.63:0/619610511 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc00cb40 con 0x7f8fe415dec0 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe40afc40 con 0x7f8fe415dec0 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fdb400640 1 -- 172.21.15.63:0/619610511 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc014440 con 0x7f8fe415dec0 2024-03-26T06:17:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.152+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe40b0200 con 0x7f8fe415dec0 2024-03-26T06:17:15.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.153+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe404f0c0 con 0x7f8fe415dec0 2024-03-26T06:17:15.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.154+0000 7f8fdb400640 1 -- 172.21.15.63:0/619610511 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8fdc01c070 con 0x7f8fe415dec0 2024-03-26T06:17:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.156+0000 7f8fdb400640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fc006bc00 0x7f8fc006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.156+0000 7f8fdb400640 1 -- 172.21.15.63:0/619610511 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8fdc08a940 con 0x7f8fe415dec0 2024-03-26T06:17:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.156+0000 7f8fe3400640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fc006bc00 0x7f8fc006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.157+0000 7f8fe3400640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fc006bc00 0x7f8fc006e0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4036000 tx=0x7f8fd4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:15.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.161+0000 7f8fdb400640 1 -- 172.21.15.63:0/619610511 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8fdc059180 con 0x7f8fe415dec0 2024-03-26T06:17:15.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.353+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fe406e6b0 con 0x7f8fe415dec0 2024-03-26T06:17:15.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.354+0000 7f8fdb400640 1 -- 172.21.15.63:0/619610511 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fdc058a80 con 0x7f8fe415dec0 2024-03-26T06:17:15.354 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:17:15.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fc006bc00 msgr2=0x7f8fc006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fc006bc00 0x7f8fc006e0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4036000 tx=0x7f8fd4030000 comp rx=0 tx=0).stop 2024-03-26T06:17:15.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe415dec0 msgr2=0x7f8fe41f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe415dec0 0x7f8fe41f7ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00b970 tx=0x7f8fdc00be30 comp rx=0 tx=0).stop 2024-03-26T06:17:15.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 shutdown_connections 2024-03-26T06:17:15.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fc006bc00 0x7f8fc006e0c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fe415dec0 0x7f8fe41f7ca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fe4143eb0 0x7f8fe415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 --2- 172.21.15.63:0/619610511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fe4071140 0x7f8fe40b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 >> 172.21.15.63:0/619610511 conn(0x7f8fe40670b0 msgr2=0x7f8fe40b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:15.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 shutdown_connections 2024-03-26T06:17:15.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.356+0000 7f8fe8c00640 1 -- 172.21.15.63:0/619610511 wait complete. 2024-03-26T06:17:15.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:17:15.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.595+0000 7fabce200640 1 Processor -- start 2024-03-26T06:17:15.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.595+0000 7fabce200640 1 -- start start 2024-03-26T06:17:15.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.597+0000 7fabce200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc8144c70 0x7fabc80712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.597+0000 7fabce200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fabc81450d0 0x7fabc8071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.597+0000 7fabce200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80d0140 con 0x7fabc80cfd60 2024-03-26T06:17:15.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.597+0000 7fabce200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc80b3530 con 0x7fabc81450d0 2024-03-26T06:17:15.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.597+0000 7fabce200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80b3810 con 0x7fabc8144c70 2024-03-26T06:17:15.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.598+0000 7fabc6a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc8144c70 0x7fabc80712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.598+0000 7fabc6a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc8144c70 0x7fabc80712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:57998/0 (socket says 172.21.15.63:57998) 2024-03-26T06:17:15.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.598+0000 7fabc6a00640 1 -- 172.21.15.63:0/3883282627 learned_addr learned my addr 172.21.15.63:0/3883282627 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:15.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.598+0000 7fabc7e00640 1 --2- 172.21.15.63:0/3883282627 >> v2:172.21.15.204:3300/0 conn(0x7fabc81450d0 0x7fabc8071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.598+0000 7fabc6a00640 1 -- 172.21.15.63:0/3883282627 >> v2:172.21.15.204:3300/0 conn(0x7fabc81450d0 msgr2=0x7fabc8071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:15.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.599+0000 7fabc6a00640 1 --2- 172.21.15.63:0/3883282627 >> v2:172.21.15.204:3300/0 conn(0x7fabc81450d0 0x7fabc8071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.599+0000 7fabc6a00640 1 -- 172.21.15.63:0/3883282627 >> v1:172.21.15.204:6789/0 conn(0x7fabc80cfd60 legacy=0x7fabc80b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.599+0000 7fabc6a00640 1 -- 172.21.15.63:0/3883282627 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80b3af0 con 0x7fabc8144c70 2024-03-26T06:17:15.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.600+0000 7fabc6a00640 1 --2- 172.21.15.63:0/3883282627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc8144c70 0x7fabc80712f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009870 tx=0x7fabb402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8314835b660818 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:15.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.604+0000 7fabc6000640 1 -- 172.21.15.63:0/3883282627 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4034070 con 0x7fabc8144c70 2024-03-26T06:17:15.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.604+0000 7fabc6000640 1 -- 172.21.15.63:0/3883282627 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb4030840 con 0x7fabc8144c70 2024-03-26T06:17:15.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.604+0000 7fabc6000640 1 -- 172.21.15.63:0/3883282627 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4030c10 con 0x7fabc8144c70 2024-03-26T06:17:15.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.605+0000 7fabce200640 1 -- 172.21.15.63:0/3883282627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc8144c70 msgr2=0x7fabc80712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.605+0000 7fabce200640 1 --2- 172.21.15.63:0/3883282627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc8144c70 0x7fabc80712f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009870 tx=0x7fabb402b980 comp rx=0 tx=0).stop 2024-03-26T06:17:15.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.605+0000 7fabce200640 1 -- 172.21.15.63:0/3883282627 shutdown_connections 2024-03-26T06:17:15.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.605+0000 7fabce200640 1 --2- 172.21.15.63:0/3883282627 >> v2:172.21.15.204:3300/0 conn(0x7fabc81450d0 0x7fabc8071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.605+0000 7fabce200640 1 --2- 172.21.15.63:0/3883282627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc8144c70 0x7fabc80712f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.605+0000 7fabce200640 1 -- 172.21.15.63:0/3883282627 >> 172.21.15.63:0/3883282627 conn(0x7fabc806ac90 msgr2=0x7fabc806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:15.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.605+0000 7fabce200640 1 -- 172.21.15.63:0/3883282627 shutdown_connections 2024-03-26T06:17:15.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.605+0000 7fabce200640 1 -- 172.21.15.63:0/3883282627 wait complete. 2024-03-26T06:17:15.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.607+0000 7fabce200640 1 Processor -- start 2024-03-26T06:17:15.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.607+0000 7fabce200640 1 -- start start 2024-03-26T06:17:15.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.608+0000 7fabce200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc80cfd60 0x7fabc815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.608+0000 7fabce200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabc8144c70 0x7fabc8141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.608+0000 7fabce200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc81450d0 0x7fabc813fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.608+0000 7fabce200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80b31c0 con 0x7fabc81450d0 2024-03-26T06:17:15.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.608+0000 7fabce200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80b40b0 con 0x7fabc8144c70 2024-03-26T06:17:15.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.608+0000 7fabce200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80ce670 con 0x7fabc80cfd60 2024-03-26T06:17:15.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc81450d0 0x7fabc813fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc81450d0 0x7fabc813fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57500/0 (socket says 172.21.15.63:57500) 2024-03-26T06:17:15.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7e00640 1 -- 172.21.15.63:0/605362920 learned_addr learned my addr 172.21.15.63:0/605362920 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:15.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc6a00640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabc8144c70 0x7fabc8141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7400640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc80cfd60 0x7fabc815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7e00640 1 -- 172.21.15.63:0/605362920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc80cfd60 msgr2=0x7fabc815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7e00640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc80cfd60 0x7fabc815e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7e00640 1 -- 172.21.15.63:0/605362920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabc8144c70 msgr2=0x7fabc8141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7e00640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabc8144c70 0x7fabc8141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7e00640 1 -- 172.21.15.63:0/605362920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc815d700 con 0x7fabc81450d0 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.609+0000 7fabc7400640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc80cfd60 0x7fabc815e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.610+0000 7fabc7e00640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc81450d0 0x7fabc813fa60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fabc000efc0 tx=0x7fabc000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.610+0000 7fabbf400640 1 -- 172.21.15.63:0/605362920 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0018020 con 0x7fabc81450d0 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.610+0000 7fabbf400640 1 -- 172.21.15.63:0/605362920 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc0014480 con 0x7fabc81450d0 2024-03-26T06:17:15.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.610+0000 7fabbf400640 1 -- 172.21.15.63:0/605362920 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0014870 con 0x7fabc81450d0 2024-03-26T06:17:15.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.610+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc815dcc0 con 0x7fabc81450d0 2024-03-26T06:17:15.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.610+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc815e280 con 0x7fabc81450d0 2024-03-26T06:17:15.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.612+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc8074730 con 0x7fabc81450d0 2024-03-26T06:17:15.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.612+0000 7fabbf400640 1 -- 172.21.15.63:0/605362920 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fabc0005d10 con 0x7fabc81450d0 2024-03-26T06:17:15.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.613+0000 7fabbf400640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faba806bc20 0x7faba806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:15.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.614+0000 7fabbf400640 1 -- 172.21.15.63:0/605362920 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fabc008b710 con 0x7fabc81450d0 2024-03-26T06:17:15.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.614+0000 7fabc7400640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faba806bc20 0x7faba806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:15.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.615+0000 7fabc7400640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faba806bc20 0x7faba806e0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fabb8001700 tx=0x7fabb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:15.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.618+0000 7fabbf400640 1 -- 172.21.15.63:0/605362920 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fabc0022070 con 0x7fabc81450d0 2024-03-26T06:17:15.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.820+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fabc815f1d0 con 0x7fabc81450d0 2024-03-26T06:17:15.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.821+0000 7fabbf400640 1 -- 172.21.15.63:0/605362920 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fabc0010040 con 0x7fabc81450d0 2024-03-26T06:17:15.822 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:15.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.823+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faba806bc20 msgr2=0x7faba806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.823+0000 7fabce200640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faba806bc20 0x7faba806e0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fabb8001700 tx=0x7fabb8009040 comp rx=0 tx=0).stop 2024-03-26T06:17:15.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.823+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc81450d0 msgr2=0x7fabc813fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:15.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.823+0000 7fabce200640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc81450d0 0x7fabc813fa60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fabc000efc0 tx=0x7fabc000c490 comp rx=0 tx=0).stop 2024-03-26T06:17:15.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.824+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 shutdown_connections 2024-03-26T06:17:15.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.824+0000 7fabce200640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faba806bc20 0x7faba806e0e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.824+0000 7fabce200640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc81450d0 0x7fabc813fa60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.824+0000 7fabce200640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabc8144c70 0x7fabc8141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.824+0000 7fabce200640 1 --2- 172.21.15.63:0/605362920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabc80cfd60 0x7fabc815e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:15.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.824+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 >> 172.21.15.63:0/605362920 conn(0x7fabc806ac90 msgr2=0x7fabc8071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:15.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.824+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 shutdown_connections 2024-03-26T06:17:15.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:15.824+0000 7fabce200640 1 -- 172.21.15.63:0/605362920 wait complete. 2024-03-26T06:17:15.844 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:17:16.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.057+0000 7f3237200640 1 Processor -- start 2024-03-26T06:17:16.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.058+0000 7f3237200640 1 -- start start 2024-03-26T06:17:16.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.060+0000 7f3237200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3238071850 0x7f323806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.060+0000 7f3237200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 0x7f323815e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.060+0000 7f3237200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323815e8b0 con 0x7f3238143eb0 2024-03-26T06:17:16.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.060+0000 7f3237200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3238144290 con 0x7f3238071850 2024-03-26T06:17:16.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.060+0000 7f3237200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323815ee60 con 0x7f323815dec0 2024-03-26T06:17:16.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.060+0000 7f322fe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3238071850 0x7f323806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.060+0000 7f322fe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3238071850 0x7f323806dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57502/0 (socket says 172.21.15.63:57502) 2024-03-26T06:17:16.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.060+0000 7f322fe00640 1 -- 172.21.15.63:0/2827097299 learned_addr learned my addr 172.21.15.63:0/2827097299 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:16.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.060+0000 7f3236800640 1 --2- 172.21.15.63:0/2827097299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 0x7f323815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.061+0000 7f322fe00640 1 -- 172.21.15.63:0/2827097299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 msgr2=0x7f323815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:16.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.061+0000 7f322fe00640 1 --2- 172.21.15.63:0/2827097299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 0x7f323815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.061+0000 7f322fe00640 1 -- 172.21.15.63:0/2827097299 >> v1:172.21.15.204:6789/0 conn(0x7f3238143eb0 legacy=0x7f3238071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.061+0000 7f322fe00640 1 -- 172.21.15.63:0/2827097299 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323815eb80 con 0x7f3238071850 2024-03-26T06:17:16.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.061+0000 7f3236800640 1 --2- 172.21.15.63:0/2827097299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 0x7f323815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:16.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.062+0000 7f322fe00640 1 --2- 172.21.15.63:0/2827097299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238071850 0x7f323806dd80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ae9be79242de23 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:16.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.063+0000 7f3235400640 1 -- 172.21.15.63:0/2827097299 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220035020 con 0x7f3238071850 2024-03-26T06:17:16.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.063+0000 7f3235400640 1 -- 172.21.15.63:0/2827097299 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3220031640 con 0x7f3238071850 2024-03-26T06:17:16.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.063+0000 7f3235400640 1 -- 172.21.15.63:0/2827097299 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322002d040 con 0x7f3238071850 2024-03-26T06:17:16.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.063+0000 7f3237200640 1 -- 172.21.15.63:0/2827097299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238071850 msgr2=0x7f323806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.063+0000 7f3237200640 1 --2- 172.21.15.63:0/2827097299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238071850 0x7f323806dd80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322002b8f0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.063+0000 7f3237200640 1 -- 172.21.15.63:0/2827097299 shutdown_connections 2024-03-26T06:17:16.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.063+0000 7f3237200640 1 --2- 172.21.15.63:0/2827097299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 0x7f323815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.063+0000 7f3237200640 1 --2- 172.21.15.63:0/2827097299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238071850 0x7f323806dd80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.063+0000 7f3237200640 1 -- 172.21.15.63:0/2827097299 >> 172.21.15.63:0/2827097299 conn(0x7f32380670b0 msgr2=0x7f32380b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:16.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.064+0000 7f3237200640 1 -- 172.21.15.63:0/2827097299 shutdown_connections 2024-03-26T06:17:16.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.064+0000 7f3237200640 1 -- 172.21.15.63:0/2827097299 wait complete. 2024-03-26T06:17:16.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.065+0000 7f3237200640 1 Processor -- start 2024-03-26T06:17:16.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.065+0000 7f3237200640 1 -- start start 2024-03-26T06:17:16.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.066+0000 7f3237200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3238071850 0x7f323815b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.066+0000 7f3237200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238143eb0 0x7f3238144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.066+0000 7f3237200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 0x7f32380afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.066+0000 7f3237200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323806d860 con 0x7f3238143eb0 2024-03-26T06:17:16.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.066+0000 7f3237200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323806d580 con 0x7f3238071850 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.066+0000 7f3237200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32380adbc0 con 0x7f323815dec0 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f322fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238143eb0 0x7f3238144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f322fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238143eb0 0x7f3238144ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57506/0 (socket says 172.21.15.63:57506) 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f322fe00640 1 -- 172.21.15.63:0/1952338982 learned_addr learned my addr 172.21.15.63:0/1952338982 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f3235e00640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3238071850 0x7f323815b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f3236800640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 0x7f32380afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f322fe00640 1 -- 172.21.15.63:0/1952338982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 msgr2=0x7f32380afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f322fe00640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 0x7f32380afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f322fe00640 1 -- 172.21.15.63:0/1952338982 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3238071850 msgr2=0x7f323815b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f322fe00640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3238071850 0x7f323815b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.067+0000 7f322fe00640 1 -- 172.21.15.63:0/1952338982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32380cc3f0 con 0x7f3238143eb0 2024-03-26T06:17:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.068+0000 7f322fe00640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238143eb0 0x7f3238144ae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3220000c00 tx=0x7f32200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:16.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.068+0000 7f322e000640 1 -- 172.21.15.63:0/1952338982 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220040070 con 0x7f3238143eb0 2024-03-26T06:17:16.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.068+0000 7f322e000640 1 -- 172.21.15.63:0/1952338982 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32200399f0 con 0x7f3238143eb0 2024-03-26T06:17:16.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.068+0000 7f322e000640 1 -- 172.21.15.63:0/1952338982 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220035040 con 0x7f3238143eb0 2024-03-26T06:17:16.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.068+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32380cc6d0 con 0x7f3238143eb0 2024-03-26T06:17:16.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.068+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32380ccc90 con 0x7f3238143eb0 2024-03-26T06:17:16.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.069+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323804f0c0 con 0x7f3238143eb0 2024-03-26T06:17:16.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.070+0000 7f322e000640 1 -- 172.21.15.63:0/1952338982 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f322004b060 con 0x7f3238143eb0 2024-03-26T06:17:16.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.071+0000 7f322e000640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f321406bbd0 0x7f321406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.071+0000 7f322e000640 1 -- 172.21.15.63:0/1952338982 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f32200ac690 con 0x7f3238143eb0 2024-03-26T06:17:16.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.071+0000 7f3235e00640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f321406bbd0 0x7f321406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.072+0000 7f3235e00640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f321406bbd0 0x7f321406e090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3228001640 tx=0x7f3228009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:16.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.076+0000 7f322e000640 1 -- 172.21.15.63:0/1952338982 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f322002f300 con 0x7f3238143eb0 2024-03-26T06:17:16.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.284+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f323806e6b0 con 0x7f3238143eb0 2024-03-26T06:17:16.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.285+0000 7f322e000640 1 -- 172.21.15.63:0/1952338982 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f322007aeb0 con 0x7f3238143eb0 2024-03-26T06:17:16.285 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:17:16.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f321406bbd0 msgr2=0x7f321406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f321406bbd0 0x7f321406e090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3228001640 tx=0x7f3228009040 comp rx=0 tx=0).stop 2024-03-26T06:17:16.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238143eb0 msgr2=0x7f3238144ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238143eb0 0x7f3238144ae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3220000c00 tx=0x7f32200046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 shutdown_connections 2024-03-26T06:17:16.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f321406bbd0 0x7f321406e090 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f323815dec0 0x7f32380afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3238143eb0 0x7f3238144ae0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 --2- 172.21.15.63:0/1952338982 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3238071850 0x7f323815b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 >> 172.21.15.63:0/1952338982 conn(0x7f32380670b0 msgr2=0x7f3238140c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:16.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 shutdown_connections 2024-03-26T06:17:16.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.288+0000 7f3237200640 1 -- 172.21.15.63:0/1952338982 wait complete. 2024-03-26T06:17:16.307 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:17:16.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.524+0000 7fe736e00640 1 Processor -- start 2024-03-26T06:17:16.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.524+0000 7fe736e00640 1 -- start start 2024-03-26T06:17:16.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.526+0000 7fe736e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe730071a00 0x7fe7300ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.526+0000 7fe736e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7300d0140 con 0x7fe7300cfd60 2024-03-26T06:17:16.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.526+0000 7fe736e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7300b3530 con 0x7fe730144c70 2024-03-26T06:17:16.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.526+0000 7fe736e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300b3810 con 0x7fe730071a00 2024-03-26T06:17:16.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.526+0000 7fe72fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe7300cfd60 0x7fe7300b45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40472/0 (socket says 172.21.15.63:40472) 2024-03-26T06:17:16.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.526+0000 7fe72fe00640 1 -- 172.21.15.63:0/2971884333 learned_addr learned my addr 172.21.15.63:0/2971884333 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:16.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.527+0000 7fe734e00640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe730071a00 0x7fe7300ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.527+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375845169 0 0) 0x7fe7300d0140 con 0x7fe7300cfd60 2024-03-26T06:17:16.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.527+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe714003520 con 0x7fe7300cfd60 2024-03-26T06:17:16.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.527+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082362459 0 0) 0x7fe7300b3530 con 0x7fe730144c70 2024-03-26T06:17:16.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.527+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7300d0140 con 0x7fe730144c70 2024-03-26T06:17:16.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.527+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1766198234 0 0) 0x7fe714003520 con 0x7fe7300cfd60 2024-03-26T06:17:16.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe730071a00 msgr2=0x7fe7300ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:16.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe730071a00 0x7fe7300ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 >> v1:172.21.15.204:6789/0 conn(0x7fe730144c70 legacy=0x7fe7300712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7300b3af0 con 0x7fe7300cfd60 2024-03-26T06:17:16.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fe720001690 con 0x7fe7300cfd60 2024-03-26T06:17:16.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe734e00640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe730071a00 0x7fe7300ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:17:16.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 >> v1:172.21.15.63:6789/0 conn(0x7fe7300cfd60 legacy=0x7fe7300b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe730071a00 0x7fe714003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7140040b0 0x7fe714004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe714004d40 0x7fe7140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300b3810 con 0x7fe7140040b0 2024-03-26T06:17:16.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71400ba70 con 0x7fe714004d40 2024-03-26T06:17:16.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71400bc70 con 0x7fe730071a00 2024-03-26T06:17:16.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe727e00640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7140040b0 0x7fe714004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe734e00640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe714004d40 0x7fe7140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe72fe00640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe730071a00 0x7fe714003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe727e00640 1 -- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe730071a00 msgr2=0x7fe714003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:16.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe727e00640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe730071a00 0x7fe714003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe727e00640 1 -- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe714004d40 msgr2=0x7fe7140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:16.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.528+0000 7fe727e00640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe714004d40 0x7fe7140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.529+0000 7fe727e00640 1 -- 172.21.15.63:0/2971884333 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe714003520 con 0x7fe7140040b0 2024-03-26T06:17:16.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.530+0000 7fe727e00640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7140040b0 0x7fe714004800 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7180018d0 tx=0x7fe714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c6ce8d552de684 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:16.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.530+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718037070 con 0x7fe7140040b0 2024-03-26T06:17:16.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.530+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180052d0 con 0x7fe7140040b0 2024-03-26T06:17:16.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.530+0000 7fe72f400640 1 -- 172.21.15.63:0/2971884333 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180014f0 con 0x7fe7140040b0 2024-03-26T06:17:16.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.530+0000 7fe736e00640 1 -- 172.21.15.63:0/2971884333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7140040b0 msgr2=0x7fe714004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.530+0000 7fe736e00640 1 --2- 172.21.15.63:0/2971884333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7140040b0 0x7fe714004800 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7180018d0 tx=0x7fe714005830 comp rx=0 tx=0).stop 2024-03-26T06:17:16.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.530+0000 7fe734e00640 1 -- 172.21.15.63:0/2971884333 reap_dead start 2024-03-26T06:17:16.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.531+0000 7fe736e00640 1 -- 172.21.15.63:0/2971884333 shutdown_connections 2024-03-26T06:17:16.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.531+0000 7fe736e00640 1 -- 172.21.15.63:0/2971884333 >> 172.21.15.63:0/2971884333 conn(0x7fe73006ac90 msgr2=0x7fe73006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:16.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.531+0000 7fe736e00640 1 -- 172.21.15.63:0/2971884333 shutdown_connections 2024-03-26T06:17:16.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.531+0000 7fe736e00640 1 -- 172.21.15.63:0/2971884333 wait complete. 2024-03-26T06:17:16.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.532+0000 7fe736e00640 1 Processor -- start 2024-03-26T06:17:16.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.533+0000 7fe736e00640 1 -- start start 2024-03-26T06:17:16.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.533+0000 7fe736e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7140040b0 0x7fe7300ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.533+0000 7fe736e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7300adf60 0x7fe73006e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe736e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe73015b180 0x7fe7300b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe736e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300b31c0 con 0x7fe7300adf60 2024-03-26T06:17:16.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe736e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300b40b0 con 0x7fe73015b180 2024-03-26T06:17:16.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe736e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7301450d0 con 0x7fe7140040b0 2024-03-26T06:17:16.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe727e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7300adf60 0x7fe73006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe727e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7300adf60 0x7fe73006e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57518/0 (socket says 172.21.15.63:57518) 2024-03-26T06:17:16.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe727e00640 1 -- 172.21.15.63:0/1971376774 learned_addr learned my addr 172.21.15.63:0/1971376774 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:16.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe72fe00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7140040b0 0x7fe7300ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe734e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe73015b180 0x7fe7300b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe727e00640 1 -- 172.21.15.63:0/1971376774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7140040b0 msgr2=0x7fe7300ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe727e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7140040b0 0x7fe7300ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe727e00640 1 -- 172.21.15.63:0/1971376774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe73015b180 msgr2=0x7fe7300b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe727e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe73015b180 0x7fe7300b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.534+0000 7fe727e00640 1 -- 172.21.15.63:0/1971376774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73006eba0 con 0x7fe7300adf60 2024-03-26T06:17:16.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.535+0000 7fe727e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7300adf60 0x7fe73006e660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe718035040 tx=0x7fe7180012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:16.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.535+0000 7fe72cc00640 1 -- 172.21.15.63:0/1971376774 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718042020 con 0x7fe7300adf60 2024-03-26T06:17:16.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.535+0000 7fe72cc00640 1 -- 172.21.15.63:0/1971376774 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718038040 con 0x7fe7300adf60 2024-03-26T06:17:16.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.535+0000 7fe72cc00640 1 -- 172.21.15.63:0/1971376774 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718037070 con 0x7fe7300adf60 2024-03-26T06:17:16.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.535+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7300acec0 con 0x7fe7300adf60 2024-03-26T06:17:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.535+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7300ad480 con 0x7fe7300adf60 2024-03-26T06:17:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.536+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe730074730 con 0x7fe7300adf60 2024-03-26T06:17:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.537+0000 7fe72cc00640 1 -- 172.21.15.63:0/1971376774 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe718045020 con 0x7fe7300adf60 2024-03-26T06:17:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.539+0000 7fe72cc00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe70c06bc00 0x7fe70c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.539+0000 7fe72cc00640 1 -- 172.21.15.63:0/1971376774 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe7180ac870 con 0x7fe7300adf60 2024-03-26T06:17:16.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.539+0000 7fe72fe00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe70c06bc00 0x7fe70c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.540+0000 7fe72fe00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe70c06bc00 0x7fe70c06e0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7300d0310 tx=0x7fe720009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:16.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.543+0000 7fe72cc00640 1 -- 172.21.15.63:0/1971376774 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe71804c030 con 0x7fe7300adf60 2024-03-26T06:17:16.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.744+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe73006b420 con 0x7fe7300adf60 2024-03-26T06:17:16.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.746+0000 7fe72cc00640 1 -- 172.21.15.63:0/1971376774 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe71807b130 con 0x7fe7300adf60 2024-03-26T06:17:16.746 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:16.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe70c06bc00 msgr2=0x7fe70c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe70c06bc00 0x7fe70c06e0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7300d0310 tx=0x7fe720009040 comp rx=0 tx=0).stop 2024-03-26T06:17:16.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7300adf60 msgr2=0x7fe73006e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7300adf60 0x7fe73006e660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe718035040 tx=0x7fe7180012d0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 shutdown_connections 2024-03-26T06:17:16.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe70c06bc00 0x7fe70c06e0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe73015b180 0x7fe7300b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7300adf60 0x7fe73006e660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 --2- 172.21.15.63:0/1971376774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7140040b0 0x7fe7300ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 >> 172.21.15.63:0/1971376774 conn(0x7fe73006ac90 msgr2=0x7fe73015d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:16.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 shutdown_connections 2024-03-26T06:17:16.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.749+0000 7fe736e00640 1 -- 172.21.15.63:0/1971376774 wait complete. 2024-03-26T06:17:16.767 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-26T06:17:16.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.987+0000 7fa458200640 1 Processor -- start 2024-03-26T06:17:16.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.988+0000 7fa458200640 1 -- start start 2024-03-26T06:17:16.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.990+0000 7fa458200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa45015dbb0 0x7fa4500d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.990+0000 7fa458200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4500d2490 con 0x7fa45015df90 2024-03-26T06:17:16.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.990+0000 7fa458200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4500d2770 con 0x7fa4500d0b30 2024-03-26T06:17:16.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.990+0000 7fa458200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4500d2a50 con 0x7fa45015dbb0 2024-03-26T06:17:16.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.990+0000 7fa455800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa45015dbb0 0x7fa4500d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.990+0000 7fa454e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa45015df90 0x7fa4500d0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40474/0 (socket says 172.21.15.63:40474) 2024-03-26T06:17:16.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.990+0000 7fa454e00640 1 -- 172.21.15.63:0/754101644 learned_addr learned my addr 172.21.15.63:0/754101644 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:16.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.990+0000 7fa455800640 1 -- 172.21.15.63:0/754101644 >> v1:172.21.15.204:6789/0 conn(0x7fa4500d0b30 legacy=0x7fa4500b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:16.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.990+0000 7fa455800640 1 -- 172.21.15.63:0/754101644 >> v1:172.21.15.63:6789/0 conn(0x7fa45015df90 legacy=0x7fa4500d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.991+0000 7fa455800640 1 -- 172.21.15.63:0/754101644 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4500d2d30 con 0x7fa45015dbb0 2024-03-26T06:17:16.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.992+0000 7fa455800640 1 --2- 172.21.15.63:0/754101644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015dbb0 0x7fa4500d1bb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4440097a0 tx=0x7fa44402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2579f4cdbd8695a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:16.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.992+0000 7fa44fe00640 1 -- 172.21.15.63:0/754101644 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444034070 con 0x7fa45015dbb0 2024-03-26T06:17:16.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.992+0000 7fa44fe00640 1 -- 172.21.15.63:0/754101644 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa444030610 con 0x7fa45015dbb0 2024-03-26T06:17:16.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.992+0000 7fa44fe00640 1 -- 172.21.15.63:0/754101644 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440309e0 con 0x7fa45015dbb0 2024-03-26T06:17:16.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.993+0000 7fa458200640 1 -- 172.21.15.63:0/754101644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015dbb0 msgr2=0x7fa4500d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.993+0000 7fa458200640 1 --2- 172.21.15.63:0/754101644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015dbb0 0x7fa4500d1bb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4440097a0 tx=0x7fa44402b960 comp rx=0 tx=0).stop 2024-03-26T06:17:16.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.993+0000 7fa458200640 1 -- 172.21.15.63:0/754101644 shutdown_connections 2024-03-26T06:17:16.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.993+0000 7fa458200640 1 --2- 172.21.15.63:0/754101644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015dbb0 0x7fa4500d1bb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.993+0000 7fa458200640 1 -- 172.21.15.63:0/754101644 >> 172.21.15.63:0/754101644 conn(0x7fa4500b5540 msgr2=0x7fa4500b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:16.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.993+0000 7fa458200640 1 -- 172.21.15.63:0/754101644 shutdown_connections 2024-03-26T06:17:16.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.993+0000 7fa458200640 1 -- 172.21.15.63:0/754101644 wait complete. 2024-03-26T06:17:16.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.995+0000 7fa458200640 1 Processor -- start 2024-03-26T06:17:16.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.995+0000 7fa458200640 1 -- start start 2024-03-26T06:17:16.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.996+0000 7fa458200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4500d0b30 0x7fa4501e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.996+0000 7fa458200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa45015dbb0 0x7fa45014fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.996+0000 7fa458200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015df90 0x7fa450150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:16.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.996+0000 7fa458200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500d36b0 con 0x7fa45015df90 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.996+0000 7fa458200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500d3530 con 0x7fa4500d0b30 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.996+0000 7fa458200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500b96e0 con 0x7fa45015dbb0 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.996+0000 7fa456200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015df90 0x7fa450150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa456200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015df90 0x7fa450150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57528/0 (socket says 172.21.15.63:57528) 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa456200640 1 -- 172.21.15.63:0/2515162057 learned_addr learned my addr 172.21.15.63:0/2515162057 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa455800640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4500d0b30 0x7fa4501e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa454e00640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa45015dbb0 0x7fa45014fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa456200640 1 -- 172.21.15.63:0/2515162057 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa45015dbb0 msgr2=0x7fa45014fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa456200640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa45015dbb0 0x7fa45014fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa456200640 1 -- 172.21.15.63:0/2515162057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4500d0b30 msgr2=0x7fa4501e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa456200640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4500d0b30 0x7fa4501e3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa456200640 1 -- 172.21.15.63:0/2515162057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4500cc1d0 con 0x7fa45015df90 2024-03-26T06:17:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.997+0000 7fa454e00640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa45015dbb0 0x7fa45014fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:16.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.998+0000 7fa456200640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015df90 0x7fa450150290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c6d0 tx=0x7fa44800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:16.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.998+0000 7fa44d600640 1 -- 172.21.15.63:0/2515162057 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa448016020 con 0x7fa45015df90 2024-03-26T06:17:16.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.998+0000 7fa44d600640 1 -- 172.21.15.63:0/2515162057 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44800a840 con 0x7fa45015df90 2024-03-26T06:17:16.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.998+0000 7fa44d600640 1 -- 172.21.15.63:0/2515162057 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800ac70 con 0x7fa45015df90 2024-03-26T06:17:17.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.998+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4500ccef0 con 0x7fa45015df90 2024-03-26T06:17:17.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.998+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45014d680 con 0x7fa45015df90 2024-03-26T06:17:17.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:16.999+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa450074730 con 0x7fa45015df90 2024-03-26T06:17:17.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.000+0000 7fa44d600640 1 -- 172.21.15.63:0/2515162057 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa448019020 con 0x7fa45015df90 2024-03-26T06:17:17.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.001+0000 7fa44d600640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa43006bbd0 0x7fa43006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:17.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.001+0000 7fa44d600640 1 -- 172.21.15.63:0/2515162057 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa44808b2b0 con 0x7fa45015df90 2024-03-26T06:17:17.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.001+0000 7fa455800640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa43006bbd0 0x7fa43006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:17.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.002+0000 7fa455800640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa43006bbd0 0x7fa43006e090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa444036000 tx=0x7fa44403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:17.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.005+0000 7fa44d600640 1 -- 172.21.15.63:0/2515162057 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa448020020 con 0x7fa45015df90 2024-03-26T06:17:17.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.219+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa45006ccb0 con 0x7fa45015df90 2024-03-26T06:17:17.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.220+0000 7fa44d600640 1 -- 172.21.15.63:0/2515162057 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa448059400 con 0x7fa45015df90 2024-03-26T06:17:17.220 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-03-26T06:17:17.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.222+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa43006bbd0 msgr2=0x7fa43006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.222+0000 7fa458200640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa43006bbd0 0x7fa43006e090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa444036000 tx=0x7fa44403b040 comp rx=0 tx=0).stop 2024-03-26T06:17:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.222+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015df90 msgr2=0x7fa450150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.222+0000 7fa458200640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015df90 0x7fa450150290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c6d0 tx=0x7fa44800cb90 comp rx=0 tx=0).stop 2024-03-26T06:17:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.223+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 shutdown_connections 2024-03-26T06:17:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.223+0000 7fa458200640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa43006bbd0 0x7fa43006e090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.223+0000 7fa458200640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa45015df90 0x7fa450150290 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.223+0000 7fa458200640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa45015dbb0 0x7fa45014fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.223+0000 7fa458200640 1 --2- 172.21.15.63:0/2515162057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4500d0b30 0x7fa4501e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.223+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 >> 172.21.15.63:0/2515162057 conn(0x7fa4500b5540 msgr2=0x7fa4500b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:17.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.223+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 shutdown_connections 2024-03-26T06:17:17.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.223+0000 7fa458200640 1 -- 172.21.15.63:0/2515162057 wait complete. 2024-03-26T06:17:17.240 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2024-03-26T06:17:17.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:17.240 DEBUG:teuthology.orchestra.run.smithi063:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-26T06:17:17.335 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[43706]: fuse finished with error 0 and tester_r 0 2024-03-26T06:17:17.342 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T06:17:17.409 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T06:17:17.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:17.409 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-26T06:17:17.470 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:17.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.691+0000 7f2401600640 1 Processor -- start 2024-03-26T06:17:17.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.691+0000 7f2401600640 1 -- start start 2024-03-26T06:17:17.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.692+0000 7f2401600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23fc071350 0x7f23fc0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:17.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.692+0000 7f2401600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f23fc0cc3f0 0x7f23fc0cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:17.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.692+0000 7f2401600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc15bf80 con 0x7f23fc145100 2024-03-26T06:17:17.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.693+0000 7f2401600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23fc0a86e0 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.693+0000 7f2401600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc071cf0 con 0x7f23fc071350 2024-03-26T06:17:17.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.693+0000 7f23faa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f23fc145100 0x7f23fc06ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40480/0 (socket says 172.21.15.63:40480) 2024-03-26T06:17:17.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.693+0000 7f23faa00640 1 -- 172.21.15.63:0/2165058283 learned_addr learned my addr 172.21.15.63:0/2165058283 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:17.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.693+0000 7f23fb400640 1 --2- 172.21.15.63:0/2165058283 >> v2:172.21.15.63:3300/0 conn(0x7f23fc0cc3f0 0x7f23fc0cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:17.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.693+0000 7f23f2000640 1 --2- 172.21.15.63:0/2165058283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23fc071350 0x7f23fc0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:17.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.693+0000 7f23fa000640 1 -- 172.21.15.63:0/2165058283 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426127423 0 0) 0x7f23fc15bf80 con 0x7f23fc145100 2024-03-26T06:17:17.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.693+0000 7f23fa000640 1 -- 172.21.15.63:0/2165058283 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e0003520 con 0x7f23fc145100 2024-03-26T06:17:17.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.694+0000 7f23fb400640 1 -- 172.21.15.63:0/2165058283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23fc071350 msgr2=0x7f23fc0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:17.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.694+0000 7f23fb400640 1 --2- 172.21.15.63:0/2165058283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23fc071350 0x7f23fc0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.694+0000 7f23fb400640 1 -- 172.21.15.63:0/2165058283 >> v1:172.21.15.63:6789/0 conn(0x7f23fc145100 legacy=0x7f23fc06ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:17.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.694+0000 7f23fb400640 1 -- 172.21.15.63:0/2165058283 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc06e2f0 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.695+0000 7f23fb400640 1 --2- 172.21.15.63:0/2165058283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 0x7f23fc0cc840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f23fc15c150 tx=0x7f23f402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc1555afe9412b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.695+0000 7f23fa000640 1 -- 172.21.15.63:0/2165058283 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4039070 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.695+0000 7f23fa000640 1 -- 172.21.15.63:0/2165058283 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f402cc40 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.695+0000 7f23fa000640 1 -- 172.21.15.63:0/2165058283 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4034440 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.696+0000 7f2401600640 1 -- 172.21.15.63:0/2165058283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 msgr2=0x7f23fc0cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.696+0000 7f2401600640 1 --2- 172.21.15.63:0/2165058283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 0x7f23fc0cc840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f23fc15c150 tx=0x7f23f402be90 comp rx=0 tx=0).stop 2024-03-26T06:17:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.696+0000 7f2401600640 1 -- 172.21.15.63:0/2165058283 shutdown_connections 2024-03-26T06:17:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.696+0000 7f2401600640 1 --2- 172.21.15.63:0/2165058283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 0x7f23fc0cc840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.696+0000 7f2401600640 1 --2- 172.21.15.63:0/2165058283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23fc071350 0x7f23fc0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.696+0000 7f2401600640 1 -- 172.21.15.63:0/2165058283 >> 172.21.15.63:0/2165058283 conn(0x7f23fc06ac90 msgr2=0x7f23fc06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:17.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.696+0000 7f2401600640 1 -- 172.21.15.63:0/2165058283 shutdown_connections 2024-03-26T06:17:17.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.696+0000 7f2401600640 1 -- 172.21.15.63:0/2165058283 wait complete. 2024-03-26T06:17:17.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.698+0000 7f2401600640 1 Processor -- start 2024-03-26T06:17:17.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.698+0000 7f2401600640 1 -- start start 2024-03-26T06:17:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f2401600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23fc071350 0x7f23fc15de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f2401600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 0x7f23fc157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f2401600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23fc145100 0x7f23fc0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f2401600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc06dd30 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f2401600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc06da50 con 0x7f23fc071350 2024-03-26T06:17:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f2401600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc06e010 con 0x7f23fc145100 2024-03-26T06:17:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f23f2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 0x7f23fc157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f23f2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 0x7f23fc157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57552/0 (socket says 172.21.15.63:57552) 2024-03-26T06:17:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f23f2000640 1 -- 172.21.15.63:0/2497868367 learned_addr learned my addr 172.21.15.63:0/2497868367 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:17.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f23f2000640 1 -- 172.21.15.63:0/2497868367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23fc145100 msgr2=0x7f23fc0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f23f2000640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23fc145100 0x7f23fc0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f23f2000640 1 -- 172.21.15.63:0/2497868367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23fc071350 msgr2=0x7f23fc15de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f23f2000640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23fc071350 0x7f23fc15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.699+0000 7f23f2000640 1 -- 172.21.15.63:0/2497868367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc0b4210 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.700+0000 7f23f2000640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 0x7f23fc157680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23e400d800 tx=0x7f23e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.700+0000 7f23f3400640 1 -- 172.21.15.63:0/2497868367 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e400b6c0 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.700+0000 7f23f3400640 1 -- 172.21.15.63:0/2497868367 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e4019070 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.700+0000 7f23f3400640 1 -- 172.21.15.63:0/2497868367 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e400ba80 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.700+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc0b44f0 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.700+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc157bc0 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.701+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc074730 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.702+0000 7f23f3400640 1 -- 172.21.15.63:0/2497868367 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f23e400bc20 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.703+0000 7f23f3400640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f23d806bc00 0x7f23d806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:17.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.703+0000 7f23f3400640 1 -- 172.21.15.63:0/2497868367 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f23e408b280 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.703+0000 7f23faa00640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f23d806bc00 0x7f23d806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:17.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.704+0000 7f23faa00640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f23d806bc00 0x7f23d806e0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000f60 tx=0x7f23ec0078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:17.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.708+0000 7f23f3400640 1 -- 172.21.15.63:0/2497868367 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f23e401c360 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:17:17.823 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:17:17.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.912+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23fc0afbe0 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.914+0000 7f23f3400640 1 -- 172.21.15.63:0/2497868367 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f23e4059a20 con 0x7f23fc0cc3f0 2024-03-26T06:17:17.914 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:17.915 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:17.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f23d806bc00 msgr2=0x7f23d806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:17.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f23d806bc00 0x7f23d806e0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000f60 tx=0x7f23ec0078f0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 msgr2=0x7f23fc157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:17.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 0x7f23fc157680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23e400d800 tx=0x7f23e400dcc0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 shutdown_connections 2024-03-26T06:17:17.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f23d806bc00 0x7f23d806e0c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23fc145100 0x7f23fc0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23fc0cc3f0 0x7f23fc157680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 --2- 172.21.15.63:0/2497868367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23fc071350 0x7f23fc15de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:17.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 >> 172.21.15.63:0/2497868367 conn(0x7f23fc06ac90 msgr2=0x7f23fc06e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:17.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 shutdown_connections 2024-03-26T06:17:17.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:17.917+0000 7f2401600640 1 -- 172.21.15.63:0/2497868367 wait complete. 2024-03-26T06:17:17.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:18.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.205+0000 7f2cba600640 1 Processor -- start 2024-03-26T06:17:18.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.205+0000 7f2cba600640 1 -- start start 2024-03-26T06:17:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cba600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb4071350 0x7f2cb40717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cba600640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2cb40ade20 0x7f2cb40ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cba600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb40af1d0 con 0x7f2cb41440f0 2024-03-26T06:17:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cba600640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb40aec10 con 0x7f2cb40ade20 2024-03-26T06:17:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cba600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40aeef0 con 0x7f2cb4071350 2024-03-26T06:17:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cb3400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2cb41440f0 0x7f2cb415f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40496/0 (socket says 172.21.15.63:40496) 2024-03-26T06:17:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cb3400640 1 -- 172.21.15.63:0/2564602186 learned_addr learned my addr 172.21.15.63:0/2564602186 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cb2a00640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb4071350 0x7f2cb40717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976809221 0 0) 0x7f2cb40af1d0 con 0x7f2cb41440f0 2024-03-26T06:17:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cb3e00640 1 --2- 172.21.15.63:0/2564602186 >> v2:172.21.15.204:3300/0 conn(0x7f2cb40ade20 0x7f2cb40ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.207+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c98003520 con 0x7f2cb41440f0 2024-03-26T06:17:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3923358113 0 0) 0x7f2c98003520 con 0x7f2cb41440f0 2024-03-26T06:17:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb4071350 msgr2=0x7f2cb40717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb4071350 0x7f2cb40717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 >> v2:172.21.15.204:3300/0 conn(0x7f2cb40ade20 msgr2=0x7f2cb40ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 --2- 172.21.15.63:0/2564602186 >> v2:172.21.15.204:3300/0 conn(0x7f2cb40ade20 0x7f2cb40ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb406d450 con 0x7f2cb41440f0 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f2ca40019f0 con 0x7f2cb41440f0 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 >> v1:172.21.15.63:6789/0 conn(0x7f2cb41440f0 legacy=0x7f2cb415f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2c98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb4071350 0x7f2c98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2c98004d40 0x7f2c980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40aec10 con 0x7f2c980039b0 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40aeef0 con 0x7f2c98004d40 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9800ba40 con 0x7f2cb4071350 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb3e00640 1 --2- 172.21.15.63:0/2564602186 >> v2:172.21.15.204:3300/0 conn(0x7f2cb40ade20 0x7f2cb40ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb3400640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2c98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.208+0000 7f2cb2a00640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb4071350 0x7f2c98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.209+0000 7f2cb3400640 1 -- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb4071350 msgr2=0x7f2c98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.209+0000 7f2cb3400640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb4071350 0x7f2c98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.209+0000 7f2cb3400640 1 -- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2c98004d40 msgr2=0x7f2c980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:18.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.209+0000 7f2cb3400640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2c98004d40 0x7f2c980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.209+0000 7f2cb3400640 1 -- 172.21.15.63:0/2564602186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98003520 con 0x7f2c980039b0 2024-03-26T06:17:18.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.209+0000 7f2cb2a00640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb4071350 0x7f2c98004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.210+0000 7f2cb3400640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2c98003dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400a7d0 tx=0x7f2c98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ec8c602c396258 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.210+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400a3f0 con 0x7f2c980039b0 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.210+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4034630 con 0x7f2c980039b0 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.210+0000 7f2cb2000640 1 -- 172.21.15.63:0/2564602186 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca402ce60 con 0x7f2c980039b0 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.211+0000 7f2cba600640 1 -- 172.21.15.63:0/2564602186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 msgr2=0x7f2c98003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.211+0000 7f2cba600640 1 --2- 172.21.15.63:0/2564602186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2c98003dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400a7d0 tx=0x7f2c98005830 comp rx=0 tx=0).stop 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.211+0000 7f2cb3e00640 1 -- 172.21.15.63:0/2564602186 reap_dead start 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.211+0000 7f2cba600640 1 -- 172.21.15.63:0/2564602186 shutdown_connections 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.211+0000 7f2cba600640 1 -- 172.21.15.63:0/2564602186 >> 172.21.15.63:0/2564602186 conn(0x7f2cb406ac90 msgr2=0x7f2cb406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.211+0000 7f2cba600640 1 -- 172.21.15.63:0/2564602186 shutdown_connections 2024-03-26T06:17:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.211+0000 7f2cba600640 1 -- 172.21.15.63:0/2564602186 wait complete. 2024-03-26T06:17:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.213+0000 7f2cba600640 1 Processor -- start 2024-03-26T06:17:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.213+0000 7f2cba600640 1 -- start start 2024-03-26T06:17:18.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cba600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2cb41597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cba600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cb41588a0 0x7f2cb41f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cba600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb41f6760 0x7f2cb415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cba600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40ae970 con 0x7f2c980039b0 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cba600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40ae7f0 con 0x7f2cb41588a0 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cba600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40717d0 con 0x7f2cb41f6760 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cb3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2cb41597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cb3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2cb41597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57570/0 (socket says 172.21.15.63:57570) 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cb3400640 1 -- 172.21.15.63:0/3220853416 learned_addr learned my addr 172.21.15.63:0/3220853416 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cb3400640 1 -- 172.21.15.63:0/3220853416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb41f6760 msgr2=0x7f2cb415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cb3400640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb41f6760 0x7f2cb415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cb3400640 1 -- 172.21.15.63:0/3220853416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cb41588a0 msgr2=0x7f2cb41f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cb3400640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cb41588a0 0x7f2cb41f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.214+0000 7f2cb3400640 1 -- 172.21.15.63:0/3220853416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40cc2f0 con 0x7f2c980039b0 2024-03-26T06:17:18.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.215+0000 7f2cb3400640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2cb41597c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400a8f0 tx=0x7f2ca4001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:18.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.215+0000 7f2cab400640 1 -- 172.21.15.63:0/3220853416 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4043020 con 0x7f2c980039b0 2024-03-26T06:17:18.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.215+0000 7f2cab400640 1 -- 172.21.15.63:0/3220853416 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca403a040 con 0x7f2c980039b0 2024-03-26T06:17:18.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.215+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb40cc5d0 con 0x7f2c980039b0 2024-03-26T06:17:18.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.215+0000 7f2cab400640 1 -- 172.21.15.63:0/3220853416 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4034c10 con 0x7f2c980039b0 2024-03-26T06:17:18.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.215+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb40ccb90 con 0x7f2c980039b0 2024-03-26T06:17:18.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.216+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb4074730 con 0x7f2c980039b0 2024-03-26T06:17:18.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.217+0000 7f2cab400640 1 -- 172.21.15.63:0/3220853416 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2ca4046020 con 0x7f2c980039b0 2024-03-26T06:17:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.218+0000 7f2cab400640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c9006bbd0 0x7f2c9006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.218+0000 7f2cab400640 1 -- 172.21.15.63:0/3220853416 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2ca40ad1c0 con 0x7f2c980039b0 2024-03-26T06:17:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.218+0000 7f2cb2a00640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c9006bbd0 0x7f2c9006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.219+0000 7f2cb2a00640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c9006bbd0 0x7f2c9006e090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40cf620 tx=0x7f2c9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:18.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.223+0000 7f2cab400640 1 -- 172.21.15.63:0/3220853416 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2ca404d030 con 0x7f2c980039b0 2024-03-26T06:17:18.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.424+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cb4071f10 con 0x7f2c980039b0 2024-03-26T06:17:18.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.425+0000 7f2cab400640 1 -- 172.21.15.63:0/3220853416 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f2ca407b8d0 con 0x7f2c980039b0 2024-03-26T06:17:18.426 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:18.426 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.428+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c9006bbd0 msgr2=0x7f2c9006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.428+0000 7f2cba600640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c9006bbd0 0x7f2c9006e090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40cf620 tx=0x7f2c9c008040 comp rx=0 tx=0).stop 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.428+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 msgr2=0x7f2cb41597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.428+0000 7f2cba600640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2cb41597c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400a8f0 tx=0x7f2ca4001cf0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.429+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 shutdown_connections 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.429+0000 7f2cba600640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c9006bbd0 0x7f2c9006e090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.429+0000 7f2cba600640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cb41f6760 0x7f2cb415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.429+0000 7f2cba600640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cb41588a0 0x7f2cb41f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.429+0000 7f2cba600640 1 --2- 172.21.15.63:0/3220853416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c980039b0 0x7f2cb41597c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.429+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 >> 172.21.15.63:0/3220853416 conn(0x7f2cb406ac90 msgr2=0x7f2cb40afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:18.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.429+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 shutdown_connections 2024-03-26T06:17:18.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.429+0000 7f2cba600640 1 -- 172.21.15.63:0/3220853416 wait complete. 2024-03-26T06:17:18.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-26T06:17:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.669+0000 7f28d5a00640 1 Processor -- start 2024-03-26T06:17:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.670+0000 7f28d5a00640 1 -- start start 2024-03-26T06:17:18.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.671+0000 7f28d5a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f28d015dbb0 0x7f28d00d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.671+0000 7f28d5a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f28d00d0b30 0x7f28d00b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.671+0000 7f28d5a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d00d2490 con 0x7f28d015df90 2024-03-26T06:17:18.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.671+0000 7f28d5a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d00d2770 con 0x7f28d00d0b30 2024-03-26T06:17:18.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.671+0000 7f28d5a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d00d2a50 con 0x7f28d015dbb0 2024-03-26T06:17:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.672+0000 7f28cf400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f28d00d0b30 0x7f28d00b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.672+0000 7f28cf400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f28d00d0b30 0x7f28d00b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57582/0 (socket says 172.21.15.63:57582) 2024-03-26T06:17:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.672+0000 7f28cf400640 1 -- 172.21.15.63:0/412787057 learned_addr learned my addr 172.21.15.63:0/412787057 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.672+0000 7f28cea00640 1 --2- 172.21.15.63:0/412787057 >> v2:172.21.15.204:3300/0 conn(0x7f28d015dbb0 0x7f28d00d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.672+0000 7f28cf400640 1 -- 172.21.15.63:0/412787057 >> v2:172.21.15.204:3300/0 conn(0x7f28d015dbb0 msgr2=0x7f28d00d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.672+0000 7f28cf400640 1 --2- 172.21.15.63:0/412787057 >> v2:172.21.15.204:3300/0 conn(0x7f28d015dbb0 0x7f28d00d1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.672+0000 7f28cf400640 1 -- 172.21.15.63:0/412787057 >> v1:172.21.15.204:6789/0 conn(0x7f28d015df90 legacy=0x7f28d00d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.672+0000 7f28cf400640 1 -- 172.21.15.63:0/412787057 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00d2d30 con 0x7f28d00d0b30 2024-03-26T06:17:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.673+0000 7f28cf400640 1 --2- 172.21.15.63:0/412787057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 0x7f28d00b6bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28d00ce280 tx=0x7f28c802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599b6e76f07635e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.674+0000 7f28cd600640 1 -- 172.21.15.63:0/412787057 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c802f850 con 0x7f28d00d0b30 2024-03-26T06:17:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.674+0000 7f28cd600640 1 -- 172.21.15.63:0/412787057 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c802f9f0 con 0x7f28d00d0b30 2024-03-26T06:17:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.674+0000 7f28cd600640 1 -- 172.21.15.63:0/412787057 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c802fdc0 con 0x7f28d00d0b30 2024-03-26T06:17:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.674+0000 7f28d5a00640 1 -- 172.21.15.63:0/412787057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 msgr2=0x7f28d00b6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.674+0000 7f28d5a00640 1 --2- 172.21.15.63:0/412787057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 0x7f28d00b6bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28d00ce280 tx=0x7f28c802ba30 comp rx=0 tx=0).stop 2024-03-26T06:17:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.675+0000 7f28d5a00640 1 -- 172.21.15.63:0/412787057 shutdown_connections 2024-03-26T06:17:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.675+0000 7f28d5a00640 1 --2- 172.21.15.63:0/412787057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 0x7f28d00b6bd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.675+0000 7f28d5a00640 1 --2- 172.21.15.63:0/412787057 >> v2:172.21.15.204:3300/0 conn(0x7f28d015dbb0 0x7f28d00d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.675+0000 7f28d5a00640 1 -- 172.21.15.63:0/412787057 >> 172.21.15.63:0/412787057 conn(0x7f28d00b5540 msgr2=0x7f28d00b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.675+0000 7f28d5a00640 1 -- 172.21.15.63:0/412787057 shutdown_connections 2024-03-26T06:17:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.675+0000 7f28d5a00640 1 -- 172.21.15.63:0/412787057 wait complete. 2024-03-26T06:17:18.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.676+0000 7f28d5a00640 1 Processor -- start 2024-03-26T06:17:18.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.676+0000 7f28d5a00640 1 -- start start 2024-03-26T06:17:18.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.677+0000 7f28d5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 0x7f28d00cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.677+0000 7f28d5a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28d015dbb0 0x7f28d01563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.677+0000 7f28d5a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28d015df90 0x7f28d014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.677+0000 7f28d5a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00d36b0 con 0x7f28d00d0b30 2024-03-26T06:17:18.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.677+0000 7f28d5a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00d3530 con 0x7f28d015df90 2024-03-26T06:17:18.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.677+0000 7f28d5a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00b96e0 con 0x7f28d015dbb0 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28cea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 0x7f28d00cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28cea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 0x7f28d00cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57584/0 (socket says 172.21.15.63:57584) 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28cea00640 1 -- 172.21.15.63:0/2441581583 learned_addr learned my addr 172.21.15.63:0/2441581583 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28cf400640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28d015df90 0x7f28d014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28cea00640 1 -- 172.21.15.63:0/2441581583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28d015dbb0 msgr2=0x7f28d01563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28ce000640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28d015dbb0 0x7f28d01563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28cea00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28d015dbb0 0x7f28d01563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28cea00640 1 -- 172.21.15.63:0/2441581583 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28d015df90 msgr2=0x7f28d014ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28cea00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28d015df90 0x7f28d014ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.678+0000 7f28cea00640 1 -- 172.21.15.63:0/2441581583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00c8a00 con 0x7f28d00d0b30 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.679+0000 7f28cea00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 0x7f28d00cbef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28c000e9b0 tx=0x7f28c000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.679+0000 7f28c6a00640 1 -- 172.21.15.63:0/2441581583 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0017070 con 0x7f28d00d0b30 2024-03-26T06:17:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.679+0000 7f28c6a00640 1 -- 172.21.15.63:0/2441581583 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c000c9a0 con 0x7f28d00d0b30 2024-03-26T06:17:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.679+0000 7f28c6a00640 1 -- 172.21.15.63:0/2441581583 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c000cd90 con 0x7f28d00d0b30 2024-03-26T06:17:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.679+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d00c8ce0 con 0x7f28d00d0b30 2024-03-26T06:17:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.679+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d00c92a0 con 0x7f28d00d0b30 2024-03-26T06:17:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.681+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d0074730 con 0x7f28d00d0b30 2024-03-26T06:17:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.681+0000 7f28c6a00640 1 -- 172.21.15.63:0/2441581583 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f28c001a070 con 0x7f28d00d0b30 2024-03-26T06:17:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.682+0000 7f28c6a00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f28ac06bbd0 0x7f28ac06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.682+0000 7f28c6a00640 1 -- 172.21.15.63:0/2441581583 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f28c008ae20 con 0x7f28d00d0b30 2024-03-26T06:17:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.682+0000 7f28ce000640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f28ac06bbd0 0x7f28ac06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:18.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.683+0000 7f28ce000640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f28ac06bbd0 0x7f28ac06e090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28b8007fd0 tx=0x7f28b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.687+0000 7f28c6a00640 1 -- 172.21.15.63:0/2441581583 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f28c00595d0 con 0x7f28d00d0b30 2024-03-26T06:17:18.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:18.931+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f28d0156ad0 con 0x7f28d00d0b30 2024-03-26T06:17:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.624+0000 7f28c6a00640 1 -- 172.21.15.63:0/2441581583 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f28c0058ed0 con 0x7f28d00d0b30 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.627+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f28ac06bbd0 msgr2=0x7f28ac06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.627+0000 7f28d5a00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f28ac06bbd0 0x7f28ac06e090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28b8007fd0 tx=0x7f28b8009040 comp rx=0 tx=0).stop 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.627+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 msgr2=0x7f28d00cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.627+0000 7f28d5a00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 0x7f28d00cbef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28c000e9b0 tx=0x7f28c000ee70 comp rx=0 tx=0).stop 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.628+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 shutdown_connections 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.628+0000 7f28d5a00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f28ac06bbd0 0x7f28ac06e090 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.628+0000 7f28d5a00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28d015df90 0x7f28d014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.628+0000 7f28d5a00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28d015dbb0 0x7f28d01563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.628+0000 7f28d5a00640 1 --2- 172.21.15.63:0/2441581583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d00d0b30 0x7f28d00cbef0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.628+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 >> 172.21.15.63:0/2441581583 conn(0x7f28d00b5540 msgr2=0x7f28d00b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.628+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 shutdown_connections 2024-03-26T06:17:19.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.628+0000 7f28d5a00640 1 -- 172.21.15.63:0/2441581583 wait complete. 2024-03-26T06:17:19.651 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-03-26T06:17:19.652 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-26T06:17:19.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.873+0000 7f761f200640 1 Processor -- start 2024-03-26T06:17:19.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.873+0000 7f761f200640 1 -- start start 2024-03-26T06:17:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.875+0000 7f761f200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200d3840 0x7f76200d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.875+0000 7f761f200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f76200b9320 0x7f76200b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.875+0000 7f761f200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76200d4160 con 0x7f762015dca0 2024-03-26T06:17:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.875+0000 7f761f200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76200d2070 con 0x7f76200b9320 2024-03-26T06:17:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.875+0000 7f761f200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200d22d0 con 0x7f76200d3840 2024-03-26T06:17:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.875+0000 7f7615400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f762015dca0 0x7f76200d1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40500/0 (socket says 172.21.15.63:40500) 2024-03-26T06:17:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.875+0000 7f7615400640 1 -- 172.21.15.63:0/2355282279 learned_addr learned my addr 172.21.15.63:0/2355282279 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.875+0000 7f761e800640 1 --2- 172.21.15.63:0/2355282279 >> v2:172.21.15.63:3300/0 conn(0x7f76200b9320 0x7f76200b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:19.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.876+0000 7f761de00640 1 --2- 172.21.15.63:0/2355282279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200d3840 0x7f76200d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:19.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.876+0000 7f761d400640 1 -- 172.21.15.63:0/2355282279 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690659676 0 0) 0x7f76200d4160 con 0x7f762015dca0 2024-03-26T06:17:19.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.876+0000 7f761d400640 1 -- 172.21.15.63:0/2355282279 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7604003520 con 0x7f762015dca0 2024-03-26T06:17:19.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.876+0000 7f761e800640 1 -- 172.21.15.63:0/2355282279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200d3840 msgr2=0x7f76200d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:19.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.876+0000 7f761e800640 1 --2- 172.21.15.63:0/2355282279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200d3840 0x7f76200d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.876+0000 7f761e800640 1 -- 172.21.15.63:0/2355282279 >> v1:172.21.15.63:6789/0 conn(0x7f762015dca0 legacy=0x7f76200d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:19.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.876+0000 7f761e800640 1 -- 172.21.15.63:0/2355282279 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200d25b0 con 0x7f76200b9320 2024-03-26T06:17:19.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.877+0000 7f761e800640 1 --2- 172.21.15.63:0/2355282279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76200b9320 0x7f76200b6a50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f76180097a0 tx=0x7f761802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b25cd6eb10f99c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:19.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.877+0000 7f761d400640 1 -- 172.21.15.63:0/2355282279 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618035020 con 0x7f76200b9320 2024-03-26T06:17:19.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.877+0000 7f761d400640 1 -- 172.21.15.63:0/2355282279 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7618031810 con 0x7f76200b9320 2024-03-26T06:17:19.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.877+0000 7f761d400640 1 -- 172.21.15.63:0/2355282279 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618031be0 con 0x7f76200b9320 2024-03-26T06:17:19.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.878+0000 7f761f200640 1 -- 172.21.15.63:0/2355282279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76200b9320 msgr2=0x7f76200b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:19.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.878+0000 7f761f200640 1 --2- 172.21.15.63:0/2355282279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76200b9320 0x7f76200b6a50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f76180097a0 tx=0x7f761802b8b0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.878+0000 7f761f200640 1 -- 172.21.15.63:0/2355282279 shutdown_connections 2024-03-26T06:17:19.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.878+0000 7f761f200640 1 --2- 172.21.15.63:0/2355282279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76200b9320 0x7f76200b6a50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.878+0000 7f761f200640 1 --2- 172.21.15.63:0/2355282279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200d3840 0x7f76200d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.878+0000 7f761f200640 1 -- 172.21.15.63:0/2355282279 >> 172.21.15.63:0/2355282279 conn(0x7f762006c570 msgr2=0x7f762006c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:19.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.878+0000 7f761f200640 1 -- 172.21.15.63:0/2355282279 shutdown_connections 2024-03-26T06:17:19.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.878+0000 7f761f200640 1 -- 172.21.15.63:0/2355282279 wait complete. 2024-03-26T06:17:19.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.880+0000 7f761f200640 1 Processor -- start 2024-03-26T06:17:19.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.880+0000 7f761f200640 1 -- start start 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.881+0000 7f761f200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200b9320 0x7f76201f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.881+0000 7f761f200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76200d3840 0x7f762015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.881+0000 7f761f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f762015dca0 0x7f76200c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.881+0000 7f761f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76200d2e50 con 0x7f762015dca0 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.881+0000 7f761f200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76200d2b70 con 0x7f76200d3840 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.881+0000 7f761f200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200d3370 con 0x7f76200b9320 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.881+0000 7f761e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f762015dca0 0x7f76200c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.881+0000 7f761e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f762015dca0 0x7f76200c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57612/0 (socket says 172.21.15.63:57612) 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.881+0000 7f761e800640 1 -- 172.21.15.63:0/1611504395 learned_addr learned my addr 172.21.15.63:0/1611504395 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f761de00640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200b9320 0x7f76201f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f7615400640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76200d3840 0x7f762015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f761e800640 1 -- 172.21.15.63:0/1611504395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200b9320 msgr2=0x7f76201f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:19.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f761e800640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200b9320 0x7f76201f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f761e800640 1 -- 172.21.15.63:0/1611504395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76200d3840 msgr2=0x7f762015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:19.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f761e800640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76200d3840 0x7f762015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:19.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f761e800640 1 -- 172.21.15.63:0/1611504395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200caa20 con 0x7f762015dca0 2024-03-26T06:17:19.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f761e800640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f762015dca0 0x7f76200c97b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f76180098c0 tx=0x7f76180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:19.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f7616a00640 1 -- 172.21.15.63:0/1611504395 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618041070 con 0x7f762015dca0 2024-03-26T06:17:19.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f7616a00640 1 -- 172.21.15.63:0/1611504395 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7618031e40 con 0x7f762015dca0 2024-03-26T06:17:19.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.882+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76200cd420 con 0x7f762015dca0 2024-03-26T06:17:19.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.883+0000 7f7616a00640 1 -- 172.21.15.63:0/1611504395 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618035040 con 0x7f762015dca0 2024-03-26T06:17:19.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.883+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76201f2ef0 con 0x7f762015dca0 2024-03-26T06:17:19.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.884+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762004f0c0 con 0x7f762015dca0 2024-03-26T06:17:19.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.885+0000 7f7616a00640 1 -- 172.21.15.63:0/1611504395 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7618038020 con 0x7f762015dca0 2024-03-26T06:17:19.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.886+0000 7f7616a00640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f75fc06bbd0 0x7f75fc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:19.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.886+0000 7f7616a00640 1 -- 172.21.15.63:0/1611504395 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f76180ac8d0 con 0x7f762015dca0 2024-03-26T06:17:19.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.887+0000 7f761de00640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f75fc06bbd0 0x7f75fc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:19.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.887+0000 7f761de00640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f75fc06bbd0 0x7f75fc06e090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76100074a0 tx=0x7f761000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:19.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:19.891+0000 7f7616a00640 1 -- 172.21.15.63:0/1611504395 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f76200cd420 con 0x7f762015dca0 2024-03-26T06:17:20.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.130+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f76200cf1e0 con 0x7f762015dca0 2024-03-26T06:17:20.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.642+0000 7f7616a00640 1 -- 172.21.15.63:0/1611504395 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f761807b080 con 0x7f762015dca0 2024-03-26T06:17:20.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.645+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f75fc06bbd0 msgr2=0x7f75fc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:20.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.645+0000 7f761f200640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f75fc06bbd0 0x7f75fc06e090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76100074a0 tx=0x7f761000b040 comp rx=0 tx=0).stop 2024-03-26T06:17:20.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.645+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f762015dca0 msgr2=0x7f76200c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:20.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.645+0000 7f761f200640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f762015dca0 0x7f76200c97b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f76180098c0 tx=0x7f76180046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.646+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 shutdown_connections 2024-03-26T06:17:20.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.646+0000 7f761f200640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f75fc06bbd0 0x7f75fc06e090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.646+0000 7f761f200640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f762015dca0 0x7f76200c97b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.646+0000 7f761f200640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76200d3840 0x7f762015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.646+0000 7f761f200640 1 --2- 172.21.15.63:0/1611504395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76200b9320 0x7f76201f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.646+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 >> 172.21.15.63:0/1611504395 conn(0x7f762006c570 msgr2=0x7f76200b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:20.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.646+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 shutdown_connections 2024-03-26T06:17:20.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.646+0000 7f761f200640 1 -- 172.21.15.63:0/1611504395 wait complete. 2024-03-26T06:17:20.667 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-26T06:17:20.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:17:20.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.884+0000 7fdaa4a00640 1 Processor -- start 2024-03-26T06:17:20.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.885+0000 7fdaa4a00640 1 -- start start 2024-03-26T06:17:20.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.886+0000 7fdaa4a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdaa00ced60 0x7fdaa006e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.886+0000 7fdaa4a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdaa0071a60 0x7fdaa0162710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.886+0000 7fdaa4a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa0163490 con 0x7fdaa00cf140 2024-03-26T06:17:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.886+0000 7fdaa4a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa006e750 con 0x7fdaa00ced60 2024-03-26T06:17:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.886+0000 7fdaa4a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa006d450 con 0x7fdaa0071a60 2024-03-26T06:17:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.887+0000 7fda9de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdaa00ced60 0x7fdaa006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.887+0000 7fda9de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdaa00ced60 0x7fdaa006e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49554/0 (socket says 172.21.15.63:49554) 2024-03-26T06:17:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.887+0000 7fda9de00640 1 -- 172.21.15.63:0/261690790 learned_addr learned my addr 172.21.15.63:0/261690790 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:20.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.887+0000 7fda9de00640 1 -- 172.21.15.63:0/261690790 >> v2:172.21.15.204:3300/0 conn(0x7fdaa0071a60 msgr2=0x7fdaa0162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:20.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.887+0000 7fda9de00640 1 --2- 172.21.15.63:0/261690790 >> v2:172.21.15.204:3300/0 conn(0x7fdaa0071a60 0x7fdaa0162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.887+0000 7fda9de00640 1 -- 172.21.15.63:0/261690790 >> v1:172.21.15.204:6789/0 conn(0x7fdaa00cf140 legacy=0x7fdaa0071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:20.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.887+0000 7fda9de00640 1 -- 172.21.15.63:0/261690790 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa006d730 con 0x7fdaa00ced60 2024-03-26T06:17:20.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.888+0000 7fda9de00640 1 --2- 172.21.15.63:0/261690790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 0x7fdaa006e210 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00712e0 tx=0x7fda9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb84afcfba5561ba server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:20.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.889+0000 7fda9d400640 1 -- 172.21.15.63:0/261690790 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90035020 con 0x7fdaa00ced60 2024-03-26T06:17:20.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.889+0000 7fda9d400640 1 -- 172.21.15.63:0/261690790 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90031870 con 0x7fdaa00ced60 2024-03-26T06:17:20.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.889+0000 7fda9d400640 1 -- 172.21.15.63:0/261690790 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90031c40 con 0x7fdaa00ced60 2024-03-26T06:17:20.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.889+0000 7fdaa4a00640 1 -- 172.21.15.63:0/261690790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 msgr2=0x7fdaa006e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:20.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.889+0000 7fdaa4a00640 1 --2- 172.21.15.63:0/261690790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 0x7fdaa006e210 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00712e0 tx=0x7fda9002b910 comp rx=0 tx=0).stop 2024-03-26T06:17:20.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.889+0000 7fdaa4a00640 1 -- 172.21.15.63:0/261690790 shutdown_connections 2024-03-26T06:17:20.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.889+0000 7fdaa4a00640 1 --2- 172.21.15.63:0/261690790 >> v2:172.21.15.204:3300/0 conn(0x7fdaa0071a60 0x7fdaa0162710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.889+0000 7fdaa4a00640 1 --2- 172.21.15.63:0/261690790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 0x7fdaa006e210 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.889+0000 7fdaa4a00640 1 -- 172.21.15.63:0/261690790 >> 172.21.15.63:0/261690790 conn(0x7fdaa006ac90 msgr2=0x7fdaa006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:20.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.890+0000 7fdaa4a00640 1 -- 172.21.15.63:0/261690790 shutdown_connections 2024-03-26T06:17:20.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.890+0000 7fdaa4a00640 1 -- 172.21.15.63:0/261690790 wait complete. 2024-03-26T06:17:20.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.892+0000 7fdaa4a00640 1 Processor -- start 2024-03-26T06:17:20.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.892+0000 7fdaa4a00640 1 -- start start 2024-03-26T06:17:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.893+0000 7fdaa4a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdaa0071a60 0x7fdaa00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.893+0000 7fdaa4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 0x7fdaa0153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.893+0000 7fdaa4a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdaa00cf140 0x7fdaa01610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.893+0000 7fdaa4a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0162c50 con 0x7fdaa00ced60 2024-03-26T06:17:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.893+0000 7fdaa4a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa006dcf0 con 0x7fdaa00cf140 2024-03-26T06:17:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.893+0000 7fdaa4a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0162dd0 con 0x7fdaa0071a60 2024-03-26T06:17:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.893+0000 7fda97e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 0x7fdaa0153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.893+0000 7fda97e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 0x7fdaa0153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49560/0 (socket says 172.21.15.63:49560) 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.893+0000 7fda97e00640 1 -- 172.21.15.63:0/2250358210 learned_addr learned my addr 172.21.15.63:0/2250358210 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.894+0000 7fda9e800640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdaa00cf140 0x7fdaa01610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.894+0000 7fda9de00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdaa0071a60 0x7fdaa00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.894+0000 7fda97e00640 1 -- 172.21.15.63:0/2250358210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdaa0071a60 msgr2=0x7fdaa00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.894+0000 7fda97e00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdaa0071a60 0x7fdaa00b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.894+0000 7fda97e00640 1 -- 172.21.15.63:0/2250358210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdaa00cf140 msgr2=0x7fdaa01610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.894+0000 7fda97e00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdaa00cf140 0x7fdaa01610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.894+0000 7fda97e00640 1 -- 172.21.15.63:0/2250358210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa0161620 con 0x7fdaa00ced60 2024-03-26T06:17:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.894+0000 7fda97e00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 0x7fdaa0153f70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c410 tx=0x7fda8800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.895+0000 7fda96000640 1 -- 172.21.15.63:0/2250358210 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88017070 con 0x7fdaa00ced60 2024-03-26T06:17:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.895+0000 7fda96000640 1 -- 172.21.15.63:0/2250358210 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda880035f0 con 0x7fdaa00ced60 2024-03-26T06:17:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.895+0000 7fda96000640 1 -- 172.21.15.63:0/2250358210 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88003a20 con 0x7fdaa00ced60 2024-03-26T06:17:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.895+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa01618c0 con 0x7fdaa00ced60 2024-03-26T06:17:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.895+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa0161e80 con 0x7fdaa00ced60 2024-03-26T06:17:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.896+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa0074730 con 0x7fdaa00ced60 2024-03-26T06:17:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.897+0000 7fda96000640 1 -- 172.21.15.63:0/2250358210 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fda88003bc0 con 0x7fdaa00ced60 2024-03-26T06:17:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.898+0000 7fda96000640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda7c06bbd0 0x7fda7c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.898+0000 7fda96000640 1 -- 172.21.15.63:0/2250358210 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fda8808a100 con 0x7fdaa00ced60 2024-03-26T06:17:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.898+0000 7fda9de00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda7c06bbd0 0x7fda7c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.899+0000 7fda9de00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda7c06bbd0 0x7fda7c06e090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda90036000 tx=0x7fda9003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:20.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:20.902+0000 7fda96000640 1 -- 172.21.15.63:0/2250358210 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fda880588a0 con 0x7fdaa00ced60 2024-03-26T06:17:21.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.141+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdaa006b2c0 con 0x7fdaa00ced60 2024-03-26T06:17:21.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.142+0000 7fda96000640 1 -- 172.21.15.63:0/2250358210 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4937 (secure 0 0 0) 0x7fda880010c0 con 0x7fdaa00ced60 2024-03-26T06:17:21.142 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:21.142 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:20.131439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-26T06:17:21.143 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-03-26T06:17:21.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda7c06bbd0 msgr2=0x7fda7c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda7c06bbd0 0x7fda7c06e090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda90036000 tx=0x7fda9003c040 comp rx=0 tx=0).stop 2024-03-26T06:17:21.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 msgr2=0x7fdaa0153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 0x7fdaa0153f70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c410 tx=0x7fda8800c8d0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 shutdown_connections 2024-03-26T06:17:21.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda7c06bbd0 0x7fda7c06e090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdaa00cf140 0x7fdaa01610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa00ced60 0x7fdaa0153f70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 --2- 172.21.15.63:0/2250358210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdaa0071a60 0x7fdaa00b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 >> 172.21.15.63:0/2250358210 conn(0x7fdaa006ac90 msgr2=0x7fdaa00cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:21.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 shutdown_connections 2024-03-26T06:17:21.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.145+0000 7fdaa4a00640 1 -- 172.21.15.63:0/2250358210 wait complete. 2024-03-26T06:17:21.163 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:21.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.382+0000 7f8308800640 1 Processor -- start 2024-03-26T06:17:21.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.383+0000 7f8308800640 1 -- start start 2024-03-26T06:17:21.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.384+0000 7f8308800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 0x7f830006e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.384+0000 7f8308800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83000cf140 0x7f8300162710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.384+0000 7f8308800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8300163490 con 0x7f83000ced60 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.384+0000 7f8308800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830006e750 con 0x7f83000cf140 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.385+0000 7f8308800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830006d450 con 0x7f8300071a60 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.385+0000 7f8306800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83000cf140 0x7f8300162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.385+0000 7f8306800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83000cf140 0x7f8300162710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49566/0 (socket says 172.21.15.63:49566) 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.385+0000 7f8306800640 1 -- 172.21.15.63:0/2119562697 learned_addr learned my addr 172.21.15.63:0/2119562697 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.385+0000 7f8305400640 1 --2- 172.21.15.63:0/2119562697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 0x7f830006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.385+0000 7f8306800640 1 -- 172.21.15.63:0/2119562697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 msgr2=0x7f830006e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.385+0000 7f8306800640 1 --2- 172.21.15.63:0/2119562697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 0x7f830006e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.385+0000 7f8306800640 1 -- 172.21.15.63:0/2119562697 >> v1:172.21.15.204:6789/0 conn(0x7f83000ced60 legacy=0x7f8300071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.385+0000 7f8306800640 1 -- 172.21.15.63:0/2119562697 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830006d730 con 0x7f83000cf140 2024-03-26T06:17:21.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.387+0000 7f8306800640 1 --2- 172.21.15.63:0/2119562697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000cf140 0x7f8300162710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009e50 tx=0x7f82fc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc35edd8004f16af server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:21.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.387+0000 7f8304a00640 1 -- 172.21.15.63:0/2119562697 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc02cb00 con 0x7f83000cf140 2024-03-26T06:17:21.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.387+0000 7f8304a00640 1 -- 172.21.15.63:0/2119562697 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc02cca0 con 0x7f83000cf140 2024-03-26T06:17:21.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.387+0000 7f8304a00640 1 -- 172.21.15.63:0/2119562697 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc034610 con 0x7f83000cf140 2024-03-26T06:17:21.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.388+0000 7f8308800640 1 -- 172.21.15.63:0/2119562697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000cf140 msgr2=0x7f8300162710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.388+0000 7f8308800640 1 --2- 172.21.15.63:0/2119562697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000cf140 0x7f8300162710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009e50 tx=0x7f82fc02bf60 comp rx=0 tx=0).stop 2024-03-26T06:17:21.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.388+0000 7f8308800640 1 -- 172.21.15.63:0/2119562697 shutdown_connections 2024-03-26T06:17:21.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.388+0000 7f8308800640 1 --2- 172.21.15.63:0/2119562697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000cf140 0x7f8300162710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.388+0000 7f8308800640 1 --2- 172.21.15.63:0/2119562697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 0x7f830006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.388+0000 7f8308800640 1 -- 172.21.15.63:0/2119562697 >> 172.21.15.63:0/2119562697 conn(0x7f830006ac90 msgr2=0x7f830006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.388+0000 7f8308800640 1 -- 172.21.15.63:0/2119562697 shutdown_connections 2024-03-26T06:17:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.388+0000 7f8308800640 1 -- 172.21.15.63:0/2119562697 wait complete. 2024-03-26T06:17:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.390+0000 7f8308800640 1 Processor -- start 2024-03-26T06:17:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.390+0000 7f8308800640 1 -- start start 2024-03-26T06:17:21.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8308800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 0x7f83000b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8308800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000ced60 0x7f8300161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8308800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83000cf140 0x7f83001616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8308800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8300162c50 con 0x7f83000ced60 2024-03-26T06:17:21.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8308800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830006dcf0 con 0x7f83000cf140 2024-03-26T06:17:21.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8308800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8300162dd0 con 0x7f8300071a60 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8305400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000ced60 0x7f8300161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8305400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000ced60 0x7f8300161180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49580/0 (socket says 172.21.15.63:49580) 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8305400640 1 -- 172.21.15.63:0/308884111 learned_addr learned my addr 172.21.15.63:0/308884111 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8305e00640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 0x7f83000b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8306800640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83000cf140 0x7f83001616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8305400640 1 -- 172.21.15.63:0/308884111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 msgr2=0x7f83000b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8305400640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 0x7f83000b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8305400640 1 -- 172.21.15.63:0/308884111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83000cf140 msgr2=0x7f83001616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8305400640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83000cf140 0x7f83001616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8305400640 1 -- 172.21.15.63:0/308884111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830015f550 con 0x7f83000ced60 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.391+0000 7f8306800640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83000cf140 0x7f83001616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:21.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.392+0000 7f8305400640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000ced60 0x7f8300161180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f82f000d620 tx=0x7f82f000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:21.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.392+0000 7f82fa000640 1 -- 172.21.15.63:0/308884111 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000b620 con 0x7f83000ced60 2024-03-26T06:17:21.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.392+0000 7f82fa000640 1 -- 172.21.15.63:0/308884111 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f0019070 con 0x7f83000ced60 2024-03-26T06:17:21.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.392+0000 7f82fa000640 1 -- 172.21.15.63:0/308884111 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000ba00 con 0x7f83000ced60 2024-03-26T06:17:21.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.392+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830015e4b0 con 0x7f83000ced60 2024-03-26T06:17:21.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.392+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830015ea70 con 0x7f83000ced60 2024-03-26T06:17:21.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.394+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8300074730 con 0x7f83000ced60 2024-03-26T06:17:21.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.394+0000 7f82fa000640 1 -- 172.21.15.63:0/308884111 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f82f000bba0 con 0x7f83000ced60 2024-03-26T06:17:21.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.395+0000 7f82fa000640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f82e406bbd0 0x7f82e406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.395+0000 7f82fa000640 1 -- 172.21.15.63:0/308884111 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f82f008b270 con 0x7f83000ced60 2024-03-26T06:17:21.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.396+0000 7f8305e00640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f82e406bbd0 0x7f82e406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.396+0000 7f8305e00640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f82e406bbd0 0x7f82e406e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82f4001640 tx=0x7f82f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:21.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.400+0000 7f82fa000640 1 -- 172.21.15.63:0/308884111 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f82f0059980 con 0x7f83000ced60 2024-03-26T06:17:21.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.603+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8300165380 con 0x7f83000ced60 2024-03-26T06:17:21.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.607+0000 7f82fa000640 1 -- 172.21.15.63:0/308884111 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f82f0059280 con 0x7f83000ced60 2024-03-26T06:17:21.607 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:21.607 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.609+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f82e406bbd0 msgr2=0x7f82e406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.609+0000 7f8308800640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f82e406bbd0 0x7f82e406e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82f4001640 tx=0x7f82f4009040 comp rx=0 tx=0).stop 2024-03-26T06:17:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.609+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000ced60 msgr2=0x7f8300161180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.609+0000 7f8308800640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000ced60 0x7f8300161180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f82f000d620 tx=0x7f82f000dae0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.610+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 shutdown_connections 2024-03-26T06:17:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.610+0000 7f8308800640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f82e406bbd0 0x7f82e406e090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.610+0000 7f8308800640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83000cf140 0x7f83001616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.610+0000 7f8308800640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83000ced60 0x7f8300161180 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.610+0000 7f8308800640 1 --2- 172.21.15.63:0/308884111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8300071a60 0x7f83000b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.610+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 >> 172.21.15.63:0/308884111 conn(0x7f830006ac90 msgr2=0x7f8300158920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:21.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.610+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 shutdown_connections 2024-03-26T06:17:21.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.610+0000 7f8308800640 1 -- 172.21.15.63:0/308884111 wait complete. 2024-03-26T06:17:21.631 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-26T06:17:21.631 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-26T06:17:21.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.844+0000 7f7267200640 1 Processor -- start 2024-03-26T06:17:21.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.844+0000 7f7267200640 1 -- start start 2024-03-26T06:17:21.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.846+0000 7f7267200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72680b5030 0x7f72680ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.846+0000 7f7267200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72680cc070 con 0x7f72680b4c50 2024-03-26T06:17:21.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.846+0000 7f7267200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726815fde0 con 0x7f7268144b50 2024-03-26T06:17:21.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.846+0000 7f7267200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72681600c0 con 0x7f72680b5030 2024-03-26T06:17:21.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.846+0000 7f7265e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f72680b4c50 0x7f726815f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43796/0 (socket says 172.21.15.63:43796) 2024-03-26T06:17:21.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.846+0000 7f7265e00640 1 -- 172.21.15.63:0/875482924 learned_addr learned my addr 172.21.15.63:0/875482924 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:21.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.846+0000 7f725fe00640 1 --2- 172.21.15.63:0/875482924 >> v2:172.21.15.63:3300/0 conn(0x7f72680b5030 0x7f72680ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.847+0000 7f7265400640 1 -- 172.21.15.63:0/875482924 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336367502 0 0) 0x7f72680cc070 con 0x7f72680b4c50 2024-03-26T06:17:21.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.847+0000 7f7265400640 1 -- 172.21.15.63:0/875482924 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f724c003520 con 0x7f72680b4c50 2024-03-26T06:17:21.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.847+0000 7f725fe00640 1 -- 172.21.15.63:0/875482924 >> v1:172.21.15.204:6789/0 conn(0x7f7268144b50 legacy=0x7f726806d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.847+0000 7f725fe00640 1 -- 172.21.15.63:0/875482924 >> v1:172.21.15.63:6789/0 conn(0x7f72680b4c50 legacy=0x7f726815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.847+0000 7f725fe00640 1 -- 172.21.15.63:0/875482924 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680cc310 con 0x7f72680b5030 2024-03-26T06:17:21.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.848+0000 7f725fe00640 1 --2- 172.21.15.63:0/875482924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b5030 0x7f72680ccaf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72500097d0 tx=0x7f725002b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc293db57e828529 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:21.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7265400640 1 -- 172.21.15.63:0/875482924 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250034070 con 0x7f72680b5030 2024-03-26T06:17:21.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7265400640 1 -- 172.21.15.63:0/875482924 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250030890 con 0x7f72680b5030 2024-03-26T06:17:21.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7265400640 1 -- 172.21.15.63:0/875482924 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250030c60 con 0x7f72680b5030 2024-03-26T06:17:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7267200640 1 -- 172.21.15.63:0/875482924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b5030 msgr2=0x7f72680ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7267200640 1 --2- 172.21.15.63:0/875482924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b5030 0x7f72680ccaf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72500097d0 tx=0x7f725002b9d0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7267200640 1 -- 172.21.15.63:0/875482924 shutdown_connections 2024-03-26T06:17:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7267200640 1 --2- 172.21.15.63:0/875482924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b5030 0x7f72680ccaf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7267200640 1 -- 172.21.15.63:0/875482924 >> 172.21.15.63:0/875482924 conn(0x7f72680b13d0 msgr2=0x7f72680b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7267200640 1 -- 172.21.15.63:0/875482924 shutdown_connections 2024-03-26T06:17:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.849+0000 7f7267200640 1 -- 172.21.15.63:0/875482924 wait complete. 2024-03-26T06:17:21.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.851+0000 7f7267200640 1 Processor -- start 2024-03-26T06:17:21.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.851+0000 7f7267200640 1 -- start start 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.852+0000 7f7267200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b4c50 0x7f72680c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.852+0000 7f7267200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72680b5030 0x7f7268138740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.852+0000 7f7267200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7268144b50 0x7f7268138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.852+0000 7f7267200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726815fa50 con 0x7f72680b4c50 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.852+0000 7f7267200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726806eb70 con 0x7f72680b5030 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.852+0000 7f7267200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7268144fe0 con 0x7f7268144b50 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7265e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b4c50 0x7f72680c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7265e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b4c50 0x7f72680c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49594/0 (socket says 172.21.15.63:49594) 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7265e00640 1 -- 172.21.15.63:0/2334836945 learned_addr learned my addr 172.21.15.63:0/2334836945 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f725fe00640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72680b5030 0x7f7268138740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7266800640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7268144b50 0x7f7268138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7265e00640 1 -- 172.21.15.63:0/2334836945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7268144b50 msgr2=0x7f7268138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7265e00640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7268144b50 0x7f7268138c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7265e00640 1 -- 172.21.15.63:0/2334836945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72680b5030 msgr2=0x7f7268138740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7265e00640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72680b5030 0x7f7268138740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7265e00640 1 -- 172.21.15.63:0/2334836945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7268132d40 con 0x7f72680b4c50 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7266800640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7268144b50 0x7f7268138c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.853+0000 7f7265e00640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b4c50 0x7f72680c48b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f725800c500 tx=0x7f725800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.854+0000 7f725e000640 1 -- 172.21.15.63:0/2334836945 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258017070 con 0x7f72680b4c50 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.854+0000 7f725e000640 1 -- 172.21.15.63:0/2334836945 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258005ce0 con 0x7f72680b4c50 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.854+0000 7f725e000640 1 -- 172.21.15.63:0/2334836945 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258007330 con 0x7f72680b4c50 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.854+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72681e6c20 con 0x7f72680b4c50 2024-03-26T06:17:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.854+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72681332c0 con 0x7f72680b4c50 2024-03-26T06:17:21.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.855+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726804f050 con 0x7f72680b4c50 2024-03-26T06:17:21.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.856+0000 7f725e000640 1 -- 172.21.15.63:0/2334836945 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f725801a070 con 0x7f72680b4c50 2024-03-26T06:17:21.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.857+0000 7f725e000640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f724406bbd0 0x7f724406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:21.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.857+0000 7f725e000640 1 -- 172.21.15.63:0/2334836945 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f725808a240 con 0x7f72680b4c50 2024-03-26T06:17:21.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.857+0000 7f725fe00640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f724406bbd0 0x7f724406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:21.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.858+0000 7f725fe00640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f724406bbd0 0x7f724406e090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7250036000 tx=0x7f725003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:21.861+0000 7f725e000640 1 -- 172.21.15.63:0/2334836945 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7258058aa0 con 0x7f72680b4c50 2024-03-26T06:17:22.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.060+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 --> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f726806e400 con 0x7f724406bbd0 2024-03-26T06:17:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.092+0000 7f725e000640 1 -- 172.21.15.63:0/2334836945 <== mgr.4104 v2:172.21.15.63:6832/3591189670 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7f726806e400 con 0x7f724406bbd0 2024-03-26T06:17:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:22.100 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-03-26T06:17:22.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f724406bbd0 msgr2=0x7f724406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f724406bbd0 0x7f724406e090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7250036000 tx=0x7f725003b040 comp rx=0 tx=0).stop 2024-03-26T06:17:22.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b4c50 msgr2=0x7f72680c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b4c50 0x7f72680c48b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f725800c500 tx=0x7f725800c9c0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 shutdown_connections 2024-03-26T06:17:22.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f724406bbd0 0x7f724406e090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7268144b50 0x7f7268138c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72680b5030 0x7f7268138740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 --2- 172.21.15.63:0/2334836945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72680b4c50 0x7f72680c48b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 >> 172.21.15.63:0/2334836945 conn(0x7f72680b13d0 msgr2=0x7f72680af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:22.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 shutdown_connections 2024-03-26T06:17:22.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.101+0000 7f7267200640 1 -- 172.21.15.63:0/2334836945 wait complete. 2024-03-26T06:17:22.125 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-03-26T06:17:21.884346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2029150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004096"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595035+0000","last_change":"2024-03-26T06:16:57.506890+0000","last_active":"2024-03-26T06:17:03.595035+0000","last_peered":"2024-03-26T06:17:03.595035+0000","last_clean":"2024-03-26T06:17:03.595035+0000","last_became_active":"2024-03-26T06:16:57.506602+0000","last_became_peered":"2024-03-26T06:16:57.506602+0000","last_unstale":"2024-03-26T06:17:03.595035+0000","last_undegraded":"2024-03-26T06:17:03.595035+0000","last_fullsized":"2024-03-26T06:17:03.595035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:14:13.027200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557577+0000","last_change":"2024-03-26T06:16:58.527848+0000","last_active":"2024-03-26T06:17:03.557577+0000","last_peered":"2024-03-26T06:17:03.557577+0000","last_clean":"2024-03-26T06:17:03.557577+0000","last_became_active":"2024-03-26T06:16:58.527552+0000","last_became_peered":"2024-03-26T06:16:58.527552+0000","last_unstale":"2024-03-26T06:17:03.557577+0000","last_undegraded":"2024-03-26T06:17:03.557577+0000","last_fullsized":"2024-03-26T06:17:03.557577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554184+0000","last_change":"2024-03-26T06:17:02.883862+0000","last_active":"2024-03-26T06:17:03.554184+0000","last_peered":"2024-03-26T06:17:03.554184+0000","last_clean":"2024-03-26T06:17:03.554184+0000","last_became_active":"2024-03-26T06:17:02.883030+0000","last_became_peered":"2024-03-26T06:17:02.883030+0000","last_unstale":"2024-03-26T06:17:03.554184+0000","last_undegraded":"2024-03-26T06:17:03.554184+0000","last_fullsized":"2024-03-26T06:17:03.554184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:54:39.278678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557980+0000","last_change":"2024-03-26T06:16:57.498142+0000","last_active":"2024-03-26T06:17:03.557980+0000","last_peered":"2024-03-26T06:17:03.557980+0000","last_clean":"2024-03-26T06:17:03.557980+0000","last_became_active":"2024-03-26T06:16:57.497676+0000","last_became_peered":"2024-03-26T06:16:57.497676+0000","last_unstale":"2024-03-26T06:17:03.557980+0000","last_undegraded":"2024-03-26T06:17:03.557980+0000","last_fullsized":"2024-03-26T06:17:03.557980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594151+0000","last_change":"2024-03-26T06:16:58.533520+0000","last_active":"2024-03-26T06:17:03.594151+0000","last_peered":"2024-03-26T06:17:03.594151+0000","last_clean":"2024-03-26T06:17:03.594151+0000","last_became_active":"2024-03-26T06:16:58.532799+0000","last_became_peered":"2024-03-26T06:16:58.532799+0000","last_unstale":"2024-03-26T06:17:03.594151+0000","last_undegraded":"2024-03-26T06:17:03.594151+0000","last_fullsized":"2024-03-26T06:17:03.594151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597128+0000","last_change":"2024-03-26T06:17:02.581513+0000","last_active":"2024-03-26T06:17:03.597128+0000","last_peered":"2024-03-26T06:17:03.597128+0000","last_clean":"2024-03-26T06:17:03.597128+0000","last_became_active":"2024-03-26T06:17:02.580429+0000","last_became_peered":"2024-03-26T06:17:02.580429+0000","last_unstale":"2024-03-26T06:17:03.597128+0000","last_undegraded":"2024-03-26T06:17:03.597128+0000","last_fullsized":"2024-03-26T06:17:03.597128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:21.836096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601161+0000","last_change":"2024-03-26T06:16:57.517050+0000","last_active":"2024-03-26T06:17:03.601161+0000","last_peered":"2024-03-26T06:17:03.601161+0000","last_clean":"2024-03-26T06:17:03.601161+0000","last_became_active":"2024-03-26T06:16:57.516624+0000","last_became_peered":"2024-03-26T06:16:57.516624+0000","last_unstale":"2024-03-26T06:17:03.601161+0000","last_undegraded":"2024-03-26T06:17:03.601161+0000","last_fullsized":"2024-03-26T06:17:03.601161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:27.040366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554266+0000","last_change":"2024-03-26T06:16:58.528249+0000","last_active":"2024-03-26T06:17:03.554266+0000","last_peered":"2024-03-26T06:17:03.554266+0000","last_clean":"2024-03-26T06:17:03.554266+0000","last_became_active":"2024-03-26T06:16:58.527930+0000","last_became_peered":"2024-03-26T06:16:58.527930+0000","last_unstale":"2024-03-26T06:17:03.554266+0000","last_undegraded":"2024-03-26T06:17:03.554266+0000","last_fullsized":"2024-03-26T06:17:03.554266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:12:57.541865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599529+0000","last_change":"2024-03-26T06:17:02.582621+0000","last_active":"2024-03-26T06:17:03.599529+0000","last_peered":"2024-03-26T06:17:03.599529+0000","last_clean":"2024-03-26T06:17:03.599529+0000","last_became_active":"2024-03-26T06:17:02.581967+0000","last_became_peered":"2024-03-26T06:17:02.581967+0000","last_unstale":"2024-03-26T06:17:03.599529+0000","last_undegraded":"2024-03-26T06:17:03.599529+0000","last_fullsized":"2024-03-26T06:17:03.599529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599843+0000","last_change":"2024-03-26T06:16:57.514049+0000","last_active":"2024-03-26T06:17:03.599843+0000","last_peered":"2024-03-26T06:17:03.599843+0000","last_clean":"2024-03-26T06:17:03.599843+0000","last_became_active":"2024-03-26T06:16:57.513744+0000","last_became_peered":"2024-03-26T06:16:57.513744+0000","last_unstale":"2024-03-26T06:17:03.599843+0000","last_undegraded":"2024-03-26T06:17:03.599843+0000","last_fullsized":"2024-03-26T06:17:03.599843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:30.683728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554334+0000","last_change":"2024-03-26T06:16:58.530727+0000","last_active":"2024-03-26T06:17:03.554334+0000","last_peered":"2024-03-26T06:17:03.554334+0000","last_clean":"2024-03-26T06:17:03.554334+0000","last_became_active":"2024-03-26T06:16:58.530387+0000","last_became_peered":"2024-03-26T06:16:58.530387+0000","last_unstale":"2024-03-26T06:17:03.554334+0000","last_undegraded":"2024-03-26T06:17:03.554334+0000","last_fullsized":"2024-03-26T06:17:03.554334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596867+0000","last_change":"2024-03-26T06:17:02.589397+0000","last_active":"2024-03-26T06:17:03.596867+0000","last_peered":"2024-03-26T06:17:03.596867+0000","last_clean":"2024-03-26T06:17:03.596867+0000","last_became_active":"2024-03-26T06:17:02.588887+0000","last_became_peered":"2024-03-26T06:17:02.588887+0000","last_unstale":"2024-03-26T06:17:03.596867+0000","last_undegraded":"2024-03-26T06:17:03.596867+0000","last_fullsized":"2024-03-26T06:17:03.596867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:07.303274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595731+0000","last_change":"2024-03-26T06:16:58.526427+0000","last_active":"2024-03-26T06:17:03.595731+0000","last_peered":"2024-03-26T06:17:03.595731+0000","last_clean":"2024-03-26T06:17:03.595731+0000","last_became_active":"2024-03-26T06:16:58.526080+0000","last_became_peered":"2024-03-26T06:16:58.526080+0000","last_unstale":"2024-03-26T06:17:03.595731+0000","last_undegraded":"2024-03-26T06:17:03.595731+0000","last_fullsized":"2024-03-26T06:17:03.595731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600384+0000","last_change":"2024-03-26T06:16:57.513120+0000","last_active":"2024-03-26T06:17:03.600384+0000","last_peered":"2024-03-26T06:17:03.600384+0000","last_clean":"2024-03-26T06:17:03.600384+0000","last_became_active":"2024-03-26T06:16:57.512654+0000","last_became_peered":"2024-03-26T06:16:57.512654+0000","last_unstale":"2024-03-26T06:17:03.600384+0000","last_undegraded":"2024-03-26T06:17:03.600384+0000","last_fullsized":"2024-03-26T06:17:03.600384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597983+0000","last_change":"2024-03-26T06:17:02.584892+0000","last_active":"2024-03-26T06:17:03.597983+0000","last_peered":"2024-03-26T06:17:03.597983+0000","last_clean":"2024-03-26T06:17:03.597983+0000","last_became_active":"2024-03-26T06:17:02.584379+0000","last_became_peered":"2024-03-26T06:17:02.584379+0000","last_unstale":"2024-03-26T06:17:03.597983+0000","last_undegraded":"2024-03-26T06:17:03.597983+0000","last_fullsized":"2024-03-26T06:17:03.597983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:46.388330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555728+0000","last_change":"2024-03-26T06:16:58.517155+0000","last_active":"2024-03-26T06:17:03.555728+0000","last_peered":"2024-03-26T06:17:03.555728+0000","last_clean":"2024-03-26T06:17:03.555728+0000","last_became_active":"2024-03-26T06:16:58.516377+0000","last_became_peered":"2024-03-26T06:16:58.516377+0000","last_unstale":"2024-03-26T06:17:03.555728+0000","last_undegraded":"2024-03-26T06:17:03.555728+0000","last_fullsized":"2024-03-26T06:17:03.555728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597289+0000","last_change":"2024-03-26T06:16:57.500506+0000","last_active":"2024-03-26T06:17:03.597289+0000","last_peered":"2024-03-26T06:17:03.597289+0000","last_clean":"2024-03-26T06:17:03.597289+0000","last_became_active":"2024-03-26T06:16:57.499432+0000","last_became_peered":"2024-03-26T06:16:57.499432+0000","last_unstale":"2024-03-26T06:17:03.597289+0000","last_undegraded":"2024-03-26T06:17:03.597289+0000","last_fullsized":"2024-03-26T06:17:03.597289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599068+0000","last_change":"2024-03-26T06:17:02.586266+0000","last_active":"2024-03-26T06:17:03.599068+0000","last_peered":"2024-03-26T06:17:03.599068+0000","last_clean":"2024-03-26T06:17:03.599068+0000","last_became_active":"2024-03-26T06:17:02.585755+0000","last_became_peered":"2024-03-26T06:17:02.585755+0000","last_unstale":"2024-03-26T06:17:03.599068+0000","last_undegraded":"2024-03-26T06:17:03.599068+0000","last_fullsized":"2024-03-26T06:17:03.599068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:36.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554831+0000","last_change":"2024-03-26T06:16:58.516177+0000","last_active":"2024-03-26T06:17:03.554831+0000","last_peered":"2024-03-26T06:17:03.554831+0000","last_clean":"2024-03-26T06:17:03.554831+0000","last_became_active":"2024-03-26T06:16:58.515861+0000","last_became_peered":"2024-03-26T06:16:58.515861+0000","last_unstale":"2024-03-26T06:17:03.554831+0000","last_undegraded":"2024-03-26T06:17:03.554831+0000","last_fullsized":"2024-03-26T06:17:03.554831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595139+0000","last_change":"2024-03-26T06:16:57.506199+0000","last_active":"2024-03-26T06:17:03.595139+0000","last_peered":"2024-03-26T06:17:03.595139+0000","last_clean":"2024-03-26T06:17:03.595139+0000","last_became_active":"2024-03-26T06:16:57.505635+0000","last_became_peered":"2024-03-26T06:16:57.505635+0000","last_unstale":"2024-03-26T06:17:03.595139+0000","last_undegraded":"2024-03-26T06:17:03.595139+0000","last_fullsized":"2024-03-26T06:17:03.595139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596127+0000","last_change":"2024-03-26T06:17:02.877672+0000","last_active":"2024-03-26T06:17:03.596127+0000","last_peered":"2024-03-26T06:17:03.596127+0000","last_clean":"2024-03-26T06:17:03.596127+0000","last_became_active":"2024-03-26T06:17:02.877192+0000","last_became_peered":"2024-03-26T06:17:02.877192+0000","last_unstale":"2024-03-26T06:17:03.596127+0000","last_undegraded":"2024-03-26T06:17:03.596127+0000","last_fullsized":"2024-03-26T06:17:03.596127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598768+0000","last_change":"2024-03-26T06:16:58.521953+0000","last_active":"2024-03-26T06:17:03.598768+0000","last_peered":"2024-03-26T06:17:03.598768+0000","last_clean":"2024-03-26T06:17:03.598768+0000","last_became_active":"2024-03-26T06:16:58.521656+0000","last_became_peered":"2024-03-26T06:16:58.521656+0000","last_unstale":"2024-03-26T06:17:03.598768+0000","last_undegraded":"2024-03-26T06:17:03.598768+0000","last_fullsized":"2024-03-26T06:17:03.598768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:03.428999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597855+0000","last_change":"2024-03-26T06:16:57.508917+0000","last_active":"2024-03-26T06:17:03.597855+0000","last_peered":"2024-03-26T06:17:03.597855+0000","last_clean":"2024-03-26T06:17:03.597855+0000","last_became_active":"2024-03-26T06:16:57.508659+0000","last_became_peered":"2024-03-26T06:16:57.508659+0000","last_unstale":"2024-03-26T06:17:03.597855+0000","last_undegraded":"2024-03-26T06:17:03.597855+0000","last_fullsized":"2024-03-26T06:17:03.597855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600692+0000","last_change":"2024-03-26T06:17:02.583351+0000","last_active":"2024-03-26T06:17:03.600692+0000","last_peered":"2024-03-26T06:17:03.600692+0000","last_clean":"2024-03-26T06:17:03.600692+0000","last_became_active":"2024-03-26T06:17:02.582876+0000","last_became_peered":"2024-03-26T06:17:02.582876+0000","last_unstale":"2024-03-26T06:17:03.600692+0000","last_undegraded":"2024-03-26T06:17:03.600692+0000","last_fullsized":"2024-03-26T06:17:03.600692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595429+0000","last_change":"2024-03-26T06:16:58.508413+0000","last_active":"2024-03-26T06:17:03.595429+0000","last_peered":"2024-03-26T06:17:03.595429+0000","last_clean":"2024-03-26T06:17:03.595429+0000","last_became_active":"2024-03-26T06:16:58.508024+0000","last_became_peered":"2024-03-26T06:16:58.508024+0000","last_unstale":"2024-03-26T06:17:03.595429+0000","last_undegraded":"2024-03-26T06:17:03.595429+0000","last_fullsized":"2024-03-26T06:17:03.595429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596617+0000","last_change":"2024-03-26T06:16:57.509822+0000","last_active":"2024-03-26T06:17:03.596617+0000","last_peered":"2024-03-26T06:17:03.596617+0000","last_clean":"2024-03-26T06:17:03.596617+0000","last_became_active":"2024-03-26T06:16:57.509535+0000","last_became_peered":"2024-03-26T06:16:57.509535+0000","last_unstale":"2024-03-26T06:17:03.596617+0000","last_undegraded":"2024-03-26T06:17:03.596617+0000","last_fullsized":"2024-03-26T06:17:03.596617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597981+0000","last_change":"2024-03-26T06:17:02.877373+0000","last_active":"2024-03-26T06:17:03.597981+0000","last_peered":"2024-03-26T06:17:03.597981+0000","last_clean":"2024-03-26T06:17:03.597981+0000","last_became_active":"2024-03-26T06:17:02.876252+0000","last_became_peered":"2024-03-26T06:17:02.876252+0000","last_unstale":"2024-03-26T06:17:03.597981+0000","last_undegraded":"2024-03-26T06:17:03.597981+0000","last_fullsized":"2024-03-26T06:17:03.597981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:19.395341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556495+0000","last_change":"2024-03-26T06:16:58.536114+0000","last_active":"2024-03-26T06:17:03.556495+0000","last_peered":"2024-03-26T06:17:03.556495+0000","last_clean":"2024-03-26T06:17:03.556495+0000","last_became_active":"2024-03-26T06:16:58.534372+0000","last_became_peered":"2024-03-26T06:16:58.534372+0000","last_unstale":"2024-03-26T06:17:03.556495+0000","last_undegraded":"2024-03-26T06:17:03.556495+0000","last_fullsized":"2024-03-26T06:17:03.556495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596054+0000","last_change":"2024-03-26T06:16:57.503958+0000","last_active":"2024-03-26T06:17:03.596054+0000","last_peered":"2024-03-26T06:17:03.596054+0000","last_clean":"2024-03-26T06:17:03.596054+0000","last_became_active":"2024-03-26T06:16:57.503652+0000","last_became_peered":"2024-03-26T06:16:57.503652+0000","last_unstale":"2024-03-26T06:17:03.596054+0000","last_undegraded":"2024-03-26T06:17:03.596054+0000","last_fullsized":"2024-03-26T06:17:03.596054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:27.040366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553997+0000","last_change":"2024-03-26T06:17:02.878945+0000","last_active":"2024-03-26T06:17:03.553997+0000","last_peered":"2024-03-26T06:17:03.553997+0000","last_clean":"2024-03-26T06:17:03.553997+0000","last_became_active":"2024-03-26T06:17:02.876348+0000","last_became_peered":"2024-03-26T06:17:02.876348+0000","last_unstale":"2024-03-26T06:17:03.553997+0000","last_undegraded":"2024-03-26T06:17:03.553997+0000","last_fullsized":"2024-03-26T06:17:03.553997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:56:38.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595956+0000","last_change":"2024-03-26T06:16:58.515417+0000","last_active":"2024-03-26T06:17:03.595956+0000","last_peered":"2024-03-26T06:17:03.595956+0000","last_clean":"2024-03-26T06:17:03.595956+0000","last_became_active":"2024-03-26T06:16:58.515099+0000","last_became_peered":"2024-03-26T06:16:58.515099+0000","last_unstale":"2024-03-26T06:17:03.595956+0000","last_undegraded":"2024-03-26T06:17:03.595956+0000","last_fullsized":"2024-03-26T06:17:03.595956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601464+0000","last_change":"2024-03-26T06:16:57.512114+0000","last_active":"2024-03-26T06:17:03.601464+0000","last_peered":"2024-03-26T06:17:03.601464+0000","last_clean":"2024-03-26T06:17:03.601464+0000","last_became_active":"2024-03-26T06:16:57.511667+0000","last_became_peered":"2024-03-26T06:16:57.511667+0000","last_unstale":"2024-03-26T06:17:03.601464+0000","last_undegraded":"2024-03-26T06:17:03.601464+0000","last_fullsized":"2024-03-26T06:17:03.601464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:02:14.322537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593526+0000","last_change":"2024-03-26T06:17:02.871332+0000","last_active":"2024-03-26T06:17:03.593526+0000","last_peered":"2024-03-26T06:17:03.593526+0000","last_clean":"2024-03-26T06:17:03.593526+0000","last_became_active":"2024-03-26T06:17:02.869955+0000","last_became_peered":"2024-03-26T06:17:02.869955+0000","last_unstale":"2024-03-26T06:17:03.593526+0000","last_undegraded":"2024-03-26T06:17:03.593526+0000","last_fullsized":"2024-03-26T06:17:03.593526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554596+0000","last_change":"2024-03-26T06:16:58.523299+0000","last_active":"2024-03-26T06:17:03.554596+0000","last_peered":"2024-03-26T06:17:03.554596+0000","last_clean":"2024-03-26T06:17:03.554596+0000","last_became_active":"2024-03-26T06:16:58.522533+0000","last_became_peered":"2024-03-26T06:16:58.522533+0000","last_unstale":"2024-03-26T06:17:03.554596+0000","last_undegraded":"2024-03-26T06:17:03.554596+0000","last_fullsized":"2024-03-26T06:17:03.554596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:30.208261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596078+0000","last_change":"2024-03-26T06:16:57.500603+0000","last_active":"2024-03-26T06:17:03.596078+0000","last_peered":"2024-03-26T06:17:03.596078+0000","last_clean":"2024-03-26T06:17:03.596078+0000","last_became_active":"2024-03-26T06:16:57.500234+0000","last_became_peered":"2024-03-26T06:16:57.500234+0000","last_unstale":"2024-03-26T06:17:03.596078+0000","last_undegraded":"2024-03-26T06:17:03.596078+0000","last_fullsized":"2024-03-26T06:17:03.596078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:30.683728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595428+0000","last_change":"2024-03-26T06:17:02.583042+0000","last_active":"2024-03-26T06:17:03.595428+0000","last_peered":"2024-03-26T06:17:03.595428+0000","last_clean":"2024-03-26T06:17:03.595428+0000","last_became_active":"2024-03-26T06:17:02.581196+0000","last_became_peered":"2024-03-26T06:17:02.581196+0000","last_unstale":"2024-03-26T06:17:03.595428+0000","last_undegraded":"2024-03-26T06:17:03.595428+0000","last_fullsized":"2024-03-26T06:17:03.595428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600154+0000","last_change":"2024-03-26T06:16:58.531514+0000","last_active":"2024-03-26T06:17:03.600154+0000","last_peered":"2024-03-26T06:17:03.600154+0000","last_clean":"2024-03-26T06:17:03.600154+0000","last_became_active":"2024-03-26T06:16:58.531162+0000","last_became_peered":"2024-03-26T06:16:58.531162+0000","last_unstale":"2024-03-26T06:17:03.600154+0000","last_undegraded":"2024-03-26T06:17:03.600154+0000","last_fullsized":"2024-03-26T06:17:03.600154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:30.860729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554746+0000","last_change":"2024-03-26T06:16:57.495688+0000","last_active":"2024-03-26T06:17:03.554746+0000","last_peered":"2024-03-26T06:17:03.554746+0000","last_clean":"2024-03-26T06:17:03.554746+0000","last_became_active":"2024-03-26T06:16:57.495052+0000","last_became_peered":"2024-03-26T06:16:57.495052+0000","last_unstale":"2024-03-26T06:17:03.554746+0000","last_undegraded":"2024-03-26T06:17:03.554746+0000","last_fullsized":"2024-03-26T06:17:03.554746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596497+0000","last_change":"2024-03-26T06:17:02.573496+0000","last_active":"2024-03-26T06:17:03.596497+0000","last_peered":"2024-03-26T06:17:03.596497+0000","last_clean":"2024-03-26T06:17:03.596497+0000","last_became_active":"2024-03-26T06:17:02.573045+0000","last_became_peered":"2024-03-26T06:17:02.573045+0000","last_unstale":"2024-03-26T06:17:03.596497+0000","last_undegraded":"2024-03-26T06:17:03.596497+0000","last_fullsized":"2024-03-26T06:17:03.596497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:13:01.612258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594153+0000","last_change":"2024-03-26T06:16:58.517202+0000","last_active":"2024-03-26T06:17:03.594153+0000","last_peered":"2024-03-26T06:17:03.594153+0000","last_clean":"2024-03-26T06:17:03.594153+0000","last_became_active":"2024-03-26T06:16:58.516835+0000","last_became_peered":"2024-03-26T06:16:58.516835+0000","last_unstale":"2024-03-26T06:17:03.594153+0000","last_undegraded":"2024-03-26T06:17:03.594153+0000","last_fullsized":"2024-03-26T06:17:03.594153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550169+0000","last_change":"2024-03-26T06:16:57.497056+0000","last_active":"2024-03-26T06:17:03.550169+0000","last_peered":"2024-03-26T06:17:03.550169+0000","last_clean":"2024-03-26T06:17:03.550169+0000","last_became_active":"2024-03-26T06:16:57.496709+0000","last_became_peered":"2024-03-26T06:16:57.496709+0000","last_unstale":"2024-03-26T06:17:03.550169+0000","last_undegraded":"2024-03-26T06:17:03.550169+0000","last_fullsized":"2024-03-26T06:17:03.550169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596338+0000","last_change":"2024-03-26T06:17:02.584311+0000","last_active":"2024-03-26T06:17:03.596338+0000","last_peered":"2024-03-26T06:17:03.596338+0000","last_clean":"2024-03-26T06:17:03.596338+0000","last_became_active":"2024-03-26T06:17:02.583886+0000","last_became_peered":"2024-03-26T06:17:02.583886+0000","last_unstale":"2024-03-26T06:17:03.596338+0000","last_undegraded":"2024-03-26T06:17:03.596338+0000","last_fullsized":"2024-03-26T06:17:03.596338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:21.194082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.592952+0000","last_change":"2024-03-26T06:16:58.530594+0000","last_active":"2024-03-26T06:17:03.592952+0000","last_peered":"2024-03-26T06:17:03.592952+0000","last_clean":"2024-03-26T06:17:03.592952+0000","last_became_active":"2024-03-26T06:16:58.529866+0000","last_became_peered":"2024-03-26T06:16:58.529866+0000","last_unstale":"2024-03-26T06:17:03.592952+0000","last_undegraded":"2024-03-26T06:17:03.592952+0000","last_fullsized":"2024-03-26T06:17:03.592952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:41:39.644933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598124+0000","last_change":"2024-03-26T06:16:57.515221+0000","last_active":"2024-03-26T06:17:03.598124+0000","last_peered":"2024-03-26T06:17:03.598124+0000","last_clean":"2024-03-26T06:17:03.598124+0000","last_became_active":"2024-03-26T06:16:57.514898+0000","last_became_peered":"2024-03-26T06:16:57.514898+0000","last_unstale":"2024-03-26T06:17:03.598124+0000","last_undegraded":"2024-03-26T06:17:03.598124+0000","last_fullsized":"2024-03-26T06:17:03.598124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595076+0000","last_change":"2024-03-26T06:17:02.882785+0000","last_active":"2024-03-26T06:17:03.595076+0000","last_peered":"2024-03-26T06:17:03.595076+0000","last_clean":"2024-03-26T06:17:03.595076+0000","last_became_active":"2024-03-26T06:17:02.880282+0000","last_became_peered":"2024-03-26T06:17:02.880282+0000","last_unstale":"2024-03-26T06:17:03.595076+0000","last_undegraded":"2024-03-26T06:17:03.595076+0000","last_fullsized":"2024-03-26T06:17:03.595076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:13:01.612258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554233+0000","last_change":"2024-03-26T06:16:58.534461+0000","last_active":"2024-03-26T06:17:03.554233+0000","last_peered":"2024-03-26T06:17:03.554233+0000","last_clean":"2024-03-26T06:17:03.554233+0000","last_became_active":"2024-03-26T06:16:58.533987+0000","last_became_peered":"2024-03-26T06:16:58.533987+0000","last_unstale":"2024-03-26T06:17:03.554233+0000","last_undegraded":"2024-03-26T06:17:03.554233+0000","last_fullsized":"2024-03-26T06:17:03.554233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553855+0000","last_change":"2024-03-26T06:16:57.493211+0000","last_active":"2024-03-26T06:17:03.553855+0000","last_peered":"2024-03-26T06:17:03.553855+0000","last_clean":"2024-03-26T06:17:03.553855+0000","last_became_active":"2024-03-26T06:16:57.492914+0000","last_became_peered":"2024-03-26T06:16:57.492914+0000","last_unstale":"2024-03-26T06:17:03.553855+0000","last_undegraded":"2024-03-26T06:17:03.553855+0000","last_fullsized":"2024-03-26T06:17:03.553855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598396+0000","last_change":"2024-03-26T06:16:49.590440+0000","last_active":"2024-03-26T06:17:03.598396+0000","last_peered":"2024-03-26T06:17:03.598396+0000","last_clean":"2024-03-26T06:17:03.598396+0000","last_became_active":"2024-03-26T06:16:49.589017+0000","last_became_peered":"2024-03-26T06:16:49.589017+0000","last_unstale":"2024-03-26T06:17:03.598396+0000","last_undegraded":"2024-03-26T06:17:03.598396+0000","last_fullsized":"2024-03-26T06:17:03.598396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_clean_scrub_stamp":"2024-03-26T06:16:48.290068+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:00:05.158039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596458+0000","last_change":"2024-03-26T06:17:02.878872+0000","last_active":"2024-03-26T06:17:03.596458+0000","last_peered":"2024-03-26T06:17:03.596458+0000","last_clean":"2024-03-26T06:17:03.596458+0000","last_became_active":"2024-03-26T06:17:02.877700+0000","last_became_peered":"2024-03-26T06:17:02.877700+0000","last_unstale":"2024-03-26T06:17:03.596458+0000","last_undegraded":"2024-03-26T06:17:03.596458+0000","last_fullsized":"2024-03-26T06:17:03.596458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600698+0000","last_change":"2024-03-26T06:16:58.533470+0000","last_active":"2024-03-26T06:17:03.600698+0000","last_peered":"2024-03-26T06:17:03.600698+0000","last_clean":"2024-03-26T06:17:03.600698+0000","last_became_active":"2024-03-26T06:16:58.533157+0000","last_became_peered":"2024-03-26T06:16:58.533157+0000","last_unstale":"2024-03-26T06:17:03.600698+0000","last_undegraded":"2024-03-26T06:17:03.600698+0000","last_fullsized":"2024-03-26T06:17:03.600698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.551305+0000","last_change":"2024-03-26T06:16:57.504891+0000","last_active":"2024-03-26T06:17:03.551305+0000","last_peered":"2024-03-26T06:17:03.551305+0000","last_clean":"2024-03-26T06:17:03.551305+0000","last_became_active":"2024-03-26T06:16:57.504556+0000","last_became_peered":"2024-03-26T06:16:57.504556+0000","last_unstale":"2024-03-26T06:17:03.551305+0000","last_undegraded":"2024-03-26T06:17:03.551305+0000","last_fullsized":"2024-03-26T06:17:03.551305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601044+0000","last_change":"2024-03-26T06:17:02.879854+0000","last_active":"2024-03-26T06:17:03.601044+0000","last_peered":"2024-03-26T06:17:03.601044+0000","last_clean":"2024-03-26T06:17:03.601044+0000","last_became_active":"2024-03-26T06:17:02.873465+0000","last_became_peered":"2024-03-26T06:17:02.873465+0000","last_unstale":"2024-03-26T06:17:03.601044+0000","last_undegraded":"2024-03-26T06:17:03.601044+0000","last_fullsized":"2024-03-26T06:17:03.601044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554519+0000","last_change":"2024-03-26T06:16:58.524155+0000","last_active":"2024-03-26T06:17:03.554519+0000","last_peered":"2024-03-26T06:17:03.554519+0000","last_clean":"2024-03-26T06:17:03.554519+0000","last_became_active":"2024-03-26T06:16:58.523112+0000","last_became_peered":"2024-03-26T06:16:58.523112+0000","last_unstale":"2024-03-26T06:17:03.554519+0000","last_undegraded":"2024-03-26T06:17:03.554519+0000","last_fullsized":"2024-03-26T06:17:03.554519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:35.992415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596126+0000","last_change":"2024-03-26T06:16:57.499837+0000","last_active":"2024-03-26T06:17:03.596126+0000","last_peered":"2024-03-26T06:17:03.596126+0000","last_clean":"2024-03-26T06:17:03.596126+0000","last_became_active":"2024-03-26T06:16:57.499493+0000","last_became_peered":"2024-03-26T06:16:57.499493+0000","last_unstale":"2024-03-26T06:17:03.596126+0000","last_undegraded":"2024-03-26T06:17:03.596126+0000","last_fullsized":"2024-03-26T06:17:03.596126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594334+0000","last_change":"2024-03-26T06:17:02.577832+0000","last_active":"2024-03-26T06:17:03.594334+0000","last_peered":"2024-03-26T06:17:03.594334+0000","last_clean":"2024-03-26T06:17:03.594334+0000","last_became_active":"2024-03-26T06:17:02.576442+0000","last_became_peered":"2024-03-26T06:17:02.576442+0000","last_unstale":"2024-03-26T06:17:03.594334+0000","last_undegraded":"2024-03-26T06:17:03.594334+0000","last_fullsized":"2024-03-26T06:17:03.594334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.602136+0000","last_change":"2024-03-26T06:16:58.552213+0000","last_active":"2024-03-26T06:17:03.602136+0000","last_peered":"2024-03-26T06:17:03.602136+0000","last_clean":"2024-03-26T06:17:03.602136+0000","last_became_active":"2024-03-26T06:16:58.551830+0000","last_became_peered":"2024-03-26T06:16:58.551830+0000","last_unstale":"2024-03-26T06:17:03.602136+0000","last_undegraded":"2024-03-26T06:17:03.602136+0000","last_fullsized":"2024-03-26T06:17:03.602136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:31:28.495785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550919+0000","last_change":"2024-03-26T06:16:57.501329+0000","last_active":"2024-03-26T06:17:03.550919+0000","last_peered":"2024-03-26T06:17:03.550919+0000","last_clean":"2024-03-26T06:17:03.550919+0000","last_became_active":"2024-03-26T06:16:57.500987+0000","last_became_peered":"2024-03-26T06:16:57.500987+0000","last_unstale":"2024-03-26T06:17:03.550919+0000","last_undegraded":"2024-03-26T06:17:03.550919+0000","last_fullsized":"2024-03-26T06:17:03.550919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.552806+0000","last_change":"2024-03-26T06:17:02.872960+0000","last_active":"2024-03-26T06:17:03.552806+0000","last_peered":"2024-03-26T06:17:03.552806+0000","last_clean":"2024-03-26T06:17:03.552806+0000","last_became_active":"2024-03-26T06:17:02.871460+0000","last_became_peered":"2024-03-26T06:17:02.871460+0000","last_unstale":"2024-03-26T06:17:03.552806+0000","last_undegraded":"2024-03-26T06:17:03.552806+0000","last_fullsized":"2024-03-26T06:17:03.552806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:44:47.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601012+0000","last_change":"2024-03-26T06:16:58.534645+0000","last_active":"2024-03-26T06:17:03.601012+0000","last_peered":"2024-03-26T06:17:03.601012+0000","last_clean":"2024-03-26T06:17:03.601012+0000","last_became_active":"2024-03-26T06:16:58.532263+0000","last_became_peered":"2024-03-26T06:16:58.532263+0000","last_unstale":"2024-03-26T06:17:03.601012+0000","last_undegraded":"2024-03-26T06:17:03.601012+0000","last_fullsized":"2024-03-26T06:17:03.601012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:35.992415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601161+0000","last_change":"2024-03-26T06:16:57.495853+0000","last_active":"2024-03-26T06:17:03.601161+0000","last_peered":"2024-03-26T06:17:03.601161+0000","last_clean":"2024-03-26T06:17:03.601161+0000","last_became_active":"2024-03-26T06:16:57.495248+0000","last_became_peered":"2024-03-26T06:16:57.495248+0000","last_unstale":"2024-03-26T06:17:03.601161+0000","last_undegraded":"2024-03-26T06:17:03.601161+0000","last_fullsized":"2024-03-26T06:17:03.601161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:20:43.357850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597470+0000","last_change":"2024-03-26T06:17:02.582195+0000","last_active":"2024-03-26T06:17:03.597470+0000","last_peered":"2024-03-26T06:17:03.597470+0000","last_clean":"2024-03-26T06:17:03.597470+0000","last_became_active":"2024-03-26T06:17:02.581717+0000","last_became_peered":"2024-03-26T06:17:02.581717+0000","last_unstale":"2024-03-26T06:17:03.597470+0000","last_undegraded":"2024-03-26T06:17:03.597470+0000","last_fullsized":"2024-03-26T06:17:03.597470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:19.811246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598827+0000","last_change":"2024-03-26T06:16:58.531961+0000","last_active":"2024-03-26T06:17:03.598827+0000","last_peered":"2024-03-26T06:17:03.598827+0000","last_clean":"2024-03-26T06:17:03.598827+0000","last_became_active":"2024-03-26T06:16:58.531656+0000","last_became_peered":"2024-03-26T06:16:58.531656+0000","last_unstale":"2024-03-26T06:17:03.598827+0000","last_undegraded":"2024-03-26T06:17:03.598827+0000","last_fullsized":"2024-03-26T06:17:03.598827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.549428+0000","last_change":"2024-03-26T06:16:57.488815+0000","last_active":"2024-03-26T06:17:03.549428+0000","last_peered":"2024-03-26T06:17:03.549428+0000","last_clean":"2024-03-26T06:17:03.549428+0000","last_became_active":"2024-03-26T06:16:57.487181+0000","last_became_peered":"2024-03-26T06:16:57.487181+0000","last_unstale":"2024-03-26T06:17:03.549428+0000","last_undegraded":"2024-03-26T06:17:03.549428+0000","last_fullsized":"2024-03-26T06:17:03.549428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:02:07.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594842+0000","last_change":"2024-03-26T06:17:02.580214+0000","last_active":"2024-03-26T06:17:03.594842+0000","last_peered":"2024-03-26T06:17:03.594842+0000","last_clean":"2024-03-26T06:17:03.594842+0000","last_became_active":"2024-03-26T06:17:02.579846+0000","last_became_peered":"2024-03-26T06:17:02.579846+0000","last_unstale":"2024-03-26T06:17:03.594842+0000","last_undegraded":"2024-03-26T06:17:03.594842+0000","last_fullsized":"2024-03-26T06:17:03.594842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:21.194082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595884+0000","last_change":"2024-03-26T06:16:58.514900+0000","last_active":"2024-03-26T06:17:03.595884+0000","last_peered":"2024-03-26T06:17:03.595884+0000","last_clean":"2024-03-26T06:17:03.595884+0000","last_became_active":"2024-03-26T06:16:58.514631+0000","last_became_peered":"2024-03-26T06:16:58.514631+0000","last_unstale":"2024-03-26T06:17:03.595884+0000","last_undegraded":"2024-03-26T06:17:03.595884+0000","last_fullsized":"2024-03-26T06:17:03.595884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595846+0000","last_change":"2024-03-26T06:16:57.507399+0000","last_active":"2024-03-26T06:17:03.595846+0000","last_peered":"2024-03-26T06:17:03.595846+0000","last_clean":"2024-03-26T06:17:03.595846+0000","last_became_active":"2024-03-26T06:16:57.506456+0000","last_became_peered":"2024-03-26T06:16:57.506456+0000","last_unstale":"2024-03-26T06:17:03.595846+0000","last_undegraded":"2024-03-26T06:17:03.595846+0000","last_fullsized":"2024-03-26T06:17:03.595846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556221+0000","last_change":"2024-03-26T06:17:02.887270+0000","last_active":"2024-03-26T06:17:03.556221+0000","last_peered":"2024-03-26T06:17:03.556221+0000","last_clean":"2024-03-26T06:17:03.556221+0000","last_became_active":"2024-03-26T06:17:02.877110+0000","last_became_peered":"2024-03-26T06:17:02.877110+0000","last_unstale":"2024-03-26T06:17:03.556221+0000","last_undegraded":"2024-03-26T06:17:03.556221+0000","last_fullsized":"2024-03-26T06:17:03.556221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:53:39.247476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600081+0000","last_change":"2024-03-26T06:16:58.537036+0000","last_active":"2024-03-26T06:17:03.600081+0000","last_peered":"2024-03-26T06:17:03.600081+0000","last_clean":"2024-03-26T06:17:03.600081+0000","last_became_active":"2024-03-26T06:16:58.536769+0000","last_became_peered":"2024-03-26T06:16:58.536769+0000","last_unstale":"2024-03-26T06:17:03.600081+0000","last_undegraded":"2024-03-26T06:17:03.600081+0000","last_fullsized":"2024-03-26T06:17:03.600081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:35.743222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554459+0000","last_change":"2024-03-26T06:16:57.503002+0000","last_active":"2024-03-26T06:17:03.554459+0000","last_peered":"2024-03-26T06:17:03.554459+0000","last_clean":"2024-03-26T06:17:03.554459+0000","last_became_active":"2024-03-26T06:16:57.502634+0000","last_became_peered":"2024-03-26T06:16:57.502634+0000","last_unstale":"2024-03-26T06:17:03.554459+0000","last_undegraded":"2024-03-26T06:17:03.554459+0000","last_fullsized":"2024-03-26T06:17:03.554459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557086+0000","last_change":"2024-03-26T06:17:02.881309+0000","last_active":"2024-03-26T06:17:03.557086+0000","last_peered":"2024-03-26T06:17:03.557086+0000","last_clean":"2024-03-26T06:17:03.557086+0000","last_became_active":"2024-03-26T06:17:02.875761+0000","last_became_peered":"2024-03-26T06:17:02.875761+0000","last_unstale":"2024-03-26T06:17:03.557086+0000","last_undegraded":"2024-03-26T06:17:03.557086+0000","last_fullsized":"2024-03-26T06:17:03.557086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:12:15.149201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594732+0000","last_change":"2024-03-26T06:16:58.525054+0000","last_active":"2024-03-26T06:17:03.594732+0000","last_peered":"2024-03-26T06:17:03.594732+0000","last_clean":"2024-03-26T06:17:03.594732+0000","last_became_active":"2024-03-26T06:16:58.524608+0000","last_became_peered":"2024-03-26T06:16:58.524608+0000","last_unstale":"2024-03-26T06:17:03.594732+0000","last_undegraded":"2024-03-26T06:17:03.594732+0000","last_fullsized":"2024-03-26T06:17:03.594732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:20:28.424836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595048+0000","last_change":"2024-03-26T06:16:57.496736+0000","last_active":"2024-03-26T06:17:03.595048+0000","last_peered":"2024-03-26T06:17:03.595048+0000","last_clean":"2024-03-26T06:17:03.595048+0000","last_became_active":"2024-03-26T06:16:57.496382+0000","last_became_peered":"2024-03-26T06:16:57.496382+0000","last_unstale":"2024-03-26T06:17:03.595048+0000","last_undegraded":"2024-03-26T06:17:03.595048+0000","last_fullsized":"2024-03-26T06:17:03.595048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:20:43.357850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554993+0000","last_change":"2024-03-26T06:17:02.878453+0000","last_active":"2024-03-26T06:17:03.554993+0000","last_peered":"2024-03-26T06:17:03.554993+0000","last_clean":"2024-03-26T06:17:03.554993+0000","last_became_active":"2024-03-26T06:17:02.871508+0000","last_became_peered":"2024-03-26T06:17:02.871508+0000","last_unstale":"2024-03-26T06:17:03.554993+0000","last_undegraded":"2024-03-26T06:17:03.554993+0000","last_fullsized":"2024-03-26T06:17:03.554993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:56:38.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600456+0000","last_change":"2024-03-26T06:16:58.529916+0000","last_active":"2024-03-26T06:17:03.600456+0000","last_peered":"2024-03-26T06:17:03.600456+0000","last_clean":"2024-03-26T06:17:03.600456+0000","last_became_active":"2024-03-26T06:16:58.529278+0000","last_became_peered":"2024-03-26T06:16:58.529278+0000","last_unstale":"2024-03-26T06:17:03.600456+0000","last_undegraded":"2024-03-26T06:17:03.600456+0000","last_fullsized":"2024-03-26T06:17:03.600456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:10.820581+0000","last_change":"2024-03-26T06:16:57.504243+0000","last_active":"2024-03-26T06:17:10.820581+0000","last_peered":"2024-03-26T06:17:10.820581+0000","last_clean":"2024-03-26T06:17:10.820581+0000","last_became_active":"2024-03-26T06:16:57.503731+0000","last_became_peered":"2024-03-26T06:16:57.503731+0000","last_unstale":"2024-03-26T06:17:10.820581+0000","last_undegraded":"2024-03-26T06:17:10.820581+0000","last_fullsized":"2024-03-26T06:17:10.820581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597671+0000","last_change":"2024-03-26T06:17:02.578804+0000","last_active":"2024-03-26T06:17:03.597671+0000","last_peered":"2024-03-26T06:17:03.597671+0000","last_clean":"2024-03-26T06:17:03.597671+0000","last_became_active":"2024-03-26T06:17:02.577517+0000","last_became_peered":"2024-03-26T06:17:02.577517+0000","last_unstale":"2024-03-26T06:17:03.597671+0000","last_undegraded":"2024-03-26T06:17:03.597671+0000","last_fullsized":"2024-03-26T06:17:03.597671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:40.062808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599668+0000","last_change":"2024-03-26T06:16:58.542622+0000","last_active":"2024-03-26T06:17:03.599668+0000","last_peered":"2024-03-26T06:17:03.599668+0000","last_clean":"2024-03-26T06:17:03.599668+0000","last_became_active":"2024-03-26T06:16:58.542271+0000","last_became_peered":"2024-03-26T06:16:58.542271+0000","last_unstale":"2024-03-26T06:17:03.599668+0000","last_undegraded":"2024-03-26T06:17:03.599668+0000","last_fullsized":"2024-03-26T06:17:03.599668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:31.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596026+0000","last_change":"2024-03-26T06:16:57.503753+0000","last_active":"2024-03-26T06:17:03.596026+0000","last_peered":"2024-03-26T06:17:03.596026+0000","last_clean":"2024-03-26T06:17:03.596026+0000","last_became_active":"2024-03-26T06:16:57.503459+0000","last_became_peered":"2024-03-26T06:16:57.503459+0000","last_unstale":"2024-03-26T06:17:03.596026+0000","last_undegraded":"2024-03-26T06:17:03.596026+0000","last_fullsized":"2024-03-26T06:17:03.596026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600050+0000","last_change":"2024-03-26T06:17:02.581612+0000","last_active":"2024-03-26T06:17:03.600050+0000","last_peered":"2024-03-26T06:17:03.600050+0000","last_clean":"2024-03-26T06:17:03.600050+0000","last_became_active":"2024-03-26T06:17:02.580790+0000","last_became_peered":"2024-03-26T06:17:02.580790+0000","last_unstale":"2024-03-26T06:17:03.600050+0000","last_undegraded":"2024-03-26T06:17:03.600050+0000","last_fullsized":"2024-03-26T06:17:03.600050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594361+0000","last_change":"2024-03-26T06:16:58.533339+0000","last_active":"2024-03-26T06:17:03.594361+0000","last_peered":"2024-03-26T06:17:03.594361+0000","last_clean":"2024-03-26T06:17:03.594361+0000","last_became_active":"2024-03-26T06:16:58.533023+0000","last_became_peered":"2024-03-26T06:16:58.533023+0000","last_unstale":"2024-03-26T06:17:03.594361+0000","last_undegraded":"2024-03-26T06:17:03.594361+0000","last_fullsized":"2024-03-26T06:17:03.594361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554096+0000","last_change":"2024-03-26T06:16:57.505342+0000","last_active":"2024-03-26T06:17:03.554096+0000","last_peered":"2024-03-26T06:17:03.554096+0000","last_clean":"2024-03-26T06:17:03.554096+0000","last_became_active":"2024-03-26T06:16:57.505086+0000","last_became_peered":"2024-03-26T06:16:57.505086+0000","last_unstale":"2024-03-26T06:17:03.554096+0000","last_undegraded":"2024-03-26T06:17:03.554096+0000","last_fullsized":"2024-03-26T06:17:03.554096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554475+0000","last_change":"2024-03-26T06:17:02.580018+0000","last_active":"2024-03-26T06:17:03.554475+0000","last_peered":"2024-03-26T06:17:03.554475+0000","last_clean":"2024-03-26T06:17:03.554475+0000","last_became_active":"2024-03-26T06:17:02.579638+0000","last_became_peered":"2024-03-26T06:17:02.579638+0000","last_unstale":"2024-03-26T06:17:03.554475+0000","last_undegraded":"2024-03-26T06:17:03.554475+0000","last_fullsized":"2024-03-26T06:17:03.554475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:11:12.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553848+0000","last_change":"2024-03-26T06:16:58.533277+0000","last_active":"2024-03-26T06:17:03.553848+0000","last_peered":"2024-03-26T06:17:03.553848+0000","last_clean":"2024-03-26T06:17:03.553848+0000","last_became_active":"2024-03-26T06:16:58.529159+0000","last_became_peered":"2024-03-26T06:16:58.529159+0000","last_unstale":"2024-03-26T06:17:03.553848+0000","last_undegraded":"2024-03-26T06:17:03.553848+0000","last_fullsized":"2024-03-26T06:17:03.553848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:40.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596366+0000","last_change":"2024-03-26T06:16:57.510798+0000","last_active":"2024-03-26T06:17:03.596366+0000","last_peered":"2024-03-26T06:17:03.596366+0000","last_clean":"2024-03-26T06:17:03.596366+0000","last_became_active":"2024-03-26T06:16:57.510512+0000","last_became_peered":"2024-03-26T06:16:57.510512+0000","last_unstale":"2024-03-26T06:17:03.596366+0000","last_undegraded":"2024-03-26T06:17:03.596366+0000","last_fullsized":"2024-03-26T06:17:03.596366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554417+0000","last_change":"2024-03-26T06:17:02.886655+0000","last_active":"2024-03-26T06:17:03.554417+0000","last_peered":"2024-03-26T06:17:03.554417+0000","last_clean":"2024-03-26T06:17:03.554417+0000","last_became_active":"2024-03-26T06:17:02.883226+0000","last_became_peered":"2024-03-26T06:17:02.883226+0000","last_unstale":"2024-03-26T06:17:03.554417+0000","last_undegraded":"2024-03-26T06:17:03.554417+0000","last_fullsized":"2024-03-26T06:17:03.554417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:08:21.367362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594521+0000","last_change":"2024-03-26T06:17:02.884097+0000","last_active":"2024-03-26T06:17:03.594521+0000","last_peered":"2024-03-26T06:17:03.594521+0000","last_clean":"2024-03-26T06:17:03.594521+0000","last_became_active":"2024-03-26T06:17:02.876466+0000","last_became_peered":"2024-03-26T06:17:02.876466+0000","last_unstale":"2024-03-26T06:17:03.594521+0000","last_undegraded":"2024-03-26T06:17:03.594521+0000","last_fullsized":"2024-03-26T06:17:03.594521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593783+0000","last_change":"2024-03-26T06:16:58.519241+0000","last_active":"2024-03-26T06:17:03.593783+0000","last_peered":"2024-03-26T06:17:03.593783+0000","last_clean":"2024-03-26T06:17:03.593783+0000","last_became_active":"2024-03-26T06:16:58.518964+0000","last_became_peered":"2024-03-26T06:16:58.518964+0000","last_unstale":"2024-03-26T06:17:03.593783+0000","last_undegraded":"2024-03-26T06:17:03.593783+0000","last_fullsized":"2024-03-26T06:17:03.593783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553403+0000","last_change":"2024-03-26T06:16:57.501927+0000","last_active":"2024-03-26T06:17:03.553403+0000","last_peered":"2024-03-26T06:17:03.553403+0000","last_clean":"2024-03-26T06:17:03.553403+0000","last_became_active":"2024-03-26T06:16:57.501575+0000","last_became_peered":"2024-03-26T06:16:57.501575+0000","last_unstale":"2024-03-26T06:17:03.553403+0000","last_undegraded":"2024-03-26T06:17:03.553403+0000","last_fullsized":"2024-03-26T06:17:03.553403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596166+0000","last_change":"2024-03-26T06:17:02.573739+0000","last_active":"2024-03-26T06:17:03.596166+0000","last_peered":"2024-03-26T06:17:03.596166+0000","last_clean":"2024-03-26T06:17:03.596166+0000","last_became_active":"2024-03-26T06:17:02.573280+0000","last_became_peered":"2024-03-26T06:17:02.573280+0000","last_unstale":"2024-03-26T06:17:03.596166+0000","last_undegraded":"2024-03-26T06:17:03.596166+0000","last_fullsized":"2024-03-26T06:17:03.596166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554477+0000","last_change":"2024-03-26T06:16:58.516850+0000","last_active":"2024-03-26T06:17:03.554477+0000","last_peered":"2024-03-26T06:17:03.554477+0000","last_clean":"2024-03-26T06:17:03.554477+0000","last_became_active":"2024-03-26T06:16:58.516487+0000","last_became_peered":"2024-03-26T06:16:58.516487+0000","last_unstale":"2024-03-26T06:17:03.554477+0000","last_undegraded":"2024-03-26T06:17:03.554477+0000","last_fullsized":"2024-03-26T06:17:03.554477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554926+0000","last_change":"2024-03-26T06:16:57.505539+0000","last_active":"2024-03-26T06:17:03.554926+0000","last_peered":"2024-03-26T06:17:03.554926+0000","last_clean":"2024-03-26T06:17:03.554926+0000","last_became_active":"2024-03-26T06:16:57.504681+0000","last_became_peered":"2024-03-26T06:16:57.504681+0000","last_unstale":"2024-03-26T06:17:03.554926+0000","last_undegraded":"2024-03-26T06:17:03.554926+0000","last_fullsized":"2024-03-26T06:17:03.554926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:02:07.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596247+0000","last_change":"2024-03-26T06:16:57.508895+0000","last_active":"2024-03-26T06:17:03.596247+0000","last_peered":"2024-03-26T06:17:03.596247+0000","last_clean":"2024-03-26T06:17:03.596247+0000","last_became_active":"2024-03-26T06:16:57.508519+0000","last_became_peered":"2024-03-26T06:16:57.508519+0000","last_unstale":"2024-03-26T06:17:03.596247+0000","last_undegraded":"2024-03-26T06:17:03.596247+0000","last_fullsized":"2024-03-26T06:17:03.596247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594814+0000","last_change":"2024-03-26T06:16:58.529802+0000","last_active":"2024-03-26T06:17:03.594814+0000","last_peered":"2024-03-26T06:17:03.594814+0000","last_clean":"2024-03-26T06:17:03.594814+0000","last_became_active":"2024-03-26T06:16:58.529237+0000","last_became_peered":"2024-03-26T06:16:58.529237+0000","last_unstale":"2024-03-26T06:17:03.594814+0000","last_undegraded":"2024-03-26T06:17:03.594814+0000","last_fullsized":"2024-03-26T06:17:03.594814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.551059+0000","last_change":"2024-03-26T06:17:02.579718+0000","last_active":"2024-03-26T06:17:03.551059+0000","last_peered":"2024-03-26T06:17:03.551059+0000","last_clean":"2024-03-26T06:17:03.551059+0000","last_became_active":"2024-03-26T06:17:02.579292+0000","last_became_peered":"2024-03-26T06:17:02.579292+0000","last_unstale":"2024-03-26T06:17:03.551059+0000","last_undegraded":"2024-03-26T06:17:03.551059+0000","last_fullsized":"2024-03-26T06:17:03.551059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:20:32.495229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555975+0000","last_change":"2024-03-26T06:16:57.505594+0000","last_active":"2024-03-26T06:17:03.555975+0000","last_peered":"2024-03-26T06:17:03.555975+0000","last_clean":"2024-03-26T06:17:03.555975+0000","last_became_active":"2024-03-26T06:16:57.504217+0000","last_became_peered":"2024-03-26T06:16:57.504217+0000","last_unstale":"2024-03-26T06:17:03.555975+0000","last_undegraded":"2024-03-26T06:17:03.555975+0000","last_fullsized":"2024-03-26T06:17:03.555975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:56.691656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597497+0000","last_change":"2024-03-26T06:16:58.525527+0000","last_active":"2024-03-26T06:17:03.597497+0000","last_peered":"2024-03-26T06:17:03.597497+0000","last_clean":"2024-03-26T06:17:03.597497+0000","last_became_active":"2024-03-26T06:16:58.525120+0000","last_became_peered":"2024-03-26T06:16:58.525120+0000","last_unstale":"2024-03-26T06:17:03.597497+0000","last_undegraded":"2024-03-26T06:17:03.597497+0000","last_fullsized":"2024-03-26T06:17:03.597497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:16.071262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555281+0000","last_change":"2024-03-26T06:17:02.579294+0000","last_active":"2024-03-26T06:17:03.555281+0000","last_peered":"2024-03-26T06:17:03.555281+0000","last_clean":"2024-03-26T06:17:03.555281+0000","last_became_active":"2024-03-26T06:17:02.578906+0000","last_became_peered":"2024-03-26T06:17:02.578906+0000","last_unstale":"2024-03-26T06:17:03.555281+0000","last_undegraded":"2024-03-26T06:17:03.555281+0000","last_fullsized":"2024-03-26T06:17:03.555281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:53:09.876582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595338+0000","last_change":"2024-03-26T06:16:58.516379+0000","last_active":"2024-03-26T06:17:03.595338+0000","last_peered":"2024-03-26T06:17:03.595338+0000","last_clean":"2024-03-26T06:17:03.595338+0000","last_became_active":"2024-03-26T06:16:58.516077+0000","last_became_peered":"2024-03-26T06:16:58.516077+0000","last_unstale":"2024-03-26T06:17:03.595338+0000","last_undegraded":"2024-03-26T06:17:03.595338+0000","last_fullsized":"2024-03-26T06:17:03.595338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.549738+0000","last_change":"2024-03-26T06:16:58.532505+0000","last_active":"2024-03-26T06:17:03.549738+0000","last_peered":"2024-03-26T06:17:03.549738+0000","last_clean":"2024-03-26T06:17:03.549738+0000","last_became_active":"2024-03-26T06:16:58.529934+0000","last_became_peered":"2024-03-26T06:16:58.529934+0000","last_unstale":"2024-03-26T06:17:03.549738+0000","last_undegraded":"2024-03-26T06:17:03.549738+0000","last_fullsized":"2024-03-26T06:17:03.549738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:31.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554160+0000","last_change":"2024-03-26T06:16:58.522722+0000","last_active":"2024-03-26T06:17:03.554160+0000","last_peered":"2024-03-26T06:17:03.554160+0000","last_clean":"2024-03-26T06:17:03.554160+0000","last_became_active":"2024-03-26T06:16:58.522370+0000","last_became_peered":"2024-03-26T06:16:58.522370+0000","last_unstale":"2024-03-26T06:17:03.554160+0000","last_undegraded":"2024-03-26T06:17:03.554160+0000","last_fullsized":"2024-03-26T06:17:03.554160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594678+0000","last_change":"2024-03-26T06:16:58.520281+0000","last_active":"2024-03-26T06:17:03.594678+0000","last_peered":"2024-03-26T06:17:03.594678+0000","last_clean":"2024-03-26T06:17:03.594678+0000","last_became_active":"2024-03-26T06:16:58.519985+0000","last_became_peered":"2024-03-26T06:16:58.519985+0000","last_unstale":"2024-03-26T06:17:03.594678+0000","last_undegraded":"2024-03-26T06:17:03.594678+0000","last_fullsized":"2024-03-26T06:17:03.594678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557423+0000","last_change":"2024-03-26T06:16:58.529109+0000","last_active":"2024-03-26T06:17:03.557423+0000","last_peered":"2024-03-26T06:17:03.557423+0000","last_clean":"2024-03-26T06:17:03.557423+0000","last_became_active":"2024-03-26T06:16:58.528801+0000","last_became_peered":"2024-03-26T06:16:58.528801+0000","last_unstale":"2024-03-26T06:17:03.557423+0000","last_undegraded":"2024-03-26T06:17:03.557423+0000","last_fullsized":"2024-03-26T06:17:03.557423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595616+0000","last_change":"2024-03-26T06:16:58.520275+0000","last_active":"2024-03-26T06:17:03.595616+0000","last_peered":"2024-03-26T06:17:03.595616+0000","last_clean":"2024-03-26T06:17:03.595616+0000","last_became_active":"2024-03-26T06:16:58.519968+0000","last_became_peered":"2024-03-26T06:16:58.519968+0000","last_unstale":"2024-03-26T06:17:03.595616+0000","last_undegraded":"2024-03-26T06:17:03.595616+0000","last_fullsized":"2024-03-26T06:17:03.595616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600878+0000","last_change":"2024-03-26T06:16:58.529307+0000","last_active":"2024-03-26T06:17:03.600878+0000","last_peered":"2024-03-26T06:17:03.600878+0000","last_clean":"2024-03-26T06:17:03.600878+0000","last_became_active":"2024-03-26T06:16:58.528918+0000","last_became_peered":"2024-03-26T06:16:58.528918+0000","last_unstale":"2024-03-26T06:17:03.600878+0000","last_undegraded":"2024-03-26T06:17:03.600878+0000","last_fullsized":"2024-03-26T06:17:03.600878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556360+0000","last_change":"2024-03-26T06:16:58.529346+0000","last_active":"2024-03-26T06:17:03.556360+0000","last_peered":"2024-03-26T06:17:03.556360+0000","last_clean":"2024-03-26T06:17:03.556360+0000","last_became_active":"2024-03-26T06:16:58.528998+0000","last_became_peered":"2024-03-26T06:16:58.528998+0000","last_unstale":"2024-03-26T06:17:03.556360+0000","last_undegraded":"2024-03-26T06:17:03.556360+0000","last_fullsized":"2024-03-26T06:17:03.556360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553105+0000","last_change":"2024-03-26T06:16:58.524089+0000","last_active":"2024-03-26T06:17:03.553105+0000","last_peered":"2024-03-26T06:17:03.553105+0000","last_clean":"2024-03-26T06:17:03.553105+0000","last_became_active":"2024-03-26T06:16:58.522756+0000","last_became_peered":"2024-03-26T06:16:58.522756+0000","last_unstale":"2024-03-26T06:17:03.553105+0000","last_undegraded":"2024-03-26T06:17:03.553105+0000","last_fullsized":"2024-03-26T06:17:03.553105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554786+0000","last_change":"2024-03-26T06:16:58.530175+0000","last_active":"2024-03-26T06:17:03.554786+0000","last_peered":"2024-03-26T06:17:03.554786+0000","last_clean":"2024-03-26T06:17:03.554786+0000","last_became_active":"2024-03-26T06:16:58.529900+0000","last_became_peered":"2024-03-26T06:16:58.529900+0000","last_unstale":"2024-03-26T06:17:03.554786+0000","last_undegraded":"2024-03-26T06:17:03.554786+0000","last_fullsized":"2024-03-26T06:17:03.554786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553982+0000","last_change":"2024-03-26T06:16:58.529902+0000","last_active":"2024-03-26T06:17:03.553982+0000","last_peered":"2024-03-26T06:17:03.553982+0000","last_clean":"2024-03-26T06:17:03.553982+0000","last_became_active":"2024-03-26T06:16:58.525109+0000","last_became_peered":"2024-03-26T06:16:58.525109+0000","last_unstale":"2024-03-26T06:17:03.553982+0000","last_undegraded":"2024-03-26T06:17:03.553982+0000","last_fullsized":"2024-03-26T06:17:03.553982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593384+0000","last_change":"2024-03-26T06:16:58.529175+0000","last_active":"2024-03-26T06:17:03.593384+0000","last_peered":"2024-03-26T06:17:03.593384+0000","last_clean":"2024-03-26T06:17:03.593384+0000","last_became_active":"2024-03-26T06:16:58.525707+0000","last_became_peered":"2024-03-26T06:16:58.525707+0000","last_unstale":"2024-03-26T06:17:03.593384+0000","last_undegraded":"2024-03-26T06:17:03.593384+0000","last_fullsized":"2024-03-26T06:17:03.593384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:22:40.139697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595961+0000","last_change":"2024-03-26T06:16:58.526724+0000","last_active":"2024-03-26T06:17:03.595961+0000","last_peered":"2024-03-26T06:17:03.595961+0000","last_clean":"2024-03-26T06:17:03.595961+0000","last_became_active":"2024-03-26T06:16:58.526193+0000","last_became_peered":"2024-03-26T06:16:58.526193+0000","last_unstale":"2024-03-26T06:17:03.595961+0000","last_undegraded":"2024-03-26T06:17:03.595961+0000","last_fullsized":"2024-03-26T06:17:03.595961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601351+0000","last_change":"2024-03-26T06:16:58.527308+0000","last_active":"2024-03-26T06:17:03.601351+0000","last_peered":"2024-03-26T06:17:03.601351+0000","last_clean":"2024-03-26T06:17:03.601351+0000","last_became_active":"2024-03-26T06:16:58.526990+0000","last_became_peered":"2024-03-26T06:16:58.526990+0000","last_unstale":"2024-03-26T06:17:03.601351+0000","last_undegraded":"2024-03-26T06:17:03.601351+0000","last_fullsized":"2024-03-26T06:17:03.601351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:40.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550779+0000","last_change":"2024-03-26T06:16:58.522409+0000","last_active":"2024-03-26T06:17:03.550779+0000","last_peered":"2024-03-26T06:17:03.550779+0000","last_clean":"2024-03-26T06:17:03.550779+0000","last_became_active":"2024-03-26T06:16:58.521947+0000","last_became_peered":"2024-03-26T06:16:58.521947+0000","last_unstale":"2024-03-26T06:17:03.550779+0000","last_undegraded":"2024-03-26T06:17:03.550779+0000","last_fullsized":"2024-03-26T06:17:03.550779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:28.052525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554877+0000","last_change":"2024-03-26T06:16:58.541494+0000","last_active":"2024-03-26T06:17:03.554877+0000","last_peered":"2024-03-26T06:17:03.554877+0000","last_clean":"2024-03-26T06:17:03.554877+0000","last_became_active":"2024-03-26T06:16:58.541225+0000","last_became_peered":"2024-03-26T06:16:58.541225+0000","last_unstale":"2024-03-26T06:17:03.554877+0000","last_undegraded":"2024-03-26T06:17:03.554877+0000","last_fullsized":"2024-03-26T06:17:03.554877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:35.743222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.552810+0000","last_change":"2024-03-26T06:16:58.533315+0000","last_active":"2024-03-26T06:17:03.552810+0000","last_peered":"2024-03-26T06:17:03.552810+0000","last_clean":"2024-03-26T06:17:03.552810+0000","last_became_active":"2024-03-26T06:16:58.528051+0000","last_became_peered":"2024-03-26T06:16:58.528051+0000","last_unstale":"2024-03-26T06:17:03.552810+0000","last_undegraded":"2024-03-26T06:17:03.552810+0000","last_fullsized":"2024-03-26T06:17:03.552810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594978+0000","last_change":"2024-03-26T06:16:58.527009+0000","last_active":"2024-03-26T06:17:03.594978+0000","last_peered":"2024-03-26T06:17:03.594978+0000","last_clean":"2024-03-26T06:17:03.594978+0000","last_became_active":"2024-03-26T06:16:58.526743+0000","last_became_peered":"2024-03-26T06:16:58.526743+0000","last_unstale":"2024-03-26T06:17:03.594978+0000","last_undegraded":"2024-03-26T06:17:03.594978+0000","last_fullsized":"2024-03-26T06:17:03.594978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594651+0000","last_change":"2024-03-26T06:16:58.507099+0000","last_active":"2024-03-26T06:17:03.594651+0000","last_peered":"2024-03-26T06:17:03.594651+0000","last_clean":"2024-03-26T06:17:03.594651+0000","last_became_active":"2024-03-26T06:16:58.506705+0000","last_became_peered":"2024-03-26T06:16:58.506705+0000","last_unstale":"2024-03-26T06:17:03.594651+0000","last_undegraded":"2024-03-26T06:17:03.594651+0000","last_fullsized":"2024-03-26T06:17:03.594651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:17:59.821941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555438+0000","last_change":"2024-03-26T06:16:58.516376+0000","last_active":"2024-03-26T06:17:03.555438+0000","last_peered":"2024-03-26T06:17:03.555438+0000","last_clean":"2024-03-26T06:17:03.555438+0000","last_became_active":"2024-03-26T06:16:58.515999+0000","last_became_peered":"2024-03-26T06:16:58.515999+0000","last_unstale":"2024-03-26T06:17:03.555438+0000","last_undegraded":"2024-03-26T06:17:03.555438+0000","last_fullsized":"2024-03-26T06:17:03.555438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599454+0000","last_change":"2024-03-26T06:16:58.544901+0000","last_active":"2024-03-26T06:17:03.599454+0000","last_peered":"2024-03-26T06:17:03.599454+0000","last_clean":"2024-03-26T06:17:03.599454+0000","last_became_active":"2024-03-26T06:16:58.544637+0000","last_became_peered":"2024-03-26T06:16:58.544637+0000","last_unstale":"2024-03-26T06:17:03.599454+0000","last_undegraded":"2024-03-26T06:17:03.599454+0000","last_fullsized":"2024-03-26T06:17:03.599454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:28.052525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596829+0000","last_change":"2024-03-26T06:16:58.536619+0000","last_active":"2024-03-26T06:17:03.596829+0000","last_peered":"2024-03-26T06:17:03.596829+0000","last_clean":"2024-03-26T06:17:03.596829+0000","last_became_active":"2024-03-26T06:16:58.536267+0000","last_became_peered":"2024-03-26T06:16:58.536267+0000","last_unstale":"2024-03-26T06:17:03.596829+0000","last_undegraded":"2024-03-26T06:17:03.596829+0000","last_fullsized":"2024-03-26T06:17:03.596829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600622+0000","last_change":"2024-03-26T06:16:58.538210+0000","last_active":"2024-03-26T06:17:03.600622+0000","last_peered":"2024-03-26T06:17:03.600622+0000","last_clean":"2024-03-26T06:17:03.600622+0000","last_became_active":"2024-03-26T06:16:58.537967+0000","last_became_peered":"2024-03-26T06:16:58.537967+0000","last_unstale":"2024-03-26T06:17:03.600622+0000","last_undegraded":"2024-03-26T06:17:03.600622+0000","last_fullsized":"2024-03-26T06:17:03.600622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.602020+0000","last_change":"2024-03-26T06:16:58.540273+0000","last_active":"2024-03-26T06:17:03.602020+0000","last_peered":"2024-03-26T06:17:03.602020+0000","last_clean":"2024-03-26T06:17:03.602020+0000","last_became_active":"2024-03-26T06:16:58.539908+0000","last_became_peered":"2024-03-26T06:16:58.539908+0000","last_unstale":"2024-03-26T06:17:03.602020+0000","last_undegraded":"2024-03-26T06:17:03.602020+0000","last_fullsized":"2024-03-26T06:17:03.602020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:12:57.541865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554144+0000","last_change":"2024-03-26T06:16:58.535528+0000","last_active":"2024-03-26T06:17:03.554144+0000","last_peered":"2024-03-26T06:17:03.554144+0000","last_clean":"2024-03-26T06:17:03.554144+0000","last_became_active":"2024-03-26T06:16:58.535213+0000","last_became_peered":"2024-03-26T06:16:58.535213+0000","last_unstale":"2024-03-26T06:17:03.554144+0000","last_undegraded":"2024-03-26T06:17:03.554144+0000","last_fullsized":"2024-03-26T06:17:03.554144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598687+0000","last_change":"2024-03-26T06:16:58.525785+0000","last_active":"2024-03-26T06:17:03.598687+0000","last_peered":"2024-03-26T06:17:03.598687+0000","last_clean":"2024-03-26T06:17:03.598687+0000","last_became_active":"2024-03-26T06:16:58.525444+0000","last_became_peered":"2024-03-26T06:16:58.525444+0000","last_unstale":"2024-03-26T06:17:03.598687+0000","last_undegraded":"2024-03-26T06:17:03.598687+0000","last_fullsized":"2024-03-26T06:17:03.598687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553717+0000","last_change":"2024-03-26T06:16:58.532698+0000","last_active":"2024-03-26T06:17:03.553717+0000","last_peered":"2024-03-26T06:17:03.553717+0000","last_clean":"2024-03-26T06:17:03.553717+0000","last_became_active":"2024-03-26T06:16:58.532381+0000","last_became_peered":"2024-03-26T06:16:58.532381+0000","last_unstale":"2024-03-26T06:17:03.553717+0000","last_undegraded":"2024-03-26T06:17:03.553717+0000","last_fullsized":"2024-03-26T06:17:03.553717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599589+0000","last_change":"2024-03-26T06:16:58.524657+0000","last_active":"2024-03-26T06:17:03.599589+0000","last_peered":"2024-03-26T06:17:03.599589+0000","last_clean":"2024-03-26T06:17:03.599589+0000","last_became_active":"2024-03-26T06:16:58.524265+0000","last_became_peered":"2024-03-26T06:16:58.524265+0000","last_unstale":"2024-03-26T06:17:03.599589+0000","last_undegraded":"2024-03-26T06:17:03.599589+0000","last_fullsized":"2024-03-26T06:17:03.599589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:30.208261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553997+0000","last_change":"2024-03-26T06:16:58.523272+0000","last_active":"2024-03-26T06:17:03.553997+0000","last_peered":"2024-03-26T06:17:03.553997+0000","last_clean":"2024-03-26T06:17:03.553997+0000","last_became_active":"2024-03-26T06:16:58.522614+0000","last_became_peered":"2024-03-26T06:16:58.522614+0000","last_unstale":"2024-03-26T06:17:03.553997+0000","last_undegraded":"2024-03-26T06:17:03.553997+0000","last_fullsized":"2024-03-26T06:17:03.553997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:17.123689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594564+0000","last_change":"2024-03-26T06:16:58.519796+0000","last_active":"2024-03-26T06:17:03.594564+0000","last_peered":"2024-03-26T06:17:03.594564+0000","last_clean":"2024-03-26T06:17:03.594564+0000","last_became_active":"2024-03-26T06:16:58.516658+0000","last_became_peered":"2024-03-26T06:16:58.516658+0000","last_unstale":"2024-03-26T06:17:03.594564+0000","last_undegraded":"2024-03-26T06:17:03.594564+0000","last_fullsized":"2024-03-26T06:17:03.594564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:19:35.554524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595916+0000","last_change":"2024-03-26T06:16:58.505664+0000","last_active":"2024-03-26T06:17:03.595916+0000","last_peered":"2024-03-26T06:17:03.595916+0000","last_clean":"2024-03-26T06:17:03.595916+0000","last_became_active":"2024-03-26T06:16:58.505309+0000","last_became_peered":"2024-03-26T06:16:58.505309+0000","last_unstale":"2024-03-26T06:17:03.595916+0000","last_undegraded":"2024-03-26T06:17:03.595916+0000","last_fullsized":"2024-03-26T06:17:03.595916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601776+0000","last_change":"2024-03-26T06:16:58.539992+0000","last_active":"2024-03-26T06:17:03.601776+0000","last_peered":"2024-03-26T06:17:03.601776+0000","last_clean":"2024-03-26T06:17:03.601776+0000","last_became_active":"2024-03-26T06:16:58.539588+0000","last_became_peered":"2024-03-26T06:16:58.539588+0000","last_unstale":"2024-03-26T06:17:03.601776+0000","last_undegraded":"2024-03-26T06:17:03.601776+0000","last_fullsized":"2024-03-26T06:17:03.601776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:17.123689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-26T06:17:22.131 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-26T06:17:22.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.393+0000 7f6b43a00640 1 Processor -- start 2024-03-26T06:17:22.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.393+0000 7f6b43a00640 1 -- start start 2024-03-26T06:17:22.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.394+0000 7f6b43a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c15dc30 0x7f6b3c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.394+0000 7f6b43a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6b3c161810 0x7f6b3c0d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.394+0000 7f6b43a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c0d38f0 con 0x7f6b3c0d0a20 2024-03-26T06:17:22.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.394+0000 7f6b43a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c0d1ed0 con 0x7f6b3c161810 2024-03-26T06:17:22.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.394+0000 7f6b43a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0cf3b0 con 0x7f6b3c15dc30 2024-03-26T06:17:22.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.395+0000 7f6b41a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6b3c0d0a20 0x7f6b3c06c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43812/0 (socket says 172.21.15.63:43812) 2024-03-26T06:17:22.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.395+0000 7f6b41a00640 1 -- 172.21.15.63:0/2681534527 learned_addr learned my addr 172.21.15.63:0/2681534527 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:22.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.395+0000 7f6b41000640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c15dc30 0x7f6b3c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.395+0000 7f6b3be00640 1 --2- 172.21.15.63:0/2681534527 >> v2:172.21.15.204:3300/0 conn(0x7f6b3c161810 0x7f6b3c0d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.395+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974288478 0 0) 0x7f6b34001110 con 0x7f6b3c0d0a20 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.395+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b20003520 con 0x7f6b3c0d0a20 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1645399426 0 0) 0x7f6b20003520 con 0x7f6b3c0d0a20 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c15dc30 msgr2=0x7f6b3c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c15dc30 0x7f6b3c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 >> v2:172.21.15.204:3300/0 conn(0x7f6b3c161810 msgr2=0x7f6b3c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 --2- 172.21.15.63:0/2681534527 >> v2:172.21.15.204:3300/0 conn(0x7f6b3c161810 0x7f6b3c0d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0ceb10 con 0x7f6b3c0d0a20 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f6b34001840 con 0x7f6b3c0d0a20 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 >> v1:172.21.15.63:6789/0 conn(0x7f6b3c0d0a20 legacy=0x7f6b3c06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b20004800 0x7f6b20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c15dc30 0x7f6b200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0d1ed0 con 0x7f6b200039b0 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0cf3b0 con 0x7f6b20004800 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2000b9c0 con 0x7f6b3c15dc30 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.396+0000 7f6b41000640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.397+0000 7f6b41a00640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c15dc30 0x7f6b200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.397+0000 7f6b3be00640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b20004800 0x7f6b20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.397+0000 7f6b41000640 1 -- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c15dc30 msgr2=0x7f6b200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.397+0000 7f6b41000640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c15dc30 0x7f6b200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.397+0000 7f6b41000640 1 -- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b20004800 msgr2=0x7f6b20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.397+0000 7f6b41000640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b20004800 0x7f6b20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.397+0000 7f6b41000640 1 -- 172.21.15.63:0/2681534527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20003520 con 0x7f6b200039b0 2024-03-26T06:17:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.398+0000 7f6b41000640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b20003dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009fc0 tx=0x7f6b20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475d062e3b0ea318 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.398+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c039070 con 0x7f6b200039b0 2024-03-26T06:17:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.398+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c02cc20 con 0x7f6b200039b0 2024-03-26T06:17:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.398+0000 7f6b3b400640 1 -- 172.21.15.63:0/2681534527 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c009c10 con 0x7f6b200039b0 2024-03-26T06:17:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.399+0000 7f6b43a00640 1 -- 172.21.15.63:0/2681534527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 msgr2=0x7f6b20003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.399+0000 7f6b43a00640 1 --2- 172.21.15.63:0/2681534527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b20003dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009fc0 tx=0x7f6b20005830 comp rx=0 tx=0).stop 2024-03-26T06:17:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.399+0000 7f6b41a00640 1 -- 172.21.15.63:0/2681534527 reap_dead start 2024-03-26T06:17:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.399+0000 7f6b43a00640 1 -- 172.21.15.63:0/2681534527 shutdown_connections 2024-03-26T06:17:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.399+0000 7f6b43a00640 1 -- 172.21.15.63:0/2681534527 >> 172.21.15.63:0/2681534527 conn(0x7f6b3c0729f0 msgr2=0x7f6b3c0b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:22.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.399+0000 7f6b43a00640 1 -- 172.21.15.63:0/2681534527 shutdown_connections 2024-03-26T06:17:22.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.399+0000 7f6b43a00640 1 -- 172.21.15.63:0/2681534527 wait complete. 2024-03-26T06:17:22.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.401+0000 7f6b43a00640 1 Processor -- start 2024-03-26T06:17:22.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.401+0000 7f6b43a00640 1 -- start start 2024-03-26T06:17:22.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b43a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b3c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b43a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b3c1f3c60 0x7f6b3c1f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b43a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c1f7740 0x7f6b3c14db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b43a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0d3370 con 0x7f6b200039b0 2024-03-26T06:17:22.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b43a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0cf0d0 con 0x7f6b3c1f3c60 2024-03-26T06:17:22.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b43a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c15e010 con 0x7f6b3c1f7740 2024-03-26T06:17:22.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b41000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b3c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b41000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b3c157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49608/0 (socket says 172.21.15.63:49608) 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b41000640 1 -- 172.21.15.63:0/4260876128 learned_addr learned my addr 172.21.15.63:0/4260876128 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.402+0000 7f6b41a00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c1f7740 0x7f6b3c14db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b3be00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b3c1f3c60 0x7f6b3c1f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b41000640 1 -- 172.21.15.63:0/4260876128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c1f7740 msgr2=0x7f6b3c14db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b41000640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c1f7740 0x7f6b3c14db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b41000640 1 -- 172.21.15.63:0/4260876128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b3c1f3c60 msgr2=0x7f6b3c1f7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b41000640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b3c1f3c60 0x7f6b3c1f7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b41000640 1 -- 172.21.15.63:0/4260876128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0cc9d0 con 0x7f6b200039b0 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b3be00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b3c1f3c60 0x7f6b3c1f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b41000640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b3c157a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00e230 tx=0x7f6b2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b38c00640 1 -- 172.21.15.63:0/4260876128 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c039050 con 0x7f6b200039b0 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b38c00640 1 -- 172.21.15.63:0/4260876128 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c03a040 con 0x7f6b200039b0 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b38c00640 1 -- 172.21.15.63:0/4260876128 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c003bb0 con 0x7f6b200039b0 2024-03-26T06:17:22.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3c1f7c30 con 0x7f6b200039b0 2024-03-26T06:17:22.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.403+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c0ccc90 con 0x7f6b200039b0 2024-03-26T06:17:22.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.405+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c074730 con 0x7f6b200039b0 2024-03-26T06:17:22.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.406+0000 7f6b38c00640 1 -- 172.21.15.63:0/4260876128 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6b2c004030 con 0x7f6b200039b0 2024-03-26T06:17:22.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.406+0000 7f6b38c00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6b1c06bbd0 0x7f6b1c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.407+0000 7f6b38c00640 1 -- 172.21.15.63:0/4260876128 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6b2c0ad710 con 0x7f6b200039b0 2024-03-26T06:17:22.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.407+0000 7f6b3be00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6b1c06bbd0 0x7f6b1c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.407+0000 7f6b3be00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6b1c06bbd0 0x7f6b1c06e090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0b69d0 tx=0x7f6b28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:22.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.411+0000 7f6b38c00640 1 -- 172.21.15.63:0/4260876128 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f6b2c07bf40 con 0x7f6b200039b0 2024-03-26T06:17:22.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.613+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 --> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b3c1f8150 con 0x7f6b1c06bbd0 2024-03-26T06:17:22.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.636+0000 7f6b38c00640 1 -- 172.21.15.63:0/4260876128 <== mgr.4104 v2:172.21.15.63:6832/3591189670 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7f6b28004030 con 0x7f6b1c06bbd0 2024-03-26T06:17:22.641 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:22.643 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.643+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6b1c06bbd0 msgr2=0x7f6b1c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.643+0000 7f6b43a00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6b1c06bbd0 0x7f6b1c06e090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0b69d0 tx=0x7f6b28008040 comp rx=0 tx=0).stop 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.643+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 msgr2=0x7f6b3c157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.643+0000 7f6b43a00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b3c157a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00e230 tx=0x7f6b2c009750 comp rx=0 tx=0).stop 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.644+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 shutdown_connections 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.644+0000 7f6b43a00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6b1c06bbd0 0x7f6b1c06e090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.644+0000 7f6b43a00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b3c1f7740 0x7f6b3c14db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.644+0000 7f6b43a00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b3c1f3c60 0x7f6b3c1f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.644+0000 7f6b43a00640 1 --2- 172.21.15.63:0/4260876128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b200039b0 0x7f6b3c157a50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.644+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 >> 172.21.15.63:0/4260876128 conn(0x7f6b3c0729f0 msgr2=0x7f6b3c0b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:22.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.644+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 shutdown_connections 2024-03-26T06:17:22.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.644+0000 7f6b43a00640 1 -- 172.21.15.63:0/4260876128 wait complete. 2024-03-26T06:17:22.666 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-03-26T06:17:21.884346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2029150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004096"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595035+0000","last_change":"2024-03-26T06:16:57.506890+0000","last_active":"2024-03-26T06:17:03.595035+0000","last_peered":"2024-03-26T06:17:03.595035+0000","last_clean":"2024-03-26T06:17:03.595035+0000","last_became_active":"2024-03-26T06:16:57.506602+0000","last_became_peered":"2024-03-26T06:16:57.506602+0000","last_unstale":"2024-03-26T06:17:03.595035+0000","last_undegraded":"2024-03-26T06:17:03.595035+0000","last_fullsized":"2024-03-26T06:17:03.595035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:14:13.027200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557577+0000","last_change":"2024-03-26T06:16:58.527848+0000","last_active":"2024-03-26T06:17:03.557577+0000","last_peered":"2024-03-26T06:17:03.557577+0000","last_clean":"2024-03-26T06:17:03.557577+0000","last_became_active":"2024-03-26T06:16:58.527552+0000","last_became_peered":"2024-03-26T06:16:58.527552+0000","last_unstale":"2024-03-26T06:17:03.557577+0000","last_undegraded":"2024-03-26T06:17:03.557577+0000","last_fullsized":"2024-03-26T06:17:03.557577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554184+0000","last_change":"2024-03-26T06:17:02.883862+0000","last_active":"2024-03-26T06:17:03.554184+0000","last_peered":"2024-03-26T06:17:03.554184+0000","last_clean":"2024-03-26T06:17:03.554184+0000","last_became_active":"2024-03-26T06:17:02.883030+0000","last_became_peered":"2024-03-26T06:17:02.883030+0000","last_unstale":"2024-03-26T06:17:03.554184+0000","last_undegraded":"2024-03-26T06:17:03.554184+0000","last_fullsized":"2024-03-26T06:17:03.554184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:54:39.278678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557980+0000","last_change":"2024-03-26T06:16:57.498142+0000","last_active":"2024-03-26T06:17:03.557980+0000","last_peered":"2024-03-26T06:17:03.557980+0000","last_clean":"2024-03-26T06:17:03.557980+0000","last_became_active":"2024-03-26T06:16:57.497676+0000","last_became_peered":"2024-03-26T06:16:57.497676+0000","last_unstale":"2024-03-26T06:17:03.557980+0000","last_undegraded":"2024-03-26T06:17:03.557980+0000","last_fullsized":"2024-03-26T06:17:03.557980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594151+0000","last_change":"2024-03-26T06:16:58.533520+0000","last_active":"2024-03-26T06:17:03.594151+0000","last_peered":"2024-03-26T06:17:03.594151+0000","last_clean":"2024-03-26T06:17:03.594151+0000","last_became_active":"2024-03-26T06:16:58.532799+0000","last_became_peered":"2024-03-26T06:16:58.532799+0000","last_unstale":"2024-03-26T06:17:03.594151+0000","last_undegraded":"2024-03-26T06:17:03.594151+0000","last_fullsized":"2024-03-26T06:17:03.594151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597128+0000","last_change":"2024-03-26T06:17:02.581513+0000","last_active":"2024-03-26T06:17:03.597128+0000","last_peered":"2024-03-26T06:17:03.597128+0000","last_clean":"2024-03-26T06:17:03.597128+0000","last_became_active":"2024-03-26T06:17:02.580429+0000","last_became_peered":"2024-03-26T06:17:02.580429+0000","last_unstale":"2024-03-26T06:17:03.597128+0000","last_undegraded":"2024-03-26T06:17:03.597128+0000","last_fullsized":"2024-03-26T06:17:03.597128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:21.836096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601161+0000","last_change":"2024-03-26T06:16:57.517050+0000","last_active":"2024-03-26T06:17:03.601161+0000","last_peered":"2024-03-26T06:17:03.601161+0000","last_clean":"2024-03-26T06:17:03.601161+0000","last_became_active":"2024-03-26T06:16:57.516624+0000","last_became_peered":"2024-03-26T06:16:57.516624+0000","last_unstale":"2024-03-26T06:17:03.601161+0000","last_undegraded":"2024-03-26T06:17:03.601161+0000","last_fullsized":"2024-03-26T06:17:03.601161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:27.040366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554266+0000","last_change":"2024-03-26T06:16:58.528249+0000","last_active":"2024-03-26T06:17:03.554266+0000","last_peered":"2024-03-26T06:17:03.554266+0000","last_clean":"2024-03-26T06:17:03.554266+0000","last_became_active":"2024-03-26T06:16:58.527930+0000","last_became_peered":"2024-03-26T06:16:58.527930+0000","last_unstale":"2024-03-26T06:17:03.554266+0000","last_undegraded":"2024-03-26T06:17:03.554266+0000","last_fullsized":"2024-03-26T06:17:03.554266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:12:57.541865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599529+0000","last_change":"2024-03-26T06:17:02.582621+0000","last_active":"2024-03-26T06:17:03.599529+0000","last_peered":"2024-03-26T06:17:03.599529+0000","last_clean":"2024-03-26T06:17:03.599529+0000","last_became_active":"2024-03-26T06:17:02.581967+0000","last_became_peered":"2024-03-26T06:17:02.581967+0000","last_unstale":"2024-03-26T06:17:03.599529+0000","last_undegraded":"2024-03-26T06:17:03.599529+0000","last_fullsized":"2024-03-26T06:17:03.599529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599843+0000","last_change":"2024-03-26T06:16:57.514049+0000","last_active":"2024-03-26T06:17:03.599843+0000","last_peered":"2024-03-26T06:17:03.599843+0000","last_clean":"2024-03-26T06:17:03.599843+0000","last_became_active":"2024-03-26T06:16:57.513744+0000","last_became_peered":"2024-03-26T06:16:57.513744+0000","last_unstale":"2024-03-26T06:17:03.599843+0000","last_undegraded":"2024-03-26T06:17:03.599843+0000","last_fullsized":"2024-03-26T06:17:03.599843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:30.683728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554334+0000","last_change":"2024-03-26T06:16:58.530727+0000","last_active":"2024-03-26T06:17:03.554334+0000","last_peered":"2024-03-26T06:17:03.554334+0000","last_clean":"2024-03-26T06:17:03.554334+0000","last_became_active":"2024-03-26T06:16:58.530387+0000","last_became_peered":"2024-03-26T06:16:58.530387+0000","last_unstale":"2024-03-26T06:17:03.554334+0000","last_undegraded":"2024-03-26T06:17:03.554334+0000","last_fullsized":"2024-03-26T06:17:03.554334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596867+0000","last_change":"2024-03-26T06:17:02.589397+0000","last_active":"2024-03-26T06:17:03.596867+0000","last_peered":"2024-03-26T06:17:03.596867+0000","last_clean":"2024-03-26T06:17:03.596867+0000","last_became_active":"2024-03-26T06:17:02.588887+0000","last_became_peered":"2024-03-26T06:17:02.588887+0000","last_unstale":"2024-03-26T06:17:03.596867+0000","last_undegraded":"2024-03-26T06:17:03.596867+0000","last_fullsized":"2024-03-26T06:17:03.596867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:07.303274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595731+0000","last_change":"2024-03-26T06:16:58.526427+0000","last_active":"2024-03-26T06:17:03.595731+0000","last_peered":"2024-03-26T06:17:03.595731+0000","last_clean":"2024-03-26T06:17:03.595731+0000","last_became_active":"2024-03-26T06:16:58.526080+0000","last_became_peered":"2024-03-26T06:16:58.526080+0000","last_unstale":"2024-03-26T06:17:03.595731+0000","last_undegraded":"2024-03-26T06:17:03.595731+0000","last_fullsized":"2024-03-26T06:17:03.595731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600384+0000","last_change":"2024-03-26T06:16:57.513120+0000","last_active":"2024-03-26T06:17:03.600384+0000","last_peered":"2024-03-26T06:17:03.600384+0000","last_clean":"2024-03-26T06:17:03.600384+0000","last_became_active":"2024-03-26T06:16:57.512654+0000","last_became_peered":"2024-03-26T06:16:57.512654+0000","last_unstale":"2024-03-26T06:17:03.600384+0000","last_undegraded":"2024-03-26T06:17:03.600384+0000","last_fullsized":"2024-03-26T06:17:03.600384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597983+0000","last_change":"2024-03-26T06:17:02.584892+0000","last_active":"2024-03-26T06:17:03.597983+0000","last_peered":"2024-03-26T06:17:03.597983+0000","last_clean":"2024-03-26T06:17:03.597983+0000","last_became_active":"2024-03-26T06:17:02.584379+0000","last_became_peered":"2024-03-26T06:17:02.584379+0000","last_unstale":"2024-03-26T06:17:03.597983+0000","last_undegraded":"2024-03-26T06:17:03.597983+0000","last_fullsized":"2024-03-26T06:17:03.597983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:46.388330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555728+0000","last_change":"2024-03-26T06:16:58.517155+0000","last_active":"2024-03-26T06:17:03.555728+0000","last_peered":"2024-03-26T06:17:03.555728+0000","last_clean":"2024-03-26T06:17:03.555728+0000","last_became_active":"2024-03-26T06:16:58.516377+0000","last_became_peered":"2024-03-26T06:16:58.516377+0000","last_unstale":"2024-03-26T06:17:03.555728+0000","last_undegraded":"2024-03-26T06:17:03.555728+0000","last_fullsized":"2024-03-26T06:17:03.555728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597289+0000","last_change":"2024-03-26T06:16:57.500506+0000","last_active":"2024-03-26T06:17:03.597289+0000","last_peered":"2024-03-26T06:17:03.597289+0000","last_clean":"2024-03-26T06:17:03.597289+0000","last_became_active":"2024-03-26T06:16:57.499432+0000","last_became_peered":"2024-03-26T06:16:57.499432+0000","last_unstale":"2024-03-26T06:17:03.597289+0000","last_undegraded":"2024-03-26T06:17:03.597289+0000","last_fullsized":"2024-03-26T06:17:03.597289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599068+0000","last_change":"2024-03-26T06:17:02.586266+0000","last_active":"2024-03-26T06:17:03.599068+0000","last_peered":"2024-03-26T06:17:03.599068+0000","last_clean":"2024-03-26T06:17:03.599068+0000","last_became_active":"2024-03-26T06:17:02.585755+0000","last_became_peered":"2024-03-26T06:17:02.585755+0000","last_unstale":"2024-03-26T06:17:03.599068+0000","last_undegraded":"2024-03-26T06:17:03.599068+0000","last_fullsized":"2024-03-26T06:17:03.599068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:36.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554831+0000","last_change":"2024-03-26T06:16:58.516177+0000","last_active":"2024-03-26T06:17:03.554831+0000","last_peered":"2024-03-26T06:17:03.554831+0000","last_clean":"2024-03-26T06:17:03.554831+0000","last_became_active":"2024-03-26T06:16:58.515861+0000","last_became_peered":"2024-03-26T06:16:58.515861+0000","last_unstale":"2024-03-26T06:17:03.554831+0000","last_undegraded":"2024-03-26T06:17:03.554831+0000","last_fullsized":"2024-03-26T06:17:03.554831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595139+0000","last_change":"2024-03-26T06:16:57.506199+0000","last_active":"2024-03-26T06:17:03.595139+0000","last_peered":"2024-03-26T06:17:03.595139+0000","last_clean":"2024-03-26T06:17:03.595139+0000","last_became_active":"2024-03-26T06:16:57.505635+0000","last_became_peered":"2024-03-26T06:16:57.505635+0000","last_unstale":"2024-03-26T06:17:03.595139+0000","last_undegraded":"2024-03-26T06:17:03.595139+0000","last_fullsized":"2024-03-26T06:17:03.595139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596127+0000","last_change":"2024-03-26T06:17:02.877672+0000","last_active":"2024-03-26T06:17:03.596127+0000","last_peered":"2024-03-26T06:17:03.596127+0000","last_clean":"2024-03-26T06:17:03.596127+0000","last_became_active":"2024-03-26T06:17:02.877192+0000","last_became_peered":"2024-03-26T06:17:02.877192+0000","last_unstale":"2024-03-26T06:17:03.596127+0000","last_undegraded":"2024-03-26T06:17:03.596127+0000","last_fullsized":"2024-03-26T06:17:03.596127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598768+0000","last_change":"2024-03-26T06:16:58.521953+0000","last_active":"2024-03-26T06:17:03.598768+0000","last_peered":"2024-03-26T06:17:03.598768+0000","last_clean":"2024-03-26T06:17:03.598768+0000","last_became_active":"2024-03-26T06:16:58.521656+0000","last_became_peered":"2024-03-26T06:16:58.521656+0000","last_unstale":"2024-03-26T06:17:03.598768+0000","last_undegraded":"2024-03-26T06:17:03.598768+0000","last_fullsized":"2024-03-26T06:17:03.598768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:03.428999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597855+0000","last_change":"2024-03-26T06:16:57.508917+0000","last_active":"2024-03-26T06:17:03.597855+0000","last_peered":"2024-03-26T06:17:03.597855+0000","last_clean":"2024-03-26T06:17:03.597855+0000","last_became_active":"2024-03-26T06:16:57.508659+0000","last_became_peered":"2024-03-26T06:16:57.508659+0000","last_unstale":"2024-03-26T06:17:03.597855+0000","last_undegraded":"2024-03-26T06:17:03.597855+0000","last_fullsized":"2024-03-26T06:17:03.597855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600692+0000","last_change":"2024-03-26T06:17:02.583351+0000","last_active":"2024-03-26T06:17:03.600692+0000","last_peered":"2024-03-26T06:17:03.600692+0000","last_clean":"2024-03-26T06:17:03.600692+0000","last_became_active":"2024-03-26T06:17:02.582876+0000","last_became_peered":"2024-03-26T06:17:02.582876+0000","last_unstale":"2024-03-26T06:17:03.600692+0000","last_undegraded":"2024-03-26T06:17:03.600692+0000","last_fullsized":"2024-03-26T06:17:03.600692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595429+0000","last_change":"2024-03-26T06:16:58.508413+0000","last_active":"2024-03-26T06:17:03.595429+0000","last_peered":"2024-03-26T06:17:03.595429+0000","last_clean":"2024-03-26T06:17:03.595429+0000","last_became_active":"2024-03-26T06:16:58.508024+0000","last_became_peered":"2024-03-26T06:16:58.508024+0000","last_unstale":"2024-03-26T06:17:03.595429+0000","last_undegraded":"2024-03-26T06:17:03.595429+0000","last_fullsized":"2024-03-26T06:17:03.595429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596617+0000","last_change":"2024-03-26T06:16:57.509822+0000","last_active":"2024-03-26T06:17:03.596617+0000","last_peered":"2024-03-26T06:17:03.596617+0000","last_clean":"2024-03-26T06:17:03.596617+0000","last_became_active":"2024-03-26T06:16:57.509535+0000","last_became_peered":"2024-03-26T06:16:57.509535+0000","last_unstale":"2024-03-26T06:17:03.596617+0000","last_undegraded":"2024-03-26T06:17:03.596617+0000","last_fullsized":"2024-03-26T06:17:03.596617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597981+0000","last_change":"2024-03-26T06:17:02.877373+0000","last_active":"2024-03-26T06:17:03.597981+0000","last_peered":"2024-03-26T06:17:03.597981+0000","last_clean":"2024-03-26T06:17:03.597981+0000","last_became_active":"2024-03-26T06:17:02.876252+0000","last_became_peered":"2024-03-26T06:17:02.876252+0000","last_unstale":"2024-03-26T06:17:03.597981+0000","last_undegraded":"2024-03-26T06:17:03.597981+0000","last_fullsized":"2024-03-26T06:17:03.597981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:19.395341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556495+0000","last_change":"2024-03-26T06:16:58.536114+0000","last_active":"2024-03-26T06:17:03.556495+0000","last_peered":"2024-03-26T06:17:03.556495+0000","last_clean":"2024-03-26T06:17:03.556495+0000","last_became_active":"2024-03-26T06:16:58.534372+0000","last_became_peered":"2024-03-26T06:16:58.534372+0000","last_unstale":"2024-03-26T06:17:03.556495+0000","last_undegraded":"2024-03-26T06:17:03.556495+0000","last_fullsized":"2024-03-26T06:17:03.556495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596054+0000","last_change":"2024-03-26T06:16:57.503958+0000","last_active":"2024-03-26T06:17:03.596054+0000","last_peered":"2024-03-26T06:17:03.596054+0000","last_clean":"2024-03-26T06:17:03.596054+0000","last_became_active":"2024-03-26T06:16:57.503652+0000","last_became_peered":"2024-03-26T06:16:57.503652+0000","last_unstale":"2024-03-26T06:17:03.596054+0000","last_undegraded":"2024-03-26T06:17:03.596054+0000","last_fullsized":"2024-03-26T06:17:03.596054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:27.040366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553997+0000","last_change":"2024-03-26T06:17:02.878945+0000","last_active":"2024-03-26T06:17:03.553997+0000","last_peered":"2024-03-26T06:17:03.553997+0000","last_clean":"2024-03-26T06:17:03.553997+0000","last_became_active":"2024-03-26T06:17:02.876348+0000","last_became_peered":"2024-03-26T06:17:02.876348+0000","last_unstale":"2024-03-26T06:17:03.553997+0000","last_undegraded":"2024-03-26T06:17:03.553997+0000","last_fullsized":"2024-03-26T06:17:03.553997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:56:38.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595956+0000","last_change":"2024-03-26T06:16:58.515417+0000","last_active":"2024-03-26T06:17:03.595956+0000","last_peered":"2024-03-26T06:17:03.595956+0000","last_clean":"2024-03-26T06:17:03.595956+0000","last_became_active":"2024-03-26T06:16:58.515099+0000","last_became_peered":"2024-03-26T06:16:58.515099+0000","last_unstale":"2024-03-26T06:17:03.595956+0000","last_undegraded":"2024-03-26T06:17:03.595956+0000","last_fullsized":"2024-03-26T06:17:03.595956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601464+0000","last_change":"2024-03-26T06:16:57.512114+0000","last_active":"2024-03-26T06:17:03.601464+0000","last_peered":"2024-03-26T06:17:03.601464+0000","last_clean":"2024-03-26T06:17:03.601464+0000","last_became_active":"2024-03-26T06:16:57.511667+0000","last_became_peered":"2024-03-26T06:16:57.511667+0000","last_unstale":"2024-03-26T06:17:03.601464+0000","last_undegraded":"2024-03-26T06:17:03.601464+0000","last_fullsized":"2024-03-26T06:17:03.601464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:02:14.322537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593526+0000","last_change":"2024-03-26T06:17:02.871332+0000","last_active":"2024-03-26T06:17:03.593526+0000","last_peered":"2024-03-26T06:17:03.593526+0000","last_clean":"2024-03-26T06:17:03.593526+0000","last_became_active":"2024-03-26T06:17:02.869955+0000","last_became_peered":"2024-03-26T06:17:02.869955+0000","last_unstale":"2024-03-26T06:17:03.593526+0000","last_undegraded":"2024-03-26T06:17:03.593526+0000","last_fullsized":"2024-03-26T06:17:03.593526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554596+0000","last_change":"2024-03-26T06:16:58.523299+0000","last_active":"2024-03-26T06:17:03.554596+0000","last_peered":"2024-03-26T06:17:03.554596+0000","last_clean":"2024-03-26T06:17:03.554596+0000","last_became_active":"2024-03-26T06:16:58.522533+0000","last_became_peered":"2024-03-26T06:16:58.522533+0000","last_unstale":"2024-03-26T06:17:03.554596+0000","last_undegraded":"2024-03-26T06:17:03.554596+0000","last_fullsized":"2024-03-26T06:17:03.554596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:30.208261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596078+0000","last_change":"2024-03-26T06:16:57.500603+0000","last_active":"2024-03-26T06:17:03.596078+0000","last_peered":"2024-03-26T06:17:03.596078+0000","last_clean":"2024-03-26T06:17:03.596078+0000","last_became_active":"2024-03-26T06:16:57.500234+0000","last_became_peered":"2024-03-26T06:16:57.500234+0000","last_unstale":"2024-03-26T06:17:03.596078+0000","last_undegraded":"2024-03-26T06:17:03.596078+0000","last_fullsized":"2024-03-26T06:17:03.596078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:30.683728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595428+0000","last_change":"2024-03-26T06:17:02.583042+0000","last_active":"2024-03-26T06:17:03.595428+0000","last_peered":"2024-03-26T06:17:03.595428+0000","last_clean":"2024-03-26T06:17:03.595428+0000","last_became_active":"2024-03-26T06:17:02.581196+0000","last_became_peered":"2024-03-26T06:17:02.581196+0000","last_unstale":"2024-03-26T06:17:03.595428+0000","last_undegraded":"2024-03-26T06:17:03.595428+0000","last_fullsized":"2024-03-26T06:17:03.595428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600154+0000","last_change":"2024-03-26T06:16:58.531514+0000","last_active":"2024-03-26T06:17:03.600154+0000","last_peered":"2024-03-26T06:17:03.600154+0000","last_clean":"2024-03-26T06:17:03.600154+0000","last_became_active":"2024-03-26T06:16:58.531162+0000","last_became_peered":"2024-03-26T06:16:58.531162+0000","last_unstale":"2024-03-26T06:17:03.600154+0000","last_undegraded":"2024-03-26T06:17:03.600154+0000","last_fullsized":"2024-03-26T06:17:03.600154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:30.860729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554746+0000","last_change":"2024-03-26T06:16:57.495688+0000","last_active":"2024-03-26T06:17:03.554746+0000","last_peered":"2024-03-26T06:17:03.554746+0000","last_clean":"2024-03-26T06:17:03.554746+0000","last_became_active":"2024-03-26T06:16:57.495052+0000","last_became_peered":"2024-03-26T06:16:57.495052+0000","last_unstale":"2024-03-26T06:17:03.554746+0000","last_undegraded":"2024-03-26T06:17:03.554746+0000","last_fullsized":"2024-03-26T06:17:03.554746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596497+0000","last_change":"2024-03-26T06:17:02.573496+0000","last_active":"2024-03-26T06:17:03.596497+0000","last_peered":"2024-03-26T06:17:03.596497+0000","last_clean":"2024-03-26T06:17:03.596497+0000","last_became_active":"2024-03-26T06:17:02.573045+0000","last_became_peered":"2024-03-26T06:17:02.573045+0000","last_unstale":"2024-03-26T06:17:03.596497+0000","last_undegraded":"2024-03-26T06:17:03.596497+0000","last_fullsized":"2024-03-26T06:17:03.596497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:13:01.612258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594153+0000","last_change":"2024-03-26T06:16:58.517202+0000","last_active":"2024-03-26T06:17:03.594153+0000","last_peered":"2024-03-26T06:17:03.594153+0000","last_clean":"2024-03-26T06:17:03.594153+0000","last_became_active":"2024-03-26T06:16:58.516835+0000","last_became_peered":"2024-03-26T06:16:58.516835+0000","last_unstale":"2024-03-26T06:17:03.594153+0000","last_undegraded":"2024-03-26T06:17:03.594153+0000","last_fullsized":"2024-03-26T06:17:03.594153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550169+0000","last_change":"2024-03-26T06:16:57.497056+0000","last_active":"2024-03-26T06:17:03.550169+0000","last_peered":"2024-03-26T06:17:03.550169+0000","last_clean":"2024-03-26T06:17:03.550169+0000","last_became_active":"2024-03-26T06:16:57.496709+0000","last_became_peered":"2024-03-26T06:16:57.496709+0000","last_unstale":"2024-03-26T06:17:03.550169+0000","last_undegraded":"2024-03-26T06:17:03.550169+0000","last_fullsized":"2024-03-26T06:17:03.550169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596338+0000","last_change":"2024-03-26T06:17:02.584311+0000","last_active":"2024-03-26T06:17:03.596338+0000","last_peered":"2024-03-26T06:17:03.596338+0000","last_clean":"2024-03-26T06:17:03.596338+0000","last_became_active":"2024-03-26T06:17:02.583886+0000","last_became_peered":"2024-03-26T06:17:02.583886+0000","last_unstale":"2024-03-26T06:17:03.596338+0000","last_undegraded":"2024-03-26T06:17:03.596338+0000","last_fullsized":"2024-03-26T06:17:03.596338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:21.194082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.592952+0000","last_change":"2024-03-26T06:16:58.530594+0000","last_active":"2024-03-26T06:17:03.592952+0000","last_peered":"2024-03-26T06:17:03.592952+0000","last_clean":"2024-03-26T06:17:03.592952+0000","last_became_active":"2024-03-26T06:16:58.529866+0000","last_became_peered":"2024-03-26T06:16:58.529866+0000","last_unstale":"2024-03-26T06:17:03.592952+0000","last_undegraded":"2024-03-26T06:17:03.592952+0000","last_fullsized":"2024-03-26T06:17:03.592952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:41:39.644933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598124+0000","last_change":"2024-03-26T06:16:57.515221+0000","last_active":"2024-03-26T06:17:03.598124+0000","last_peered":"2024-03-26T06:17:03.598124+0000","last_clean":"2024-03-26T06:17:03.598124+0000","last_became_active":"2024-03-26T06:16:57.514898+0000","last_became_peered":"2024-03-26T06:16:57.514898+0000","last_unstale":"2024-03-26T06:17:03.598124+0000","last_undegraded":"2024-03-26T06:17:03.598124+0000","last_fullsized":"2024-03-26T06:17:03.598124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595076+0000","last_change":"2024-03-26T06:17:02.882785+0000","last_active":"2024-03-26T06:17:03.595076+0000","last_peered":"2024-03-26T06:17:03.595076+0000","last_clean":"2024-03-26T06:17:03.595076+0000","last_became_active":"2024-03-26T06:17:02.880282+0000","last_became_peered":"2024-03-26T06:17:02.880282+0000","last_unstale":"2024-03-26T06:17:03.595076+0000","last_undegraded":"2024-03-26T06:17:03.595076+0000","last_fullsized":"2024-03-26T06:17:03.595076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:13:01.612258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554233+0000","last_change":"2024-03-26T06:16:58.534461+0000","last_active":"2024-03-26T06:17:03.554233+0000","last_peered":"2024-03-26T06:17:03.554233+0000","last_clean":"2024-03-26T06:17:03.554233+0000","last_became_active":"2024-03-26T06:16:58.533987+0000","last_became_peered":"2024-03-26T06:16:58.533987+0000","last_unstale":"2024-03-26T06:17:03.554233+0000","last_undegraded":"2024-03-26T06:17:03.554233+0000","last_fullsized":"2024-03-26T06:17:03.554233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553855+0000","last_change":"2024-03-26T06:16:57.493211+0000","last_active":"2024-03-26T06:17:03.553855+0000","last_peered":"2024-03-26T06:17:03.553855+0000","last_clean":"2024-03-26T06:17:03.553855+0000","last_became_active":"2024-03-26T06:16:57.492914+0000","last_became_peered":"2024-03-26T06:16:57.492914+0000","last_unstale":"2024-03-26T06:17:03.553855+0000","last_undegraded":"2024-03-26T06:17:03.553855+0000","last_fullsized":"2024-03-26T06:17:03.553855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598396+0000","last_change":"2024-03-26T06:16:49.590440+0000","last_active":"2024-03-26T06:17:03.598396+0000","last_peered":"2024-03-26T06:17:03.598396+0000","last_clean":"2024-03-26T06:17:03.598396+0000","last_became_active":"2024-03-26T06:16:49.589017+0000","last_became_peered":"2024-03-26T06:16:49.589017+0000","last_unstale":"2024-03-26T06:17:03.598396+0000","last_undegraded":"2024-03-26T06:17:03.598396+0000","last_fullsized":"2024-03-26T06:17:03.598396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_clean_scrub_stamp":"2024-03-26T06:16:48.290068+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:00:05.158039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596458+0000","last_change":"2024-03-26T06:17:02.878872+0000","last_active":"2024-03-26T06:17:03.596458+0000","last_peered":"2024-03-26T06:17:03.596458+0000","last_clean":"2024-03-26T06:17:03.596458+0000","last_became_active":"2024-03-26T06:17:02.877700+0000","last_became_peered":"2024-03-26T06:17:02.877700+0000","last_unstale":"2024-03-26T06:17:03.596458+0000","last_undegraded":"2024-03-26T06:17:03.596458+0000","last_fullsized":"2024-03-26T06:17:03.596458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600698+0000","last_change":"2024-03-26T06:16:58.533470+0000","last_active":"2024-03-26T06:17:03.600698+0000","last_peered":"2024-03-26T06:17:03.600698+0000","last_clean":"2024-03-26T06:17:03.600698+0000","last_became_active":"2024-03-26T06:16:58.533157+0000","last_became_peered":"2024-03-26T06:16:58.533157+0000","last_unstale":"2024-03-26T06:17:03.600698+0000","last_undegraded":"2024-03-26T06:17:03.600698+0000","last_fullsized":"2024-03-26T06:17:03.600698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.551305+0000","last_change":"2024-03-26T06:16:57.504891+0000","last_active":"2024-03-26T06:17:03.551305+0000","last_peered":"2024-03-26T06:17:03.551305+0000","last_clean":"2024-03-26T06:17:03.551305+0000","last_became_active":"2024-03-26T06:16:57.504556+0000","last_became_peered":"2024-03-26T06:16:57.504556+0000","last_unstale":"2024-03-26T06:17:03.551305+0000","last_undegraded":"2024-03-26T06:17:03.551305+0000","last_fullsized":"2024-03-26T06:17:03.551305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601044+0000","last_change":"2024-03-26T06:17:02.879854+0000","last_active":"2024-03-26T06:17:03.601044+0000","last_peered":"2024-03-26T06:17:03.601044+0000","last_clean":"2024-03-26T06:17:03.601044+0000","last_became_active":"2024-03-26T06:17:02.873465+0000","last_became_peered":"2024-03-26T06:17:02.873465+0000","last_unstale":"2024-03-26T06:17:03.601044+0000","last_undegraded":"2024-03-26T06:17:03.601044+0000","last_fullsized":"2024-03-26T06:17:03.601044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554519+0000","last_change":"2024-03-26T06:16:58.524155+0000","last_active":"2024-03-26T06:17:03.554519+0000","last_peered":"2024-03-26T06:17:03.554519+0000","last_clean":"2024-03-26T06:17:03.554519+0000","last_became_active":"2024-03-26T06:16:58.523112+0000","last_became_peered":"2024-03-26T06:16:58.523112+0000","last_unstale":"2024-03-26T06:17:03.554519+0000","last_undegraded":"2024-03-26T06:17:03.554519+0000","last_fullsized":"2024-03-26T06:17:03.554519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:35.992415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596126+0000","last_change":"2024-03-26T06:16:57.499837+0000","last_active":"2024-03-26T06:17:03.596126+0000","last_peered":"2024-03-26T06:17:03.596126+0000","last_clean":"2024-03-26T06:17:03.596126+0000","last_became_active":"2024-03-26T06:16:57.499493+0000","last_became_peered":"2024-03-26T06:16:57.499493+0000","last_unstale":"2024-03-26T06:17:03.596126+0000","last_undegraded":"2024-03-26T06:17:03.596126+0000","last_fullsized":"2024-03-26T06:17:03.596126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594334+0000","last_change":"2024-03-26T06:17:02.577832+0000","last_active":"2024-03-26T06:17:03.594334+0000","last_peered":"2024-03-26T06:17:03.594334+0000","last_clean":"2024-03-26T06:17:03.594334+0000","last_became_active":"2024-03-26T06:17:02.576442+0000","last_became_peered":"2024-03-26T06:17:02.576442+0000","last_unstale":"2024-03-26T06:17:03.594334+0000","last_undegraded":"2024-03-26T06:17:03.594334+0000","last_fullsized":"2024-03-26T06:17:03.594334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.602136+0000","last_change":"2024-03-26T06:16:58.552213+0000","last_active":"2024-03-26T06:17:03.602136+0000","last_peered":"2024-03-26T06:17:03.602136+0000","last_clean":"2024-03-26T06:17:03.602136+0000","last_became_active":"2024-03-26T06:16:58.551830+0000","last_became_peered":"2024-03-26T06:16:58.551830+0000","last_unstale":"2024-03-26T06:17:03.602136+0000","last_undegraded":"2024-03-26T06:17:03.602136+0000","last_fullsized":"2024-03-26T06:17:03.602136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:31:28.495785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550919+0000","last_change":"2024-03-26T06:16:57.501329+0000","last_active":"2024-03-26T06:17:03.550919+0000","last_peered":"2024-03-26T06:17:03.550919+0000","last_clean":"2024-03-26T06:17:03.550919+0000","last_became_active":"2024-03-26T06:16:57.500987+0000","last_became_peered":"2024-03-26T06:16:57.500987+0000","last_unstale":"2024-03-26T06:17:03.550919+0000","last_undegraded":"2024-03-26T06:17:03.550919+0000","last_fullsized":"2024-03-26T06:17:03.550919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.552806+0000","last_change":"2024-03-26T06:17:02.872960+0000","last_active":"2024-03-26T06:17:03.552806+0000","last_peered":"2024-03-26T06:17:03.552806+0000","last_clean":"2024-03-26T06:17:03.552806+0000","last_became_active":"2024-03-26T06:17:02.871460+0000","last_became_peered":"2024-03-26T06:17:02.871460+0000","last_unstale":"2024-03-26T06:17:03.552806+0000","last_undegraded":"2024-03-26T06:17:03.552806+0000","last_fullsized":"2024-03-26T06:17:03.552806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:44:47.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601012+0000","last_change":"2024-03-26T06:16:58.534645+0000","last_active":"2024-03-26T06:17:03.601012+0000","last_peered":"2024-03-26T06:17:03.601012+0000","last_clean":"2024-03-26T06:17:03.601012+0000","last_became_active":"2024-03-26T06:16:58.532263+0000","last_became_peered":"2024-03-26T06:16:58.532263+0000","last_unstale":"2024-03-26T06:17:03.601012+0000","last_undegraded":"2024-03-26T06:17:03.601012+0000","last_fullsized":"2024-03-26T06:17:03.601012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:35.992415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601161+0000","last_change":"2024-03-26T06:16:57.495853+0000","last_active":"2024-03-26T06:17:03.601161+0000","last_peered":"2024-03-26T06:17:03.601161+0000","last_clean":"2024-03-26T06:17:03.601161+0000","last_became_active":"2024-03-26T06:16:57.495248+0000","last_became_peered":"2024-03-26T06:16:57.495248+0000","last_unstale":"2024-03-26T06:17:03.601161+0000","last_undegraded":"2024-03-26T06:17:03.601161+0000","last_fullsized":"2024-03-26T06:17:03.601161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:20:43.357850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597470+0000","last_change":"2024-03-26T06:17:02.582195+0000","last_active":"2024-03-26T06:17:03.597470+0000","last_peered":"2024-03-26T06:17:03.597470+0000","last_clean":"2024-03-26T06:17:03.597470+0000","last_became_active":"2024-03-26T06:17:02.581717+0000","last_became_peered":"2024-03-26T06:17:02.581717+0000","last_unstale":"2024-03-26T06:17:03.597470+0000","last_undegraded":"2024-03-26T06:17:03.597470+0000","last_fullsized":"2024-03-26T06:17:03.597470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:19.811246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598827+0000","last_change":"2024-03-26T06:16:58.531961+0000","last_active":"2024-03-26T06:17:03.598827+0000","last_peered":"2024-03-26T06:17:03.598827+0000","last_clean":"2024-03-26T06:17:03.598827+0000","last_became_active":"2024-03-26T06:16:58.531656+0000","last_became_peered":"2024-03-26T06:16:58.531656+0000","last_unstale":"2024-03-26T06:17:03.598827+0000","last_undegraded":"2024-03-26T06:17:03.598827+0000","last_fullsized":"2024-03-26T06:17:03.598827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.549428+0000","last_change":"2024-03-26T06:16:57.488815+0000","last_active":"2024-03-26T06:17:03.549428+0000","last_peered":"2024-03-26T06:17:03.549428+0000","last_clean":"2024-03-26T06:17:03.549428+0000","last_became_active":"2024-03-26T06:16:57.487181+0000","last_became_peered":"2024-03-26T06:16:57.487181+0000","last_unstale":"2024-03-26T06:17:03.549428+0000","last_undegraded":"2024-03-26T06:17:03.549428+0000","last_fullsized":"2024-03-26T06:17:03.549428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:02:07.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594842+0000","last_change":"2024-03-26T06:17:02.580214+0000","last_active":"2024-03-26T06:17:03.594842+0000","last_peered":"2024-03-26T06:17:03.594842+0000","last_clean":"2024-03-26T06:17:03.594842+0000","last_became_active":"2024-03-26T06:17:02.579846+0000","last_became_peered":"2024-03-26T06:17:02.579846+0000","last_unstale":"2024-03-26T06:17:03.594842+0000","last_undegraded":"2024-03-26T06:17:03.594842+0000","last_fullsized":"2024-03-26T06:17:03.594842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:21.194082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595884+0000","last_change":"2024-03-26T06:16:58.514900+0000","last_active":"2024-03-26T06:17:03.595884+0000","last_peered":"2024-03-26T06:17:03.595884+0000","last_clean":"2024-03-26T06:17:03.595884+0000","last_became_active":"2024-03-26T06:16:58.514631+0000","last_became_peered":"2024-03-26T06:16:58.514631+0000","last_unstale":"2024-03-26T06:17:03.595884+0000","last_undegraded":"2024-03-26T06:17:03.595884+0000","last_fullsized":"2024-03-26T06:17:03.595884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595846+0000","last_change":"2024-03-26T06:16:57.507399+0000","last_active":"2024-03-26T06:17:03.595846+0000","last_peered":"2024-03-26T06:17:03.595846+0000","last_clean":"2024-03-26T06:17:03.595846+0000","last_became_active":"2024-03-26T06:16:57.506456+0000","last_became_peered":"2024-03-26T06:16:57.506456+0000","last_unstale":"2024-03-26T06:17:03.595846+0000","last_undegraded":"2024-03-26T06:17:03.595846+0000","last_fullsized":"2024-03-26T06:17:03.595846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556221+0000","last_change":"2024-03-26T06:17:02.887270+0000","last_active":"2024-03-26T06:17:03.556221+0000","last_peered":"2024-03-26T06:17:03.556221+0000","last_clean":"2024-03-26T06:17:03.556221+0000","last_became_active":"2024-03-26T06:17:02.877110+0000","last_became_peered":"2024-03-26T06:17:02.877110+0000","last_unstale":"2024-03-26T06:17:03.556221+0000","last_undegraded":"2024-03-26T06:17:03.556221+0000","last_fullsized":"2024-03-26T06:17:03.556221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:53:39.247476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600081+0000","last_change":"2024-03-26T06:16:58.537036+0000","last_active":"2024-03-26T06:17:03.600081+0000","last_peered":"2024-03-26T06:17:03.600081+0000","last_clean":"2024-03-26T06:17:03.600081+0000","last_became_active":"2024-03-26T06:16:58.536769+0000","last_became_peered":"2024-03-26T06:16:58.536769+0000","last_unstale":"2024-03-26T06:17:03.600081+0000","last_undegraded":"2024-03-26T06:17:03.600081+0000","last_fullsized":"2024-03-26T06:17:03.600081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:35.743222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554459+0000","last_change":"2024-03-26T06:16:57.503002+0000","last_active":"2024-03-26T06:17:03.554459+0000","last_peered":"2024-03-26T06:17:03.554459+0000","last_clean":"2024-03-26T06:17:03.554459+0000","last_became_active":"2024-03-26T06:16:57.502634+0000","last_became_peered":"2024-03-26T06:16:57.502634+0000","last_unstale":"2024-03-26T06:17:03.554459+0000","last_undegraded":"2024-03-26T06:17:03.554459+0000","last_fullsized":"2024-03-26T06:17:03.554459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557086+0000","last_change":"2024-03-26T06:17:02.881309+0000","last_active":"2024-03-26T06:17:03.557086+0000","last_peered":"2024-03-26T06:17:03.557086+0000","last_clean":"2024-03-26T06:17:03.557086+0000","last_became_active":"2024-03-26T06:17:02.875761+0000","last_became_peered":"2024-03-26T06:17:02.875761+0000","last_unstale":"2024-03-26T06:17:03.557086+0000","last_undegraded":"2024-03-26T06:17:03.557086+0000","last_fullsized":"2024-03-26T06:17:03.557086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:12:15.149201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594732+0000","last_change":"2024-03-26T06:16:58.525054+0000","last_active":"2024-03-26T06:17:03.594732+0000","last_peered":"2024-03-26T06:17:03.594732+0000","last_clean":"2024-03-26T06:17:03.594732+0000","last_became_active":"2024-03-26T06:16:58.524608+0000","last_became_peered":"2024-03-26T06:16:58.524608+0000","last_unstale":"2024-03-26T06:17:03.594732+0000","last_undegraded":"2024-03-26T06:17:03.594732+0000","last_fullsized":"2024-03-26T06:17:03.594732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:20:28.424836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595048+0000","last_change":"2024-03-26T06:16:57.496736+0000","last_active":"2024-03-26T06:17:03.595048+0000","last_peered":"2024-03-26T06:17:03.595048+0000","last_clean":"2024-03-26T06:17:03.595048+0000","last_became_active":"2024-03-26T06:16:57.496382+0000","last_became_peered":"2024-03-26T06:16:57.496382+0000","last_unstale":"2024-03-26T06:17:03.595048+0000","last_undegraded":"2024-03-26T06:17:03.595048+0000","last_fullsized":"2024-03-26T06:17:03.595048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:20:43.357850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554993+0000","last_change":"2024-03-26T06:17:02.878453+0000","last_active":"2024-03-26T06:17:03.554993+0000","last_peered":"2024-03-26T06:17:03.554993+0000","last_clean":"2024-03-26T06:17:03.554993+0000","last_became_active":"2024-03-26T06:17:02.871508+0000","last_became_peered":"2024-03-26T06:17:02.871508+0000","last_unstale":"2024-03-26T06:17:03.554993+0000","last_undegraded":"2024-03-26T06:17:03.554993+0000","last_fullsized":"2024-03-26T06:17:03.554993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:56:38.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600456+0000","last_change":"2024-03-26T06:16:58.529916+0000","last_active":"2024-03-26T06:17:03.600456+0000","last_peered":"2024-03-26T06:17:03.600456+0000","last_clean":"2024-03-26T06:17:03.600456+0000","last_became_active":"2024-03-26T06:16:58.529278+0000","last_became_peered":"2024-03-26T06:16:58.529278+0000","last_unstale":"2024-03-26T06:17:03.600456+0000","last_undegraded":"2024-03-26T06:17:03.600456+0000","last_fullsized":"2024-03-26T06:17:03.600456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:10.820581+0000","last_change":"2024-03-26T06:16:57.504243+0000","last_active":"2024-03-26T06:17:10.820581+0000","last_peered":"2024-03-26T06:17:10.820581+0000","last_clean":"2024-03-26T06:17:10.820581+0000","last_became_active":"2024-03-26T06:16:57.503731+0000","last_became_peered":"2024-03-26T06:16:57.503731+0000","last_unstale":"2024-03-26T06:17:10.820581+0000","last_undegraded":"2024-03-26T06:17:10.820581+0000","last_fullsized":"2024-03-26T06:17:10.820581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597671+0000","last_change":"2024-03-26T06:17:02.578804+0000","last_active":"2024-03-26T06:17:03.597671+0000","last_peered":"2024-03-26T06:17:03.597671+0000","last_clean":"2024-03-26T06:17:03.597671+0000","last_became_active":"2024-03-26T06:17:02.577517+0000","last_became_peered":"2024-03-26T06:17:02.577517+0000","last_unstale":"2024-03-26T06:17:03.597671+0000","last_undegraded":"2024-03-26T06:17:03.597671+0000","last_fullsized":"2024-03-26T06:17:03.597671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:40.062808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599668+0000","last_change":"2024-03-26T06:16:58.542622+0000","last_active":"2024-03-26T06:17:03.599668+0000","last_peered":"2024-03-26T06:17:03.599668+0000","last_clean":"2024-03-26T06:17:03.599668+0000","last_became_active":"2024-03-26T06:16:58.542271+0000","last_became_peered":"2024-03-26T06:16:58.542271+0000","last_unstale":"2024-03-26T06:17:03.599668+0000","last_undegraded":"2024-03-26T06:17:03.599668+0000","last_fullsized":"2024-03-26T06:17:03.599668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:31.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596026+0000","last_change":"2024-03-26T06:16:57.503753+0000","last_active":"2024-03-26T06:17:03.596026+0000","last_peered":"2024-03-26T06:17:03.596026+0000","last_clean":"2024-03-26T06:17:03.596026+0000","last_became_active":"2024-03-26T06:16:57.503459+0000","last_became_peered":"2024-03-26T06:16:57.503459+0000","last_unstale":"2024-03-26T06:17:03.596026+0000","last_undegraded":"2024-03-26T06:17:03.596026+0000","last_fullsized":"2024-03-26T06:17:03.596026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600050+0000","last_change":"2024-03-26T06:17:02.581612+0000","last_active":"2024-03-26T06:17:03.600050+0000","last_peered":"2024-03-26T06:17:03.600050+0000","last_clean":"2024-03-26T06:17:03.600050+0000","last_became_active":"2024-03-26T06:17:02.580790+0000","last_became_peered":"2024-03-26T06:17:02.580790+0000","last_unstale":"2024-03-26T06:17:03.600050+0000","last_undegraded":"2024-03-26T06:17:03.600050+0000","last_fullsized":"2024-03-26T06:17:03.600050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594361+0000","last_change":"2024-03-26T06:16:58.533339+0000","last_active":"2024-03-26T06:17:03.594361+0000","last_peered":"2024-03-26T06:17:03.594361+0000","last_clean":"2024-03-26T06:17:03.594361+0000","last_became_active":"2024-03-26T06:16:58.533023+0000","last_became_peered":"2024-03-26T06:16:58.533023+0000","last_unstale":"2024-03-26T06:17:03.594361+0000","last_undegraded":"2024-03-26T06:17:03.594361+0000","last_fullsized":"2024-03-26T06:17:03.594361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554096+0000","last_change":"2024-03-26T06:16:57.505342+0000","last_active":"2024-03-26T06:17:03.554096+0000","last_peered":"2024-03-26T06:17:03.554096+0000","last_clean":"2024-03-26T06:17:03.554096+0000","last_became_active":"2024-03-26T06:16:57.505086+0000","last_became_peered":"2024-03-26T06:16:57.505086+0000","last_unstale":"2024-03-26T06:17:03.554096+0000","last_undegraded":"2024-03-26T06:17:03.554096+0000","last_fullsized":"2024-03-26T06:17:03.554096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554475+0000","last_change":"2024-03-26T06:17:02.580018+0000","last_active":"2024-03-26T06:17:03.554475+0000","last_peered":"2024-03-26T06:17:03.554475+0000","last_clean":"2024-03-26T06:17:03.554475+0000","last_became_active":"2024-03-26T06:17:02.579638+0000","last_became_peered":"2024-03-26T06:17:02.579638+0000","last_unstale":"2024-03-26T06:17:03.554475+0000","last_undegraded":"2024-03-26T06:17:03.554475+0000","last_fullsized":"2024-03-26T06:17:03.554475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:11:12.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553848+0000","last_change":"2024-03-26T06:16:58.533277+0000","last_active":"2024-03-26T06:17:03.553848+0000","last_peered":"2024-03-26T06:17:03.553848+0000","last_clean":"2024-03-26T06:17:03.553848+0000","last_became_active":"2024-03-26T06:16:58.529159+0000","last_became_peered":"2024-03-26T06:16:58.529159+0000","last_unstale":"2024-03-26T06:17:03.553848+0000","last_undegraded":"2024-03-26T06:17:03.553848+0000","last_fullsized":"2024-03-26T06:17:03.553848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:40.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596366+0000","last_change":"2024-03-26T06:16:57.510798+0000","last_active":"2024-03-26T06:17:03.596366+0000","last_peered":"2024-03-26T06:17:03.596366+0000","last_clean":"2024-03-26T06:17:03.596366+0000","last_became_active":"2024-03-26T06:16:57.510512+0000","last_became_peered":"2024-03-26T06:16:57.510512+0000","last_unstale":"2024-03-26T06:17:03.596366+0000","last_undegraded":"2024-03-26T06:17:03.596366+0000","last_fullsized":"2024-03-26T06:17:03.596366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554417+0000","last_change":"2024-03-26T06:17:02.886655+0000","last_active":"2024-03-26T06:17:03.554417+0000","last_peered":"2024-03-26T06:17:03.554417+0000","last_clean":"2024-03-26T06:17:03.554417+0000","last_became_active":"2024-03-26T06:17:02.883226+0000","last_became_peered":"2024-03-26T06:17:02.883226+0000","last_unstale":"2024-03-26T06:17:03.554417+0000","last_undegraded":"2024-03-26T06:17:03.554417+0000","last_fullsized":"2024-03-26T06:17:03.554417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:08:21.367362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594521+0000","last_change":"2024-03-26T06:17:02.884097+0000","last_active":"2024-03-26T06:17:03.594521+0000","last_peered":"2024-03-26T06:17:03.594521+0000","last_clean":"2024-03-26T06:17:03.594521+0000","last_became_active":"2024-03-26T06:17:02.876466+0000","last_became_peered":"2024-03-26T06:17:02.876466+0000","last_unstale":"2024-03-26T06:17:03.594521+0000","last_undegraded":"2024-03-26T06:17:03.594521+0000","last_fullsized":"2024-03-26T06:17:03.594521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593783+0000","last_change":"2024-03-26T06:16:58.519241+0000","last_active":"2024-03-26T06:17:03.593783+0000","last_peered":"2024-03-26T06:17:03.593783+0000","last_clean":"2024-03-26T06:17:03.593783+0000","last_became_active":"2024-03-26T06:16:58.518964+0000","last_became_peered":"2024-03-26T06:16:58.518964+0000","last_unstale":"2024-03-26T06:17:03.593783+0000","last_undegraded":"2024-03-26T06:17:03.593783+0000","last_fullsized":"2024-03-26T06:17:03.593783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553403+0000","last_change":"2024-03-26T06:16:57.501927+0000","last_active":"2024-03-26T06:17:03.553403+0000","last_peered":"2024-03-26T06:17:03.553403+0000","last_clean":"2024-03-26T06:17:03.553403+0000","last_became_active":"2024-03-26T06:16:57.501575+0000","last_became_peered":"2024-03-26T06:16:57.501575+0000","last_unstale":"2024-03-26T06:17:03.553403+0000","last_undegraded":"2024-03-26T06:17:03.553403+0000","last_fullsized":"2024-03-26T06:17:03.553403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596166+0000","last_change":"2024-03-26T06:17:02.573739+0000","last_active":"2024-03-26T06:17:03.596166+0000","last_peered":"2024-03-26T06:17:03.596166+0000","last_clean":"2024-03-26T06:17:03.596166+0000","last_became_active":"2024-03-26T06:17:02.573280+0000","last_became_peered":"2024-03-26T06:17:02.573280+0000","last_unstale":"2024-03-26T06:17:03.596166+0000","last_undegraded":"2024-03-26T06:17:03.596166+0000","last_fullsized":"2024-03-26T06:17:03.596166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554477+0000","last_change":"2024-03-26T06:16:58.516850+0000","last_active":"2024-03-26T06:17:03.554477+0000","last_peered":"2024-03-26T06:17:03.554477+0000","last_clean":"2024-03-26T06:17:03.554477+0000","last_became_active":"2024-03-26T06:16:58.516487+0000","last_became_peered":"2024-03-26T06:16:58.516487+0000","last_unstale":"2024-03-26T06:17:03.554477+0000","last_undegraded":"2024-03-26T06:17:03.554477+0000","last_fullsized":"2024-03-26T06:17:03.554477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554926+0000","last_change":"2024-03-26T06:16:57.505539+0000","last_active":"2024-03-26T06:17:03.554926+0000","last_peered":"2024-03-26T06:17:03.554926+0000","last_clean":"2024-03-26T06:17:03.554926+0000","last_became_active":"2024-03-26T06:16:57.504681+0000","last_became_peered":"2024-03-26T06:16:57.504681+0000","last_unstale":"2024-03-26T06:17:03.554926+0000","last_undegraded":"2024-03-26T06:17:03.554926+0000","last_fullsized":"2024-03-26T06:17:03.554926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:02:07.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596247+0000","last_change":"2024-03-26T06:16:57.508895+0000","last_active":"2024-03-26T06:17:03.596247+0000","last_peered":"2024-03-26T06:17:03.596247+0000","last_clean":"2024-03-26T06:17:03.596247+0000","last_became_active":"2024-03-26T06:16:57.508519+0000","last_became_peered":"2024-03-26T06:16:57.508519+0000","last_unstale":"2024-03-26T06:17:03.596247+0000","last_undegraded":"2024-03-26T06:17:03.596247+0000","last_fullsized":"2024-03-26T06:17:03.596247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594814+0000","last_change":"2024-03-26T06:16:58.529802+0000","last_active":"2024-03-26T06:17:03.594814+0000","last_peered":"2024-03-26T06:17:03.594814+0000","last_clean":"2024-03-26T06:17:03.594814+0000","last_became_active":"2024-03-26T06:16:58.529237+0000","last_became_peered":"2024-03-26T06:16:58.529237+0000","last_unstale":"2024-03-26T06:17:03.594814+0000","last_undegraded":"2024-03-26T06:17:03.594814+0000","last_fullsized":"2024-03-26T06:17:03.594814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.551059+0000","last_change":"2024-03-26T06:17:02.579718+0000","last_active":"2024-03-26T06:17:03.551059+0000","last_peered":"2024-03-26T06:17:03.551059+0000","last_clean":"2024-03-26T06:17:03.551059+0000","last_became_active":"2024-03-26T06:17:02.579292+0000","last_became_peered":"2024-03-26T06:17:02.579292+0000","last_unstale":"2024-03-26T06:17:03.551059+0000","last_undegraded":"2024-03-26T06:17:03.551059+0000","last_fullsized":"2024-03-26T06:17:03.551059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:20:32.495229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555975+0000","last_change":"2024-03-26T06:16:57.505594+0000","last_active":"2024-03-26T06:17:03.555975+0000","last_peered":"2024-03-26T06:17:03.555975+0000","last_clean":"2024-03-26T06:17:03.555975+0000","last_became_active":"2024-03-26T06:16:57.504217+0000","last_became_peered":"2024-03-26T06:16:57.504217+0000","last_unstale":"2024-03-26T06:17:03.555975+0000","last_undegraded":"2024-03-26T06:17:03.555975+0000","last_fullsized":"2024-03-26T06:17:03.555975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:56.691656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597497+0000","last_change":"2024-03-26T06:16:58.525527+0000","last_active":"2024-03-26T06:17:03.597497+0000","last_peered":"2024-03-26T06:17:03.597497+0000","last_clean":"2024-03-26T06:17:03.597497+0000","last_became_active":"2024-03-26T06:16:58.525120+0000","last_became_peered":"2024-03-26T06:16:58.525120+0000","last_unstale":"2024-03-26T06:17:03.597497+0000","last_undegraded":"2024-03-26T06:17:03.597497+0000","last_fullsized":"2024-03-26T06:17:03.597497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:16.071262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555281+0000","last_change":"2024-03-26T06:17:02.579294+0000","last_active":"2024-03-26T06:17:03.555281+0000","last_peered":"2024-03-26T06:17:03.555281+0000","last_clean":"2024-03-26T06:17:03.555281+0000","last_became_active":"2024-03-26T06:17:02.578906+0000","last_became_peered":"2024-03-26T06:17:02.578906+0000","last_unstale":"2024-03-26T06:17:03.555281+0000","last_undegraded":"2024-03-26T06:17:03.555281+0000","last_fullsized":"2024-03-26T06:17:03.555281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:53:09.876582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595338+0000","last_change":"2024-03-26T06:16:58.516379+0000","last_active":"2024-03-26T06:17:03.595338+0000","last_peered":"2024-03-26T06:17:03.595338+0000","last_clean":"2024-03-26T06:17:03.595338+0000","last_became_active":"2024-03-26T06:16:58.516077+0000","last_became_peered":"2024-03-26T06:16:58.516077+0000","last_unstale":"2024-03-26T06:17:03.595338+0000","last_undegraded":"2024-03-26T06:17:03.595338+0000","last_fullsized":"2024-03-26T06:17:03.595338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.549738+0000","last_change":"2024-03-26T06:16:58.532505+0000","last_active":"2024-03-26T06:17:03.549738+0000","last_peered":"2024-03-26T06:17:03.549738+0000","last_clean":"2024-03-26T06:17:03.549738+0000","last_became_active":"2024-03-26T06:16:58.529934+0000","last_became_peered":"2024-03-26T06:16:58.529934+0000","last_unstale":"2024-03-26T06:17:03.549738+0000","last_undegraded":"2024-03-26T06:17:03.549738+0000","last_fullsized":"2024-03-26T06:17:03.549738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:31.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554160+0000","last_change":"2024-03-26T06:16:58.522722+0000","last_active":"2024-03-26T06:17:03.554160+0000","last_peered":"2024-03-26T06:17:03.554160+0000","last_clean":"2024-03-26T06:17:03.554160+0000","last_became_active":"2024-03-26T06:16:58.522370+0000","last_became_peered":"2024-03-26T06:16:58.522370+0000","last_unstale":"2024-03-26T06:17:03.554160+0000","last_undegraded":"2024-03-26T06:17:03.554160+0000","last_fullsized":"2024-03-26T06:17:03.554160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594678+0000","last_change":"2024-03-26T06:16:58.520281+0000","last_active":"2024-03-26T06:17:03.594678+0000","last_peered":"2024-03-26T06:17:03.594678+0000","last_clean":"2024-03-26T06:17:03.594678+0000","last_became_active":"2024-03-26T06:16:58.519985+0000","last_became_peered":"2024-03-26T06:16:58.519985+0000","last_unstale":"2024-03-26T06:17:03.594678+0000","last_undegraded":"2024-03-26T06:17:03.594678+0000","last_fullsized":"2024-03-26T06:17:03.594678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557423+0000","last_change":"2024-03-26T06:16:58.529109+0000","last_active":"2024-03-26T06:17:03.557423+0000","last_peered":"2024-03-26T06:17:03.557423+0000","last_clean":"2024-03-26T06:17:03.557423+0000","last_became_active":"2024-03-26T06:16:58.528801+0000","last_became_peered":"2024-03-26T06:16:58.528801+0000","last_unstale":"2024-03-26T06:17:03.557423+0000","last_undegraded":"2024-03-26T06:17:03.557423+0000","last_fullsized":"2024-03-26T06:17:03.557423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595616+0000","last_change":"2024-03-26T06:16:58.520275+0000","last_active":"2024-03-26T06:17:03.595616+0000","last_peered":"2024-03-26T06:17:03.595616+0000","last_clean":"2024-03-26T06:17:03.595616+0000","last_became_active":"2024-03-26T06:16:58.519968+0000","last_became_peered":"2024-03-26T06:16:58.519968+0000","last_unstale":"2024-03-26T06:17:03.595616+0000","last_undegraded":"2024-03-26T06:17:03.595616+0000","last_fullsized":"2024-03-26T06:17:03.595616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600878+0000","last_change":"2024-03-26T06:16:58.529307+0000","last_active":"2024-03-26T06:17:03.600878+0000","last_peered":"2024-03-26T06:17:03.600878+0000","last_clean":"2024-03-26T06:17:03.600878+0000","last_became_active":"2024-03-26T06:16:58.528918+0000","last_became_peered":"2024-03-26T06:16:58.528918+0000","last_unstale":"2024-03-26T06:17:03.600878+0000","last_undegraded":"2024-03-26T06:17:03.600878+0000","last_fullsized":"2024-03-26T06:17:03.600878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556360+0000","last_change":"2024-03-26T06:16:58.529346+0000","last_active":"2024-03-26T06:17:03.556360+0000","last_peered":"2024-03-26T06:17:03.556360+0000","last_clean":"2024-03-26T06:17:03.556360+0000","last_became_active":"2024-03-26T06:16:58.528998+0000","last_became_peered":"2024-03-26T06:16:58.528998+0000","last_unstale":"2024-03-26T06:17:03.556360+0000","last_undegraded":"2024-03-26T06:17:03.556360+0000","last_fullsized":"2024-03-26T06:17:03.556360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553105+0000","last_change":"2024-03-26T06:16:58.524089+0000","last_active":"2024-03-26T06:17:03.553105+0000","last_peered":"2024-03-26T06:17:03.553105+0000","last_clean":"2024-03-26T06:17:03.553105+0000","last_became_active":"2024-03-26T06:16:58.522756+0000","last_became_peered":"2024-03-26T06:16:58.522756+0000","last_unstale":"2024-03-26T06:17:03.553105+0000","last_undegraded":"2024-03-26T06:17:03.553105+0000","last_fullsized":"2024-03-26T06:17:03.553105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554786+0000","last_change":"2024-03-26T06:16:58.530175+0000","last_active":"2024-03-26T06:17:03.554786+0000","last_peered":"2024-03-26T06:17:03.554786+0000","last_clean":"2024-03-26T06:17:03.554786+0000","last_became_active":"2024-03-26T06:16:58.529900+0000","last_became_peered":"2024-03-26T06:16:58.529900+0000","last_unstale":"2024-03-26T06:17:03.554786+0000","last_undegraded":"2024-03-26T06:17:03.554786+0000","last_fullsized":"2024-03-26T06:17:03.554786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553982+0000","last_change":"2024-03-26T06:16:58.529902+0000","last_active":"2024-03-26T06:17:03.553982+0000","last_peered":"2024-03-26T06:17:03.553982+0000","last_clean":"2024-03-26T06:17:03.553982+0000","last_became_active":"2024-03-26T06:16:58.525109+0000","last_became_peered":"2024-03-26T06:16:58.525109+0000","last_unstale":"2024-03-26T06:17:03.553982+0000","last_undegraded":"2024-03-26T06:17:03.553982+0000","last_fullsized":"2024-03-26T06:17:03.553982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593384+0000","last_change":"2024-03-26T06:16:58.529175+0000","last_active":"2024-03-26T06:17:03.593384+0000","last_peered":"2024-03-26T06:17:03.593384+0000","last_clean":"2024-03-26T06:17:03.593384+0000","last_became_active":"2024-03-26T06:16:58.525707+0000","last_became_peered":"2024-03-26T06:16:58.525707+0000","last_unstale":"2024-03-26T06:17:03.593384+0000","last_undegraded":"2024-03-26T06:17:03.593384+0000","last_fullsized":"2024-03-26T06:17:03.593384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:22:40.139697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595961+0000","last_change":"2024-03-26T06:16:58.526724+0000","last_active":"2024-03-26T06:17:03.595961+0000","last_peered":"2024-03-26T06:17:03.595961+0000","last_clean":"2024-03-26T06:17:03.595961+0000","last_became_active":"2024-03-26T06:16:58.526193+0000","last_became_peered":"2024-03-26T06:16:58.526193+0000","last_unstale":"2024-03-26T06:17:03.595961+0000","last_undegraded":"2024-03-26T06:17:03.595961+0000","last_fullsized":"2024-03-26T06:17:03.595961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601351+0000","last_change":"2024-03-26T06:16:58.527308+0000","last_active":"2024-03-26T06:17:03.601351+0000","last_peered":"2024-03-26T06:17:03.601351+0000","last_clean":"2024-03-26T06:17:03.601351+0000","last_became_active":"2024-03-26T06:16:58.526990+0000","last_became_peered":"2024-03-26T06:16:58.526990+0000","last_unstale":"2024-03-26T06:17:03.601351+0000","last_undegraded":"2024-03-26T06:17:03.601351+0000","last_fullsized":"2024-03-26T06:17:03.601351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:40.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550779+0000","last_change":"2024-03-26T06:16:58.522409+0000","last_active":"2024-03-26T06:17:03.550779+0000","last_peered":"2024-03-26T06:17:03.550779+0000","last_clean":"2024-03-26T06:17:03.550779+0000","last_became_active":"2024-03-26T06:16:58.521947+0000","last_became_peered":"2024-03-26T06:16:58.521947+0000","last_unstale":"2024-03-26T06:17:03.550779+0000","last_undegraded":"2024-03-26T06:17:03.550779+0000","last_fullsized":"2024-03-26T06:17:03.550779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:28.052525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554877+0000","last_change":"2024-03-26T06:16:58.541494+0000","last_active":"2024-03-26T06:17:03.554877+0000","last_peered":"2024-03-26T06:17:03.554877+0000","last_clean":"2024-03-26T06:17:03.554877+0000","last_became_active":"2024-03-26T06:16:58.541225+0000","last_became_peered":"2024-03-26T06:16:58.541225+0000","last_unstale":"2024-03-26T06:17:03.554877+0000","last_undegraded":"2024-03-26T06:17:03.554877+0000","last_fullsized":"2024-03-26T06:17:03.554877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:35.743222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.552810+0000","last_change":"2024-03-26T06:16:58.533315+0000","last_active":"2024-03-26T06:17:03.552810+0000","last_peered":"2024-03-26T06:17:03.552810+0000","last_clean":"2024-03-26T06:17:03.552810+0000","last_became_active":"2024-03-26T06:16:58.528051+0000","last_became_peered":"2024-03-26T06:16:58.528051+0000","last_unstale":"2024-03-26T06:17:03.552810+0000","last_undegraded":"2024-03-26T06:17:03.552810+0000","last_fullsized":"2024-03-26T06:17:03.552810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594978+0000","last_change":"2024-03-26T06:16:58.527009+0000","last_active":"2024-03-26T06:17:03.594978+0000","last_peered":"2024-03-26T06:17:03.594978+0000","last_clean":"2024-03-26T06:17:03.594978+0000","last_became_active":"2024-03-26T06:16:58.526743+0000","last_became_peered":"2024-03-26T06:16:58.526743+0000","last_unstale":"2024-03-26T06:17:03.594978+0000","last_undegraded":"2024-03-26T06:17:03.594978+0000","last_fullsized":"2024-03-26T06:17:03.594978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594651+0000","last_change":"2024-03-26T06:16:58.507099+0000","last_active":"2024-03-26T06:17:03.594651+0000","last_peered":"2024-03-26T06:17:03.594651+0000","last_clean":"2024-03-26T06:17:03.594651+0000","last_became_active":"2024-03-26T06:16:58.506705+0000","last_became_peered":"2024-03-26T06:16:58.506705+0000","last_unstale":"2024-03-26T06:17:03.594651+0000","last_undegraded":"2024-03-26T06:17:03.594651+0000","last_fullsized":"2024-03-26T06:17:03.594651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:17:59.821941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555438+0000","last_change":"2024-03-26T06:16:58.516376+0000","last_active":"2024-03-26T06:17:03.555438+0000","last_peered":"2024-03-26T06:17:03.555438+0000","last_clean":"2024-03-26T06:17:03.555438+0000","last_became_active":"2024-03-26T06:16:58.515999+0000","last_became_peered":"2024-03-26T06:16:58.515999+0000","last_unstale":"2024-03-26T06:17:03.555438+0000","last_undegraded":"2024-03-26T06:17:03.555438+0000","last_fullsized":"2024-03-26T06:17:03.555438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599454+0000","last_change":"2024-03-26T06:16:58.544901+0000","last_active":"2024-03-26T06:17:03.599454+0000","last_peered":"2024-03-26T06:17:03.599454+0000","last_clean":"2024-03-26T06:17:03.599454+0000","last_became_active":"2024-03-26T06:16:58.544637+0000","last_became_peered":"2024-03-26T06:16:58.544637+0000","last_unstale":"2024-03-26T06:17:03.599454+0000","last_undegraded":"2024-03-26T06:17:03.599454+0000","last_fullsized":"2024-03-26T06:17:03.599454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:28.052525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596829+0000","last_change":"2024-03-26T06:16:58.536619+0000","last_active":"2024-03-26T06:17:03.596829+0000","last_peered":"2024-03-26T06:17:03.596829+0000","last_clean":"2024-03-26T06:17:03.596829+0000","last_became_active":"2024-03-26T06:16:58.536267+0000","last_became_peered":"2024-03-26T06:16:58.536267+0000","last_unstale":"2024-03-26T06:17:03.596829+0000","last_undegraded":"2024-03-26T06:17:03.596829+0000","last_fullsized":"2024-03-26T06:17:03.596829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600622+0000","last_change":"2024-03-26T06:16:58.538210+0000","last_active":"2024-03-26T06:17:03.600622+0000","last_peered":"2024-03-26T06:17:03.600622+0000","last_clean":"2024-03-26T06:17:03.600622+0000","last_became_active":"2024-03-26T06:16:58.537967+0000","last_became_peered":"2024-03-26T06:16:58.537967+0000","last_unstale":"2024-03-26T06:17:03.600622+0000","last_undegraded":"2024-03-26T06:17:03.600622+0000","last_fullsized":"2024-03-26T06:17:03.600622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.602020+0000","last_change":"2024-03-26T06:16:58.540273+0000","last_active":"2024-03-26T06:17:03.602020+0000","last_peered":"2024-03-26T06:17:03.602020+0000","last_clean":"2024-03-26T06:17:03.602020+0000","last_became_active":"2024-03-26T06:16:58.539908+0000","last_became_peered":"2024-03-26T06:16:58.539908+0000","last_unstale":"2024-03-26T06:17:03.602020+0000","last_undegraded":"2024-03-26T06:17:03.602020+0000","last_fullsized":"2024-03-26T06:17:03.602020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:12:57.541865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554144+0000","last_change":"2024-03-26T06:16:58.535528+0000","last_active":"2024-03-26T06:17:03.554144+0000","last_peered":"2024-03-26T06:17:03.554144+0000","last_clean":"2024-03-26T06:17:03.554144+0000","last_became_active":"2024-03-26T06:16:58.535213+0000","last_became_peered":"2024-03-26T06:16:58.535213+0000","last_unstale":"2024-03-26T06:17:03.554144+0000","last_undegraded":"2024-03-26T06:17:03.554144+0000","last_fullsized":"2024-03-26T06:17:03.554144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598687+0000","last_change":"2024-03-26T06:16:58.525785+0000","last_active":"2024-03-26T06:17:03.598687+0000","last_peered":"2024-03-26T06:17:03.598687+0000","last_clean":"2024-03-26T06:17:03.598687+0000","last_became_active":"2024-03-26T06:16:58.525444+0000","last_became_peered":"2024-03-26T06:16:58.525444+0000","last_unstale":"2024-03-26T06:17:03.598687+0000","last_undegraded":"2024-03-26T06:17:03.598687+0000","last_fullsized":"2024-03-26T06:17:03.598687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553717+0000","last_change":"2024-03-26T06:16:58.532698+0000","last_active":"2024-03-26T06:17:03.553717+0000","last_peered":"2024-03-26T06:17:03.553717+0000","last_clean":"2024-03-26T06:17:03.553717+0000","last_became_active":"2024-03-26T06:16:58.532381+0000","last_became_peered":"2024-03-26T06:16:58.532381+0000","last_unstale":"2024-03-26T06:17:03.553717+0000","last_undegraded":"2024-03-26T06:17:03.553717+0000","last_fullsized":"2024-03-26T06:17:03.553717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599589+0000","last_change":"2024-03-26T06:16:58.524657+0000","last_active":"2024-03-26T06:17:03.599589+0000","last_peered":"2024-03-26T06:17:03.599589+0000","last_clean":"2024-03-26T06:17:03.599589+0000","last_became_active":"2024-03-26T06:16:58.524265+0000","last_became_peered":"2024-03-26T06:16:58.524265+0000","last_unstale":"2024-03-26T06:17:03.599589+0000","last_undegraded":"2024-03-26T06:17:03.599589+0000","last_fullsized":"2024-03-26T06:17:03.599589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:30.208261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553997+0000","last_change":"2024-03-26T06:16:58.523272+0000","last_active":"2024-03-26T06:17:03.553997+0000","last_peered":"2024-03-26T06:17:03.553997+0000","last_clean":"2024-03-26T06:17:03.553997+0000","last_became_active":"2024-03-26T06:16:58.522614+0000","last_became_peered":"2024-03-26T06:16:58.522614+0000","last_unstale":"2024-03-26T06:17:03.553997+0000","last_undegraded":"2024-03-26T06:17:03.553997+0000","last_fullsized":"2024-03-26T06:17:03.553997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:17.123689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594564+0000","last_change":"2024-03-26T06:16:58.519796+0000","last_active":"2024-03-26T06:17:03.594564+0000","last_peered":"2024-03-26T06:17:03.594564+0000","last_clean":"2024-03-26T06:17:03.594564+0000","last_became_active":"2024-03-26T06:16:58.516658+0000","last_became_peered":"2024-03-26T06:16:58.516658+0000","last_unstale":"2024-03-26T06:17:03.594564+0000","last_undegraded":"2024-03-26T06:17:03.594564+0000","last_fullsized":"2024-03-26T06:17:03.594564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:19:35.554524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595916+0000","last_change":"2024-03-26T06:16:58.505664+0000","last_active":"2024-03-26T06:17:03.595916+0000","last_peered":"2024-03-26T06:17:03.595916+0000","last_clean":"2024-03-26T06:17:03.595916+0000","last_became_active":"2024-03-26T06:16:58.505309+0000","last_became_peered":"2024-03-26T06:16:58.505309+0000","last_unstale":"2024-03-26T06:17:03.595916+0000","last_undegraded":"2024-03-26T06:17:03.595916+0000","last_fullsized":"2024-03-26T06:17:03.595916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601776+0000","last_change":"2024-03-26T06:16:58.539992+0000","last_active":"2024-03-26T06:17:03.601776+0000","last_peered":"2024-03-26T06:17:03.601776+0000","last_clean":"2024-03-26T06:17:03.601776+0000","last_became_active":"2024-03-26T06:16:58.539588+0000","last_became_peered":"2024-03-26T06:16:58.539588+0000","last_unstale":"2024-03-26T06:17:03.601776+0000","last_undegraded":"2024-03-26T06:17:03.601776+0000","last_fullsized":"2024-03-26T06:17:03.601776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:17.123689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-26T06:17:22.671 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-26T06:17:22.671 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-26T06:17:22.671 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-26T06:17:22.672 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-26T06:17:22.672 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-26T06:17:22.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.930+0000 7fd3d6200640 1 Processor -- start 2024-03-26T06:17:22.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.931+0000 7fd3d6200640 1 -- start start 2024-03-26T06:17:22.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.932+0000 7fd3d6200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3d00cdf10 0x7fd3d00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.932+0000 7fd3d6200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d00ce830 con 0x7fd3d015fe40 2024-03-26T06:17:22.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.932+0000 7fd3d6200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d00cfaa0 con 0x7fd3d00c6b50 2024-03-26T06:17:22.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.932+0000 7fd3d6200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d00cfd50 con 0x7fd3d00cdf10 2024-03-26T06:17:22.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.932+0000 7fd3cf400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3d00cdf10 0x7fd3d00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.933+0000 7fd3cea00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd3d015fe40 0x7fd3d00cf390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43822/0 (socket says 172.21.15.63:43822) 2024-03-26T06:17:22.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.933+0000 7fd3cea00640 1 -- 172.21.15.63:0/450340922 learned_addr learned my addr 172.21.15.63:0/450340922 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:22.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.933+0000 7fd3ce000640 1 -- 172.21.15.63:0/450340922 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260447637 0 0) 0x7fd3d00ce830 con 0x7fd3d015fe40 2024-03-26T06:17:22.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.933+0000 7fd3ce000640 1 -- 172.21.15.63:0/450340922 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b4003520 con 0x7fd3d015fe40 2024-03-26T06:17:22.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.933+0000 7fd3cf400640 1 -- 172.21.15.63:0/450340922 >> v1:172.21.15.204:6789/0 conn(0x7fd3d00c6b50 legacy=0x7fd3d00c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.933+0000 7fd3cf400640 1 -- 172.21.15.63:0/450340922 >> v1:172.21.15.63:6789/0 conn(0x7fd3d015fe40 legacy=0x7fd3d00cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.933+0000 7fd3cf400640 1 -- 172.21.15.63:0/450340922 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00d0030 con 0x7fd3d00cdf10 2024-03-26T06:17:22.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.935+0000 7fd3cf400640 1 --2- 172.21.15.63:0/450340922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d00cdf10 0x7fd3d00ce2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009d90 tx=0x7fd3c002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bb1dab34492238 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:22.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.935+0000 7fd3ce000640 1 -- 172.21.15.63:0/450340922 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0039070 con 0x7fd3d00cdf10 2024-03-26T06:17:22.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.935+0000 7fd3ce000640 1 -- 172.21.15.63:0/450340922 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c002cd00 con 0x7fd3d00cdf10 2024-03-26T06:17:22.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.935+0000 7fd3ce000640 1 -- 172.21.15.63:0/450340922 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0034660 con 0x7fd3d00cdf10 2024-03-26T06:17:22.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.936+0000 7fd3d6200640 1 -- 172.21.15.63:0/450340922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d00cdf10 msgr2=0x7fd3d00ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.936+0000 7fd3d6200640 1 --2- 172.21.15.63:0/450340922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d00cdf10 0x7fd3d00ce2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009d90 tx=0x7fd3c002bf50 comp rx=0 tx=0).stop 2024-03-26T06:17:22.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.936+0000 7fd3d6200640 1 -- 172.21.15.63:0/450340922 shutdown_connections 2024-03-26T06:17:22.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.936+0000 7fd3d6200640 1 --2- 172.21.15.63:0/450340922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d00cdf10 0x7fd3d00ce2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.936+0000 7fd3d6200640 1 -- 172.21.15.63:0/450340922 >> 172.21.15.63:0/450340922 conn(0x7fd3d00b3410 msgr2=0x7fd3d00b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:22.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.936+0000 7fd3d6200640 1 -- 172.21.15.63:0/450340922 shutdown_connections 2024-03-26T06:17:22.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.936+0000 7fd3d6200640 1 -- 172.21.15.63:0/450340922 wait complete. 2024-03-26T06:17:22.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.938+0000 7fd3d6200640 1 Processor -- start 2024-03-26T06:17:22.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.938+0000 7fd3d6200640 1 -- start start 2024-03-26T06:17:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.939+0000 7fd3d6200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3d00c6b50 0x7fd3d0150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.939+0000 7fd3d6200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d00cdf10 0x7fd3d00b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.939+0000 7fd3d6200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d015fe40 0x7fd3d00b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3d6200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00c76b0 con 0x7fd3d015fe40 2024-03-26T06:17:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3d6200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d015f640 con 0x7fd3d00c6b50 2024-03-26T06:17:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3d6200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d01602c0 con 0x7fd3d00cdf10 2024-03-26T06:17:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d015fe40 0x7fd3d00b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d015fe40 0x7fd3d00b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49632/0 (socket says 172.21.15.63:49632) 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cfe00640 1 -- 172.21.15.63:0/1952846700 learned_addr learned my addr 172.21.15.63:0/1952846700 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cf400640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3d00c6b50 0x7fd3d0150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cea00640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d00cdf10 0x7fd3d00b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cfe00640 1 -- 172.21.15.63:0/1952846700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d00cdf10 msgr2=0x7fd3d00b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cfe00640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d00cdf10 0x7fd3d00b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cfe00640 1 -- 172.21.15.63:0/1952846700 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3d00c6b50 msgr2=0x7fd3d0150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cfe00640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3d00c6b50 0x7fd3d0150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.940+0000 7fd3cfe00640 1 -- 172.21.15.63:0/1952846700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00b55f0 con 0x7fd3d015fe40 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.941+0000 7fd3cfe00640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d015fe40 0x7fd3d00b4c90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c390 tx=0x7fd3c800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.941+0000 7fd3c7400640 1 -- 172.21.15.63:0/1952846700 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8017070 con 0x7fd3d015fe40 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.941+0000 7fd3c7400640 1 -- 172.21.15.63:0/1952846700 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c80052d0 con 0x7fd3d015fe40 2024-03-26T06:17:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.941+0000 7fd3c7400640 1 -- 172.21.15.63:0/1952846700 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8003810 con 0x7fd3d015fe40 2024-03-26T06:17:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.941+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d00b58d0 con 0x7fd3d015fe40 2024-03-26T06:17:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.941+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d01505c0 con 0x7fd3d015fe40 2024-03-26T06:17:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.942+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d0074730 con 0x7fd3d015fe40 2024-03-26T06:17:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.943+0000 7fd3c7400640 1 -- 172.21.15.63:0/1952846700 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd3c801a070 con 0x7fd3d015fe40 2024-03-26T06:17:22.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.944+0000 7fd3c7400640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd3ac06bbd0 0x7fd3ac06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:22.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.944+0000 7fd3c7400640 1 -- 172.21.15.63:0/1952846700 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd3c808a1b0 con 0x7fd3d015fe40 2024-03-26T06:17:22.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.944+0000 7fd3cf400640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd3ac06bbd0 0x7fd3ac06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:22.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.945+0000 7fd3cf400640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd3ac06bbd0 0x7fd3ac06e090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0036000 tx=0x7fd3c0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:22.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:22.949+0000 7fd3c7400640 1 -- 172.21.15.63:0/1952846700 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fd3c80588c0 con 0x7fd3d015fe40 2024-03-26T06:17:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.201+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd3d00b4210 con 0x7fd3d015fe40 2024-03-26T06:17:23.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.205+0000 7fd3c7400640 1 -- 172.21.15.63:0/1952846700 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+172579 (secure 0 0 0) 0x7fd3c80581c0 con 0x7fd3d015fe40 2024-03-26T06:17:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd3ac06bbd0 msgr2=0x7fd3ac06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd3ac06bbd0 0x7fd3ac06e090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0036000 tx=0x7fd3c0030000 comp rx=0 tx=0).stop 2024-03-26T06:17:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d015fe40 msgr2=0x7fd3d00b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d015fe40 0x7fd3d00b4c90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c390 tx=0x7fd3c800c850 comp rx=0 tx=0).stop 2024-03-26T06:17:23.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 shutdown_connections 2024-03-26T06:17:23.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd3ac06bbd0 0x7fd3ac06e090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3d015fe40 0x7fd3d00b4c90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d00cdf10 0x7fd3d00b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 --2- 172.21.15.63:0/1952846700 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3d00c6b50 0x7fd3d0150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.210+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 >> 172.21.15.63:0/1952846700 conn(0x7fd3d00b3410 msgr2=0x7fd3d015c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:23.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.211+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 shutdown_connections 2024-03-26T06:17:23.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.211+0000 7fd3d6200640 1 -- 172.21.15.63:0/1952846700 wait complete. 2024-03-26T06:17:23.229 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3591189670},{"type":"v1","addr":"172.21.15.63:6833","nonce":3591189670}]},"active_addr":"172.21.15.63:6833/3591189670","active_change":"2024-03-26T06:16:37.855808+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":1798628026}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3884058115}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3602910936}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":1919227178}]}]} 2024-03-26T06:17:23.232 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-26T06:17:23.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-26T06:17:23.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:23.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.458+0000 7fee7ca00640 1 Processor -- start 2024-03-26T06:17:23.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.458+0000 7fee7ca00640 1 -- start start 2024-03-26T06:17:23.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.460+0000 7fee7ca00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee78151020 0x7fee7815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.460+0000 7fee7ca00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fee780b4b20 0x7fee7806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.460+0000 7fee7ca00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 0x7fee780ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.460+0000 7fee7ca00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780ce2c0 con 0x7fee78151020 2024-03-26T06:17:23.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.460+0000 7fee7ca00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780cdcb0 con 0x7fee780b4b20 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.460+0000 7fee7ca00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee780b4fd0 con 0x7fee7806e050 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.460+0000 7fee77400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee78151020 0x7fee7815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.461+0000 7fee77400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee78151020 0x7fee7815e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49646/0 (socket says 172.21.15.63:49646) 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.461+0000 7fee77400640 1 -- 172.21.15.63:0/896921102 learned_addr learned my addr 172.21.15.63:0/896921102 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.461+0000 7fee77e00640 1 --2- 172.21.15.63:0/896921102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 0x7fee780ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.461+0000 7fee76a00640 1 --2- 172.21.15.63:0/896921102 >> v2:172.21.15.204:3300/0 conn(0x7fee780b4b20 0x7fee7806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.461+0000 7fee77400640 1 -- 172.21.15.63:0/896921102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 msgr2=0x7fee780ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.461+0000 7fee77400640 1 --2- 172.21.15.63:0/896921102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 0x7fee780ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.461+0000 7fee77400640 1 -- 172.21.15.63:0/896921102 >> v2:172.21.15.204:3300/0 conn(0x7fee780b4b20 msgr2=0x7fee7806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.461+0000 7fee77400640 1 --2- 172.21.15.63:0/896921102 >> v2:172.21.15.204:3300/0 conn(0x7fee780b4b20 0x7fee7806db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.461+0000 7fee77400640 1 -- 172.21.15.63:0/896921102 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780b3cf0 con 0x7fee78151020 2024-03-26T06:17:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.462+0000 7fee77400640 1 --2- 172.21.15.63:0/896921102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 0x7fee7815e4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee7806f620 tx=0x7fee6802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788e7a39c1bcc6ac server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.462+0000 7fee76000640 1 -- 172.21.15.63:0/896921102 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee680317d0 con 0x7fee78151020 2024-03-26T06:17:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee76000640 1 -- 172.21.15.63:0/896921102 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68037070 con 0x7fee78151020 2024-03-26T06:17:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee76000640 1 -- 172.21.15.63:0/896921102 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68031b90 con 0x7fee78151020 2024-03-26T06:17:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee7ca00640 1 -- 172.21.15.63:0/896921102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 msgr2=0x7fee7815e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee7ca00640 1 --2- 172.21.15.63:0/896921102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 0x7fee7815e4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee7806f620 tx=0x7fee6802b870 comp rx=0 tx=0).stop 2024-03-26T06:17:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee7ca00640 1 -- 172.21.15.63:0/896921102 shutdown_connections 2024-03-26T06:17:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee7ca00640 1 --2- 172.21.15.63:0/896921102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 0x7fee780ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee7ca00640 1 --2- 172.21.15.63:0/896921102 >> v2:172.21.15.204:3300/0 conn(0x7fee780b4b20 0x7fee7806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee7ca00640 1 --2- 172.21.15.63:0/896921102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 0x7fee7815e4c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee7ca00640 1 -- 172.21.15.63:0/896921102 >> 172.21.15.63:0/896921102 conn(0x7fee780b13d0 msgr2=0x7fee780b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.463+0000 7fee7ca00640 1 -- 172.21.15.63:0/896921102 shutdown_connections 2024-03-26T06:17:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.464+0000 7fee7ca00640 1 -- 172.21.15.63:0/896921102 wait complete. 2024-03-26T06:17:23.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.465+0000 7fee7ca00640 1 Processor -- start 2024-03-26T06:17:23.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.465+0000 7fee7ca00640 1 -- start start 2024-03-26T06:17:23.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.466+0000 7fee7ca00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 0x7fee781f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.466+0000 7fee7ca00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee780b4b20 0x7fee7814d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.466+0000 7fee7ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 0x7fee78138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.466+0000 7fee7ca00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780cec90 con 0x7fee78151020 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.466+0000 7fee7ca00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780cdf50 con 0x7fee780b4b20 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.466+0000 7fee7ca00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee780cee10 con 0x7fee7806e050 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee77e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 0x7fee78138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee77e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 0x7fee78138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49660/0 (socket says 172.21.15.63:49660) 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee77e00640 1 -- 172.21.15.63:0/4184534503 learned_addr learned my addr 172.21.15.63:0/4184534503 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee77400640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 0x7fee781f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee76a00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee780b4b20 0x7fee7814d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee77e00640 1 -- 172.21.15.63:0/4184534503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 msgr2=0x7fee781f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee77e00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 0x7fee781f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee77e00640 1 -- 172.21.15.63:0/4184534503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee780b4b20 msgr2=0x7fee7814d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee77e00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee780b4b20 0x7fee7814d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.467+0000 7fee77e00640 1 -- 172.21.15.63:0/4184534503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7814c5e0 con 0x7fee78151020 2024-03-26T06:17:23.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.468+0000 7fee77e00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 0x7fee78138d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee70009fd0 tx=0x7fee7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:23.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.468+0000 7fee6f400640 1 -- 172.21.15.63:0/4184534503 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70014420 con 0x7fee78151020 2024-03-26T06:17:23.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.468+0000 7fee6f400640 1 -- 172.21.15.63:0/4184534503 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee70019070 con 0x7fee78151020 2024-03-26T06:17:23.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.468+0000 7fee6f400640 1 -- 172.21.15.63:0/4184534503 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70014800 con 0x7fee78151020 2024-03-26T06:17:23.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.468+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee781f5060 con 0x7fee78151020 2024-03-26T06:17:23.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.468+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee78139b70 con 0x7fee78151020 2024-03-26T06:17:23.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.469+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee780b0430 con 0x7fee78151020 2024-03-26T06:17:23.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.470+0000 7fee6f400640 1 -- 172.21.15.63:0/4184534503 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fee700149a0 con 0x7fee78151020 2024-03-26T06:17:23.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.471+0000 7fee6f400640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5806bbd0 0x7fee5806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.471+0000 7fee6f400640 1 -- 172.21.15.63:0/4184534503 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fee7008b620 con 0x7fee78151020 2024-03-26T06:17:23.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.471+0000 7fee77400640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5806bbd0 0x7fee5806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.472+0000 7fee77400640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5806bbd0 0x7fee5806e090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee68036000 tx=0x7fee6803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:23.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.476+0000 7fee6f400640 1 -- 172.21.15.63:0/4184534503 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fee780b0430 con 0x7fee78151020 2024-03-26T06:17:23.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.678+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee7815a920 con 0x7fee78151020 2024-03-26T06:17:23.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.681+0000 7fee6f400640 1 -- 172.21.15.63:0/4184534503 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7fee7815a920 con 0x7fee78151020 2024-03-26T06:17:23.682 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:23.682 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.683+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5806bbd0 msgr2=0x7fee5806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5806bbd0 0x7fee5806e090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee68036000 tx=0x7fee6803d040 comp rx=0 tx=0).stop 2024-03-26T06:17:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 msgr2=0x7fee78138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 0x7fee78138d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee70009fd0 tx=0x7fee7000e4b0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 shutdown_connections 2024-03-26T06:17:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5806bbd0 0x7fee5806e090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee78151020 0x7fee78138d40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee780b4b20 0x7fee7814d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 --2- 172.21.15.63:0/4184534503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7806e050 0x7fee781f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 >> 172.21.15.63:0/4184534503 conn(0x7fee780b13d0 msgr2=0x7fee780afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:23.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 shutdown_connections 2024-03-26T06:17:23.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.684+0000 7fee7ca00640 1 -- 172.21.15.63:0/4184534503 wait complete. 2024-03-26T06:17:23.702 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-26T06:17:23.702 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.927+0000 7f2566600640 1 Processor -- start 2024-03-26T06:17:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.928+0000 7f2566600640 1 -- start start 2024-03-26T06:17:23.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.929+0000 7f2566600640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f256015d9a0 0x7f25600b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.929+0000 7f2566600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 0x7f25600ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.929+0000 7f2566600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25600d3250 0x7f25600cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.929+0000 7f2566600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600b97c0 con 0x7f25600d3250 2024-03-26T06:17:23.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.929+0000 7f2566600640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600d21b0 con 0x7f256015d9a0 2024-03-26T06:17:23.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.929+0000 7f2566600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600d2490 con 0x7f25600d1c10 2024-03-26T06:17:23.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.929+0000 7f2565c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25600d3250 0x7f25600cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.930+0000 7f2565c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25600d3250 0x7f25600cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49666/0 (socket says 172.21.15.63:49666) 2024-03-26T06:17:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.930+0000 7f2565c00640 1 -- 172.21.15.63:0/1426944994 learned_addr learned my addr 172.21.15.63:0/1426944994 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.930+0000 7f255fe00640 1 --2- 172.21.15.63:0/1426944994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 0x7f25600ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.930+0000 7f2565200640 1 --2- 172.21.15.63:0/1426944994 >> v2:172.21.15.204:3300/0 conn(0x7f256015d9a0 0x7f25600b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.930+0000 7f2565c00640 1 -- 172.21.15.63:0/1426944994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 msgr2=0x7f25600ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.930+0000 7f2565c00640 1 --2- 172.21.15.63:0/1426944994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 0x7f25600ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.930+0000 7f2565c00640 1 -- 172.21.15.63:0/1426944994 >> v2:172.21.15.204:3300/0 conn(0x7f256015d9a0 msgr2=0x7f25600b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.930+0000 7f2565c00640 1 --2- 172.21.15.63:0/1426944994 >> v2:172.21.15.204:3300/0 conn(0x7f256015d9a0 0x7f25600b9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.930+0000 7f2565c00640 1 -- 172.21.15.63:0/1426944994 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600d2770 con 0x7f25600d3250 2024-03-26T06:17:23.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.931+0000 7f2565c00640 1 --2- 172.21.15.63:0/1426944994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 0x7f25600cea50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f256008bf40 tx=0x7f255802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a826187a1d58a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:23.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.931+0000 7f255f400640 1 -- 172.21.15.63:0/1426944994 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255802c9f0 con 0x7f25600d3250 2024-03-26T06:17:23.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.931+0000 7f255f400640 1 -- 172.21.15.63:0/1426944994 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255802cb90 con 0x7f25600d3250 2024-03-26T06:17:23.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.931+0000 7f255f400640 1 -- 172.21.15.63:0/1426944994 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25580343f0 con 0x7f25600d3250 2024-03-26T06:17:23.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.932+0000 7f2566600640 1 -- 172.21.15.63:0/1426944994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 msgr2=0x7f25600cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.932+0000 7f2566600640 1 --2- 172.21.15.63:0/1426944994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 0x7f25600cea50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f256008bf40 tx=0x7f255802be50 comp rx=0 tx=0).stop 2024-03-26T06:17:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.932+0000 7f2566600640 1 -- 172.21.15.63:0/1426944994 shutdown_connections 2024-03-26T06:17:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.932+0000 7f2566600640 1 --2- 172.21.15.63:0/1426944994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 0x7f25600cea50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.932+0000 7f2566600640 1 --2- 172.21.15.63:0/1426944994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 0x7f25600ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.932+0000 7f2566600640 1 --2- 172.21.15.63:0/1426944994 >> v2:172.21.15.204:3300/0 conn(0x7f256015d9a0 0x7f25600b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.932+0000 7f2566600640 1 -- 172.21.15.63:0/1426944994 >> 172.21.15.63:0/1426944994 conn(0x7f256006bfa0 msgr2=0x7f256006c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.933+0000 7f2566600640 1 -- 172.21.15.63:0/1426944994 shutdown_connections 2024-03-26T06:17:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.933+0000 7f2566600640 1 -- 172.21.15.63:0/1426944994 wait complete. 2024-03-26T06:17:23.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.934+0000 7f2566600640 1 Processor -- start 2024-03-26T06:17:23.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.935+0000 7f2566600640 1 -- start start 2024-03-26T06:17:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.935+0000 7f2566600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 0x7f256015f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.935+0000 7f2566600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 0x7f25601f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f2566600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256015d9a0 0x7f25600c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f2566600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256015dd80 con 0x7f25600d3250 2024-03-26T06:17:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f2566600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600d2d30 con 0x7f256015d9a0 2024-03-26T06:17:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f2566600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600b52c0 con 0x7f25600d1c10 2024-03-26T06:17:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f255fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 0x7f25601f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f255fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 0x7f25601f3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49668/0 (socket says 172.21.15.63:49668) 2024-03-26T06:17:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f255fe00640 1 -- 172.21.15.63:0/3509635127 learned_addr learned my addr 172.21.15.63:0/3509635127 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f2565200640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 0x7f256015f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f255fe00640 1 -- 172.21.15.63:0/3509635127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 msgr2=0x7f256015f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f255fe00640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 0x7f256015f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f2565c00640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256015d9a0 0x7f25600c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f255fe00640 1 -- 172.21.15.63:0/3509635127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256015d9a0 msgr2=0x7f25600c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f255fe00640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256015d9a0 0x7f25600c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.936+0000 7f255fe00640 1 -- 172.21.15.63:0/3509635127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600cb380 con 0x7f25600d3250 2024-03-26T06:17:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.937+0000 7f255fe00640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 0x7f25601f3260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f254c00d800 tx=0x7f254c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.937+0000 7f255cc00640 1 -- 172.21.15.63:0/3509635127 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c018020 con 0x7f25600d3250 2024-03-26T06:17:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.937+0000 7f255cc00640 1 -- 172.21.15.63:0/3509635127 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c0096a0 con 0x7f25600d3250 2024-03-26T06:17:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.937+0000 7f255cc00640 1 -- 172.21.15.63:0/3509635127 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c009a70 con 0x7f25600d3250 2024-03-26T06:17:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.937+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25601601b0 con 0x7f25600d3250 2024-03-26T06:17:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.937+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2560160770 con 0x7f25600d3250 2024-03-26T06:17:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.938+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256004f050 con 0x7f25600d3250 2024-03-26T06:17:23.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.939+0000 7f255cc00640 1 -- 172.21.15.63:0/3509635127 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f254c01b020 con 0x7f25600d3250 2024-03-26T06:17:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.940+0000 7f255cc00640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f254006bbd0 0x7f254006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.940+0000 7f255cc00640 1 -- 172.21.15.63:0/3509635127 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f254c08afe0 con 0x7f25600d3250 2024-03-26T06:17:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.940+0000 7f2565200640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f254006bbd0 0x7f254006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:23.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.941+0000 7f2565200640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f254006bbd0 0x7f254006e090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2554006fd0 tx=0x7f2554008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:23.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:23.945+0000 7f255cc00640 1 -- 172.21.15.63:0/3509635127 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f254c022030 con 0x7f25600d3250 2024-03-26T06:17:24.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.153+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25600c6aa0 con 0x7f25600d3250 2024-03-26T06:17:24.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.155+0000 7f255cc00640 1 -- 172.21.15.63:0/3509635127 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f254c059750 con 0x7f25600d3250 2024-03-26T06:17:24.156 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:24.156 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:24.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f254006bbd0 msgr2=0x7f254006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f254006bbd0 0x7f254006e090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2554006fd0 tx=0x7f2554008040 comp rx=0 tx=0).stop 2024-03-26T06:17:24.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 msgr2=0x7f25601f3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 0x7f25601f3260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f254c00d800 tx=0x7f254c00dcc0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 shutdown_connections 2024-03-26T06:17:24.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f254006bbd0 0x7f254006e090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256015d9a0 0x7f25600c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25600d3250 0x7f25601f3260 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 --2- 172.21.15.63:0/3509635127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25600d1c10 0x7f256015f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 >> 172.21.15.63:0/3509635127 conn(0x7f256006bfa0 msgr2=0x7f256015cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 shutdown_connections 2024-03-26T06:17:24.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.159+0000 7f2566600640 1 -- 172.21.15.63:0/3509635127 wait complete. 2024-03-26T06:17:24.180 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-26T06:17:24.180 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-26T06:17:24.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-26T06:17:24.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-26T06:17:24.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-26T06:17:24.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-26T06:17:24.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-26T06:17:24.183 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-26T06:17:24.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.493+0000 7efe96200640 1 Processor -- start 2024-03-26T06:17:24.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.493+0000 7efe96200640 1 -- start start 2024-03-26T06:17:24.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.494+0000 7f6162600640 1 Processor -- start 2024-03-26T06:17:24.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.495+0000 7f6162600640 1 -- start start 2024-03-26T06:17:24.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.496+0000 7efe96200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efe9015d9d0 0x7efe900b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.496+0000 7efe96200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe9015ddb0 0x7efe901616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.497+0000 7efe96200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900d19d0 con 0x7efe900ce640 2024-03-26T06:17:24.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.497+0000 7efe96200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe90161f10 con 0x7efe9015d9d0 2024-03-26T06:17:24.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.497+0000 7efe96200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe901621f0 con 0x7efe9015ddb0 2024-03-26T06:17:24.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.497+0000 7efe8fe00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7efe900ce640 0x7efe900b52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:42462/0 (socket says 172.21.15.63:42462) 2024-03-26T06:17:24.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.497+0000 7efe8fe00640 1 -- 172.21.15.63:0/1802707018 learned_addr learned my addr 172.21.15.63:0/1802707018 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.498+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724220716 0 0) 0x7efe900d19d0 con 0x7efe900ce640 2024-03-26T06:17:24.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.498+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe74003520 con 0x7efe900ce640 2024-03-26T06:17:24.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.498+0000 7f6162600640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f61540556a0 0x7f6154054da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.498+0000 7efe93200640 1 Processor -- start 2024-03-26T06:17:24.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.498+0000 7efe8ea00640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe9015ddb0 0x7efe901616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.498+0000 7efe8f400640 1 --2- 172.21.15.63:0/1802707018 >> v2:172.21.15.204:3300/0 conn(0x7efe9015d9d0 0x7efe900b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.498+0000 7f6162600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6154007d30 con 0x7f61540509b0 2024-03-26T06:17:24.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7f6162600640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6154008010 con 0x7f61540391b0 2024-03-26T06:17:24.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836087287 0 0) 0x7efe74003520 con 0x7efe900ce640 2024-03-26T06:17:24.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe9015ddb0 msgr2=0x7efe901616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7f6162600640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61540082f0 con 0x7f61540556a0 2024-03-26T06:17:24.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe9015ddb0 0x7efe901616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 >> v2:172.21.15.204:3300/0 conn(0x7efe9015d9d0 msgr2=0x7efe900b94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7f615b400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f61540509b0 0x7f6154050d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43828/0 (socket says 172.21.15.63:43828) 2024-03-26T06:17:24.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7f615b400640 1 -- 172.21.15.63:0/2077073225 learned_addr learned my addr 172.21.15.63:0/2077073225 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 --2- 172.21.15.63:0/1802707018 >> v2:172.21.15.204:3300/0 conn(0x7efe9015d9d0 0x7efe900b94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe901624d0 con 0x7efe900ce640 2024-03-26T06:17:24.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7efe7c001670 con 0x7efe900ce640 2024-03-26T06:17:24.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7f615aa00640 1 --2- 172.21.15.63:0/2077073225 >> v2:172.21.15.204:3300/0 conn(0x7f61540556a0 0x7f6154054da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.498+0000 7efe93200640 1 -- start start 2024-03-26T06:17:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7efe93200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe8c159d00 0x7efe8c0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7efe93200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efe8c0b36f0 0x7efe8c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7efe93200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8c071c10 con 0x7efe8c071830 2024-03-26T06:17:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7efe93200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8c0ccac0 con 0x7efe8c159d00 2024-03-26T06:17:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7efe93200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8c06e880 con 0x7efe8c0b36f0 2024-03-26T06:17:24.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 >> v1:172.21.15.204:6789/0 conn(0x7efe900ce640 legacy=0x7efe900b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe740039b0 0x7efe74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7f862f200640 1 Processor -- start 2024-03-26T06:17:24.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7f862f200640 1 -- start start 2024-03-26T06:17:24.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7f615aa00640 1 -- 172.21.15.63:0/2077073225 >> v1:172.21.15.204:6789/0 conn(0x7f61540391b0 legacy=0x7f6154039620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe74004800 0x7efe74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe740051c0 0x7efe7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe90161f10 con 0x7efe740051c0 2024-03-26T06:17:24.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe901621f0 con 0x7efe740039b0 2024-03-26T06:17:24.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.499+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7400bf30 con 0x7efe74004800 2024-03-26T06:17:24.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7efe8ea00640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe9015ddb0 0x7efe901616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:24.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.500+0000 7efe8f400640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe740039b0 0x7efe74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.501+0000 7efe8ea00640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe74004800 0x7efe74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.501+0000 7efe8fe00640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe740051c0 0x7efe7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7f862f200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f862815df90 0x7f86280d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7efe8f400640 1 -- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe74004800 msgr2=0x7efe74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7efe8f400640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe74004800 0x7efe74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7efe8f400640 1 -- 172.21.15.63:0/1802707018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe740051c0 msgr2=0x7efe7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7efe8f400640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe740051c0 0x7efe7400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7efe8f400640 1 -- 172.21.15.63:0/1802707018 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe901624d0 con 0x7efe740039b0 2024-03-26T06:17:24.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.501+0000 7efe8be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe8c159d00 0x7efe8c0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.501+0000 7efe8b400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efe8c0b36f0 0x7efe8c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7efe8b400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efe8c0b36f0 0x7efe8c0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43592/0 (socket says 172.21.15.63:43592) 2024-03-26T06:17:24.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7efe8b400640 1 -- 172.21.15.63:0/1917399737 learned_addr learned my addr 172.21.15.63:0/1917399737 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7f862f200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f86280b96e0 0x7f86280d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7f862f200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86280d2490 con 0x7f862815dbb0 2024-03-26T06:17:24.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7f862f200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280b7be0 con 0x7f862815df90 2024-03-26T06:17:24.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7f862f200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280d2770 con 0x7f86280b96e0 2024-03-26T06:17:24.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.503+0000 7f8627e00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f862815dbb0 0x7f86280d1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:42488/0 (socket says 172.21.15.63:42488) 2024-03-26T06:17:24.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.503+0000 7f8627e00640 1 -- 172.21.15.63:0/1325031371 learned_addr learned my addr 172.21.15.63:0/1325031371 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.503+0000 7f8627400640 1 --2- 172.21.15.63:0/1325031371 >> v2:172.21.15.63:3300/0 conn(0x7f862815df90 0x7f86280d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7f615a000640 1 -- 172.21.15.63:0/2077073225 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705577306 0 0) 0x7f6154007d30 con 0x7f61540509b0 2024-03-26T06:17:24.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7f615aa00640 1 -- 172.21.15.63:0/2077073225 >> v1:172.21.15.63:6789/0 conn(0x7f61540509b0 legacy=0x7f6154050d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.502+0000 7f615aa00640 1 -- 172.21.15.63:0/2077073225 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540085d0 con 0x7f61540556a0 2024-03-26T06:17:24.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.503+0000 7efe8b400640 1 -- 172.21.15.63:0/1917399737 >> v2:172.21.15.63:3300/0 conn(0x7efe8c159d00 msgr2=0x7efe8c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.503+0000 7f862d200640 1 --2- 172.21.15.63:0/1325031371 >> v2:172.21.15.204:3300/0 conn(0x7f86280b96e0 0x7f86280d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.503+0000 7fae44a00640 1 Processor -- start 2024-03-26T06:17:24.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.503+0000 7efe8b400640 1 --2- 172.21.15.63:0/1917399737 >> v2:172.21.15.63:3300/0 conn(0x7efe8c159d00 0x7efe8c0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.503+0000 7efe8aa00640 1 -- 172.21.15.63:0/1917399737 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948045357 0 0) 0x7efe8c071c10 con 0x7efe8c071830 2024-03-26T06:17:24.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7efe8b400640 1 -- 172.21.15.63:0/1917399737 >> v1:172.21.15.63:6789/0 conn(0x7efe8c071830 legacy=0x7efe8c06d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.503+0000 7fae44a00640 1 -- start start 2024-03-26T06:17:24.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7efe8f400640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe740039b0 0x7efe74003dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe80009af0 tx=0x7efe74005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd7a8836192264de server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7efe8b400640 1 -- 172.21.15.63:0/1917399737 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c06eb60 con 0x7efe8c0b36f0 2024-03-26T06:17:24.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7efe8be00640 1 --2- 172.21.15.63:0/1917399737 >> v2:172.21.15.63:3300/0 conn(0x7efe8c159d00 0x7efe8c0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:24.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7f615aa00640 1 --2- 172.21.15.63:0/2077073225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61540556a0 0x7f6154054da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f615c064a50 tx=0x7f615c0a8800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d5a95d8d6dec215 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7f862d200640 1 -- 172.21.15.63:0/1325031371 >> v2:172.21.15.63:3300/0 conn(0x7f862815df90 msgr2=0x7f86280d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80040070 con 0x7efe740039b0 2024-03-26T06:17:24.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7f862d200640 1 --2- 172.21.15.63:0/1325031371 >> v2:172.21.15.63:3300/0 conn(0x7f862815df90 0x7f86280d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7f862d200640 1 -- 172.21.15.63:0/1325031371 >> v1:172.21.15.204:6789/0 conn(0x7f862815dbb0 legacy=0x7f86280d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7f862d200640 1 -- 172.21.15.63:0/1325031371 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280d2a50 con 0x7f86280b96e0 2024-03-26T06:17:24.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7f8626a00640 1 -- 172.21.15.63:0/1325031371 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925852588 0 0) 0x7f86280d2490 con 0x7f862815dbb0 2024-03-26T06:17:24.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.505+0000 7f8627400640 1 --2- 172.21.15.63:0/1325031371 >> v2:172.21.15.63:3300/0 conn(0x7f862815df90 0x7f86280d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:17:24.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.504+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8003b400 con 0x7efe740039b0 2024-03-26T06:17:24.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.505+0000 7efe8e000640 1 -- 172.21.15.63:0/1802707018 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80009690 con 0x7efe740039b0 2024-03-26T06:17:24.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.505+0000 7f615a000640 1 -- 172.21.15.63:0/2077073225 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c0ae620 con 0x7f61540556a0 2024-03-26T06:17:24.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.505+0000 7f615a000640 1 -- 172.21.15.63:0/2077073225 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c0ae800 con 0x7f61540556a0 2024-03-26T06:17:24.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.505+0000 7f615a000640 1 -- 172.21.15.63:0/2077073225 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c0aec70 con 0x7f61540556a0 2024-03-26T06:17:24.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.505+0000 7fae44a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fae4015df90 0x7fae400d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.505+0000 7fae44a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae400b96e0 0x7fae400d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7efe96200640 1 -- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe740039b0 msgr2=0x7efe74003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7efe96200640 1 --2- 172.21.15.63:0/1802707018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe740039b0 0x7efe74003dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe80009af0 tx=0x7efe74005830 comp rx=0 tx=0).stop 2024-03-26T06:17:24.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7fae44a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae400d2490 con 0x7fae4015dbb0 2024-03-26T06:17:24.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7fae44a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae400b7be0 con 0x7fae4015df90 2024-03-26T06:17:24.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7fae44a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400d2770 con 0x7fae400b96e0 2024-03-26T06:17:24.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7efe8fe00640 1 -- 172.21.15.63:0/1802707018 reap_dead start 2024-03-26T06:17:24.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7fae3de00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fae4015dbb0 0x7fae400d1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43850/0 (socket says 172.21.15.63:43850) 2024-03-26T06:17:24.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7fae3de00640 1 -- 172.21.15.63:0/2560247005 learned_addr learned my addr 172.21.15.63:0/2560247005 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7f862d200640 1 --2- 172.21.15.63:0/1325031371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86280b96e0 0x7f86280d0960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86280d1240 tx=0x7f862002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa4a9b68e71a6338 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7fae3e800640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae400b96e0 0x7fae400d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7efe8b400640 1 --2- 172.21.15.63:0/1917399737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe8c0b36f0 0x7efe8c0712f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0b3fb0 tx=0x7efe780300a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fac8d2a341f58fe server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3d400640 1 --2- 172.21.15.63:0/2560247005 >> v2:172.21.15.204:3300/0 conn(0x7fae4015df90 0x7fae400d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7f6162600640 1 -- 172.21.15.63:0/2077073225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61540556a0 msgr2=0x7f6154054da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8184323 0 0) 0x7fae400d2490 con 0x7fae4015dbb0 2024-03-26T06:17:24.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae24003520 con 0x7fae4015dbb0 2024-03-26T06:17:24.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7f8626a00640 1 -- 172.21.15.63:0/1325031371 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620039070 con 0x7f86280b96e0 2024-03-26T06:17:24.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.506+0000 7f6162600640 1 --2- 172.21.15.63:0/2077073225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61540556a0 0x7f6154054da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f615c064a50 tx=0x7f615c0a8800 comp rx=0 tx=0).stop 2024-03-26T06:17:24.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7efe96200640 1 -- 172.21.15.63:0/1802707018 shutdown_connections 2024-03-26T06:17:24.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7efe96200640 1 -- 172.21.15.63:0/1802707018 >> 172.21.15.63:0/1802707018 conn(0x7efe9006c2f0 msgr2=0x7efe9006c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7f8626a00640 1 -- 172.21.15.63:0/1325031371 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862002cd10 con 0x7f86280b96e0 2024-03-26T06:17:24.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7f8626a00640 1 -- 172.21.15.63:0/1325031371 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620034660 con 0x7f86280b96e0 2024-03-26T06:17:24.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7efe8aa00640 1 -- 172.21.15.63:0/1917399737 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78036070 con 0x7efe8c0b36f0 2024-03-26T06:17:24.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3895377831 0 0) 0x7fae24003520 con 0x7fae4015dbb0 2024-03-26T06:17:24.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae400b96e0 msgr2=0x7fae400d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae400b96e0 0x7fae400d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 >> v2:172.21.15.204:3300/0 conn(0x7fae4015df90 msgr2=0x7fae400d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 --2- 172.21.15.63:0/2560247005 >> v2:172.21.15.204:3300/0 conn(0x7fae4015df90 0x7fae400d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae400d2a50 con 0x7fae4015dbb0 2024-03-26T06:17:24.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fae30001670 con 0x7fae4015dbb0 2024-03-26T06:17:24.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7efe96200640 1 -- 172.21.15.63:0/1802707018 shutdown_connections 2024-03-26T06:17:24.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7efe8aa00640 1 -- 172.21.15.63:0/1917399737 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78030e50 con 0x7efe8c0b36f0 2024-03-26T06:17:24.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7efe8aa00640 1 -- 172.21.15.63:0/1917399737 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7803a600 con 0x7efe8c0b36f0 2024-03-26T06:17:24.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 >> v1:172.21.15.63:6789/0 conn(0x7fae4015dbb0 legacy=0x7fae400d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae240039b0 0x7fae24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.507+0000 7fae3ca00640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae24004800 0x7fae24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7fae3ca00640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae240051c0 0x7fae2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400b7be0 con 0x7fae240039b0 2024-03-26T06:17:24.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400d2770 con 0x7fae240051c0 2024-03-26T06:17:24.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2400bf00 con 0x7fae24004800 2024-03-26T06:17:24.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7fae3e800640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae400b96e0 0x7fae400d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:17:24.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7efe96200640 1 -- 172.21.15.63:0/1802707018 wait complete. 2024-03-26T06:17:24.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7f862f200640 1 -- 172.21.15.63:0/1325031371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86280b96e0 msgr2=0x7f86280d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7f862f200640 1 --2- 172.21.15.63:0/1325031371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86280b96e0 0x7f86280d0960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86280d1240 tx=0x7f862002bf60 comp rx=0 tx=0).stop 2024-03-26T06:17:24.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7f6162600640 1 -- 172.21.15.63:0/2077073225 shutdown_connections 2024-03-26T06:17:24.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7f6162600640 1 --2- 172.21.15.63:0/2077073225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61540556a0 0x7f6154054da0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7f6162600640 1 -- 172.21.15.63:0/2077073225 >> 172.21.15.63:0/2077073225 conn(0x7f6154055be0 msgr2=0x7f6154055ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7f862f200640 1 -- 172.21.15.63:0/1325031371 shutdown_connections 2024-03-26T06:17:24.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7fae3de00640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae240039b0 0x7fae24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7fae3d400640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae24004800 0x7fae24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.508+0000 7f862f200640 1 --2- 172.21.15.63:0/1325031371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86280b96e0 0x7f86280d0960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7f862f200640 1 --2- 172.21.15.63:0/1325031371 >> v2:172.21.15.63:3300/0 conn(0x7f862815df90 0x7f86280d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7f862f200640 1 -- 172.21.15.63:0/1325031371 >> 172.21.15.63:0/1325031371 conn(0x7f86280b5540 msgr2=0x7f86280b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7f862f200640 1 -- 172.21.15.63:0/1325031371 shutdown_connections 2024-03-26T06:17:24.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7f6162600640 1 -- 172.21.15.63:0/2077073225 shutdown_connections 2024-03-26T06:17:24.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7fae3d400640 1 -- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae240051c0 msgr2=0x7fae2400b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-26T06:17:24.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7fae3e800640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae240051c0 0x7fae2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7f862f200640 1 -- 172.21.15.63:0/1325031371 wait complete. 2024-03-26T06:17:24.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7fae3d400640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae240051c0 0x7fae2400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7fae3d400640 1 -- 172.21.15.63:0/2560247005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae240039b0 msgr2=0x7fae24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7fae3d400640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae240039b0 0x7fae24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7fae3d400640 1 -- 172.21.15.63:0/2560247005 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae400d2a50 con 0x7fae24004800 2024-03-26T06:17:24.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7fae3de00640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae240039b0 0x7fae24003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:24.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7efe93200640 1 -- 172.21.15.63:0/1917399737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe8c0b36f0 msgr2=0x7efe8c0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7efe93200640 1 --2- 172.21.15.63:0/1917399737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe8c0b36f0 0x7efe8c0712f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0b3fb0 tx=0x7efe780300a0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.509+0000 7f6162600640 1 -- 172.21.15.63:0/2077073225 wait complete. 2024-03-26T06:17:24.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.511+0000 7efe93200640 1 -- 172.21.15.63:0/1917399737 shutdown_connections 2024-03-26T06:17:24.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.511+0000 7efe93200640 1 --2- 172.21.15.63:0/1917399737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe8c0b36f0 0x7efe8c0712f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.511+0000 7efe93200640 1 --2- 172.21.15.63:0/1917399737 >> v2:172.21.15.63:3300/0 conn(0x7efe8c159d00 0x7efe8c0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.511+0000 7efe93200640 1 -- 172.21.15.63:0/1917399737 >> 172.21.15.63:0/1917399737 conn(0x7efe8c06b0b0 msgr2=0x7efe8c06b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.511+0000 7efe93200640 1 -- 172.21.15.63:0/1917399737 shutdown_connections 2024-03-26T06:17:24.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.511+0000 7efe96200640 1 Processor -- start 2024-03-26T06:17:24.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.511+0000 7fae3d400640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae24004800 0x7fae24004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009a90 tx=0x7fae24005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eba784e6577221fd server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.511+0000 7f862f200640 1 Processor -- start 2024-03-26T06:17:24.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.512+0000 7efe96200640 1 -- start start 2024-03-26T06:17:24.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.512+0000 7f6162600640 1 Processor -- start 2024-03-26T06:17:24.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.512+0000 7f862f200640 1 -- start start 2024-03-26T06:17:24.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.512+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c039070 con 0x7fae24004800 2024-03-26T06:17:24.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.512+0000 7f6162600640 1 -- start start 2024-03-26T06:17:24.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.512+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c02c6b0 con 0x7fae24004800 2024-03-26T06:17:24.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.512+0000 7fae3ca00640 1 -- 172.21.15.63:0/2560247005 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c009690 con 0x7fae24004800 2024-03-26T06:17:24.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7fae44a00640 1 -- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae24004800 msgr2=0x7fae24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7fae44a00640 1 --2- 172.21.15.63:0/2560247005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae24004800 0x7fae24004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009a90 tx=0x7fae24005830 comp rx=0 tx=0).stop 2024-03-26T06:17:24.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7efe96200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe740039b0 0x7efe900cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7efe96200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe901532d0 0x7efe900ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7efe96200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe900caf30 0x7efe9015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7efe93200640 1 -- 172.21.15.63:0/1917399737 wait complete. 2024-03-26T06:17:24.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7fae3e800640 1 -- 172.21.15.63:0/2560247005 reap_dead start 2024-03-26T06:17:24.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7fae44a00640 1 -- 172.21.15.63:0/2560247005 shutdown_connections 2024-03-26T06:17:24.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7fae44a00640 1 -- 172.21.15.63:0/2560247005 >> 172.21.15.63:0/2560247005 conn(0x7fae400b5540 msgr2=0x7fae400b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f862f200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86280b96e0 0x7f8628160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f0151c00640 1 Processor -- start 2024-03-26T06:17:24.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7efe96200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900d3340 con 0x7efe901532d0 2024-03-26T06:17:24.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7efe96200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900d31c0 con 0x7efe900caf30 2024-03-26T06:17:24.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.513+0000 7efe96200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe900d34c0 con 0x7efe740039b0 2024-03-26T06:17:24.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f6162600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61540391b0 0x7f61540e1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f6162600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61540509b0 0x7f6154049710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f6162600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61540556a0 0x7f6154049c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f862f200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f862815dbb0 0x7f86280b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f862f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815df90 0x7f862815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f862f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280d36b0 con 0x7f862815df90 2024-03-26T06:17:24.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f862f200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280d3530 con 0x7f86280b96e0 2024-03-26T06:17:24.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f862f200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280b6bd0 con 0x7f862815dbb0 2024-03-26T06:17:24.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f0151c00640 1 -- start start 2024-03-26T06:17:24.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7efe8fe00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe900caf30 0x7efe9015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7efe8f400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe740039b0 0x7efe900cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7efe8f400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe740039b0 0x7efe900cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47676/0 (socket says 172.21.15.63:47676) 2024-03-26T06:17:24.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7efe8f400640 1 -- 172.21.15.63:0/1916246048 learned_addr learned my addr 172.21.15.63:0/1916246048 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7efe8ea00640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe901532d0 0x7efe900ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f6162600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540e0190 con 0x7f61540509b0 2024-03-26T06:17:24.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f6162600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540079c0 con 0x7f61540391b0 2024-03-26T06:17:24.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.514+0000 7f6162600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61540e0310 con 0x7f61540556a0 2024-03-26T06:17:24.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7fae44a00640 1 -- 172.21.15.63:0/2560247005 shutdown_connections 2024-03-26T06:17:24.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f8627400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f862815dbb0 0x7f86280b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f8627e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86280b96e0 0x7f8628160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f8627e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86280b96e0 0x7f8628160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43614/0 (socket says 172.21.15.63:43614) 2024-03-26T06:17:24.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f8627e00640 1 -- 172.21.15.63:0/185016429 learned_addr learned my addr 172.21.15.63:0/185016429 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f862d200640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815df90 0x7f862815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7efe93200640 1 Processor -- start 2024-03-26T06:17:24.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f615aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61540509b0 0x7f6154049710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f615aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61540509b0 0x7f6154049710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49706/0 (socket says 172.21.15.63:49706) 2024-03-26T06:17:24.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f615aa00640 1 -- 172.21.15.63:0/1413822933 learned_addr learned my addr 172.21.15.63:0/1413822933 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f615be00640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61540556a0 0x7f6154049c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.515+0000 7f615b400640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61540391b0 0x7f61540e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7efe93200640 1 -- start start 2024-03-26T06:17:24.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7efe8f400640 1 -- 172.21.15.63:0/1916246048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe900caf30 msgr2=0x7efe9015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7efe8f400640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe900caf30 0x7efe9015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7efe8f400640 1 -- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe901532d0 msgr2=0x7efe900ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7efe8f400640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe901532d0 0x7efe900ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7efe8f400640 1 -- 172.21.15.63:0/1916246048 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe901611c0 con 0x7efe740039b0 2024-03-26T06:17:24.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f862d200640 1 -- 172.21.15.63:0/185016429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f862815dbb0 msgr2=0x7f86280b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f862d200640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f862815dbb0 0x7f86280b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f862d200640 1 -- 172.21.15.63:0/185016429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86280b96e0 msgr2=0x7f8628160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f862d200640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86280b96e0 0x7f8628160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f862d200640 1 -- 172.21.15.63:0/185016429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280cca40 con 0x7f862815df90 2024-03-26T06:17:24.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7fae44a00640 1 -- 172.21.15.63:0/2560247005 wait complete. 2024-03-26T06:17:24.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f615aa00640 1 -- 172.21.15.63:0/1413822933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61540556a0 msgr2=0x7f6154049c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f862d200640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815df90 0x7f862815e410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8620033000 tx=0x7f8620004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f615aa00640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61540556a0 0x7f6154049c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f615aa00640 1 -- 172.21.15.63:0/1413822933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61540391b0 msgr2=0x7f61540e1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f615aa00640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61540391b0 0x7f61540e1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.516+0000 7f615aa00640 1 -- 172.21.15.63:0/1413822933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154004f60 con 0x7f61540509b0 2024-03-26T06:17:24.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f0151c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f014c159ed0 0x7f014c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f0151c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f014c06f3e0 0x7f014c06e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f0151c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c15a650 con 0x7f014c159af0 2024-03-26T06:17:24.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f0151c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0b4120 con 0x7f014c06f3e0 2024-03-26T06:17:24.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f0151c00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c06da80 con 0x7f014c159ed0 2024-03-26T06:17:24.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7efe93200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe8c071830 0x7efe8c14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7efe93200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe8c0b36f0 0x7efe8c152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7efe93200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe8c159d00 0x7efe8c0af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7efe93200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c06f120 con 0x7efe8c071830 2024-03-26T06:17:24.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7efe93200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c06e510 con 0x7efe8c0b36f0 2024-03-26T06:17:24.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7efe93200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c06f2a0 con 0x7efe8c159d00 2024-03-26T06:17:24.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f014aa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f014c159af0 0x7f014c0b3a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43858/0 (socket says 172.21.15.63:43858) 2024-03-26T06:17:24.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7efe8f400640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe740039b0 0x7efe900cd3a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe80009a90 tx=0x7efe80004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f014aa00640 1 -- 172.21.15.63:0/3551568987 learned_addr learned my addr 172.21.15.63:0/3551568987 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7efe8b400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe8c0b36f0 0x7efe8c152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7f014b400640 1 --2- 172.21.15.63:0/3551568987 >> v2:172.21.15.63:3300/0 conn(0x7f014c06f3e0 0x7f014c06e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7f615aa00640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61540509b0 0x7f6154049710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f615c02d400 tx=0x7f615c074400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7efe91200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe8c159d00 0x7efe8c0af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7efe91200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe8c159d00 0x7efe8c0af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47708/0 (socket says 172.21.15.63:47708) 2024-03-26T06:17:24.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7efe91200640 1 -- 172.21.15.63:0/3261866697 learned_addr learned my addr 172.21.15.63:0/3261866697 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7efe87400640 1 -- 172.21.15.63:0/1916246048 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8004a020 con 0x7efe740039b0 2024-03-26T06:17:24.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7efe87400640 1 -- 172.21.15.63:0/1916246048 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe80003c40 con 0x7efe740039b0 2024-03-26T06:17:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f861fe00640 1 -- 172.21.15.63:0/185016429 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620039050 con 0x7f862815df90 2024-03-26T06:17:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f861fe00640 1 -- 172.21.15.63:0/185016429 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862003a040 con 0x7f862815df90 2024-03-26T06:17:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f861fe00640 1 -- 172.21.15.63:0/185016429 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862003e610 con 0x7f862815df90 2024-03-26T06:17:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.517+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86280ccd20 con 0x7f862815df90 2024-03-26T06:17:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86280cd2e0 con 0x7f862815df90 2024-03-26T06:17:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7f014a000640 1 --2- 172.21.15.63:0/3551568987 >> v2:172.21.15.204:3300/0 conn(0x7f014c159ed0 0x7f014c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe90152510 con 0x7efe740039b0 2024-03-26T06:17:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.518+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe90152ad0 con 0x7efe740039b0 2024-03-26T06:17:24.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7efe87400640 1 -- 172.21.15.63:0/1916246048 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80040040 con 0x7efe740039b0 2024-03-26T06:17:24.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7efe8be00640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe8c071830 0x7efe8c14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7efe91200640 1 -- 172.21.15.63:0/3261866697 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe8c0b36f0 msgr2=0x7efe8c152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7efe91200640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe8c0b36f0 0x7efe8c152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7efe91200640 1 -- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe8c071830 msgr2=0x7efe8c14ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7efe91200640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe8c071830 0x7efe8c14ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7efe91200640 1 -- 172.21.15.63:0/3261866697 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c14b580 con 0x7efe8c159d00 2024-03-26T06:17:24.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7efe8b400640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe8c0b36f0 0x7efe8c152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:24.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7fae44a00640 1 Processor -- start 2024-03-26T06:17:24.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.519+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8628074730 con 0x7f862815df90 2024-03-26T06:17:24.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe9004f0c0 con 0x7efe740039b0 2024-03-26T06:17:24.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7efe91200640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe8c159d00 0x7efe8c0af9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efe84001560 tx=0x7efe8400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7fae44a00640 1 -- start start 2024-03-26T06:17:24.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7f014b400640 1 -- 172.21.15.63:0/3551568987 >> v2:172.21.15.204:3300/0 conn(0x7f014c159ed0 msgr2=0x7f014c06e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7f014b400640 1 --2- 172.21.15.63:0/3551568987 >> v2:172.21.15.204:3300/0 conn(0x7f014c159ed0 0x7f014c06e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7f014b400640 1 -- 172.21.15.63:0/3551568987 >> v1:172.21.15.63:6789/0 conn(0x7f014c159af0 legacy=0x7f014c0b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7f014b400640 1 -- 172.21.15.63:0/3551568987 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c15a930 con 0x7f014c06f3e0 2024-03-26T06:17:24.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7f614f400640 1 -- 172.21.15.63:0/1413822933 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c0afc30 con 0x7f61540509b0 2024-03-26T06:17:24.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6154036600 con 0x7f61540509b0 2024-03-26T06:17:24.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.520+0000 7f614f400640 1 -- 172.21.15.63:0/1413822933 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c0afdd0 con 0x7f61540509b0 2024-03-26T06:17:24.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.521+0000 7f614f400640 1 -- 172.21.15.63:0/1413822933 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c0afc30 con 0x7f61540509b0 2024-03-26T06:17:24.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.521+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6154034500 con 0x7f61540509b0 2024-03-26T06:17:24.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.521+0000 7fae44a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae401f5320 0x7fae400c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.521+0000 7fae44a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae400c7aa0 0x7fae4015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.521+0000 7f3a25000640 1 Processor -- start 2024-03-26T06:17:24.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.522+0000 7efe83e00640 1 -- 172.21.15.63:0/3261866697 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84017070 con 0x7efe8c159d00 2024-03-26T06:17:24.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7efe83e00640 1 -- 172.21.15.63:0/3261866697 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84003dc0 con 0x7efe8c159d00 2024-03-26T06:17:24.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.522+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6138001030 con 0x7f61540509b0 2024-03-26T06:17:24.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7efe83e00640 1 -- 172.21.15.63:0/3261866697 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe840052b0 con 0x7efe8c159d00 2024-03-26T06:17:24.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c14b860 con 0x7efe8c159d00 2024-03-26T06:17:24.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c14be20 con 0x7efe8c159d00 2024-03-26T06:17:24.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.522+0000 7f3a25000640 1 -- start start 2024-03-26T06:17:24.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7f3a25000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a200d0b30 0x7f3a20168950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7f3a25000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a200b7be0 con 0x7f3a2015dbb0 2024-03-26T06:17:24.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7f3a25000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a200d2490 con 0x7f3a2015df90 2024-03-26T06:17:24.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7f3a25000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200d2770 con 0x7f3a200d0b30 2024-03-26T06:17:24.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7f014b400640 1 --2- 172.21.15.63:0/3551568987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f014c06f3e0 0x7f014c06e620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f014c15d700 tx=0x7f014402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96be42ecef6cdf9 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7f0149600640 1 -- 172.21.15.63:0/3551568987 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144039070 con 0x7f014c06f3e0 2024-03-26T06:17:24.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7f0149600640 1 -- 172.21.15.63:0/3551568987 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014402cc70 con 0x7f014c06f3e0 2024-03-26T06:17:24.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7f0149600640 1 -- 172.21.15.63:0/3551568987 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144034660 con 0x7f014c06f3e0 2024-03-26T06:17:24.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.521+0000 7fae44a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4015bd50 0x7fae401e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.521+0000 7fae44a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400d36b0 con 0x7fae401f5320 2024-03-26T06:17:24.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.521+0000 7fae44a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400d3530 con 0x7fae4015bd50 2024-03-26T06:17:24.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.521+0000 7fae44a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400d0960 con 0x7fae400c7aa0 2024-03-26T06:17:24.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.522+0000 7fae3e800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4015bd50 0x7fae401e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.522+0000 7fae3e800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4015bd50 0x7fae401e54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43640/0 (socket says 172.21.15.63:43640) 2024-03-26T06:17:24.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.522+0000 7fae3e800640 1 -- 172.21.15.63:0/3195217040 learned_addr learned my addr 172.21.15.63:0/3195217040 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.523+0000 7fba76e00640 1 Processor -- start 2024-03-26T06:17:24.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7fae3e800640 1 -- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae400c7aa0 msgr2=0x7fae4015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7fae3e800640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae400c7aa0 0x7fae4015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7fae3e800640 1 -- 172.21.15.63:0/3195217040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae401f5320 msgr2=0x7fae400c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7fae3e800640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae401f5320 0x7fae400c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7fae3e800640 1 -- 172.21.15.63:0/3195217040 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae401f8cc0 con 0x7fae4015bd50 2024-03-26T06:17:24.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f0151c00640 1 -- 172.21.15.63:0/3551568987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f014c06f3e0 msgr2=0x7f014c06e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f0151c00640 1 --2- 172.21.15.63:0/3551568987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f014c06f3e0 0x7f014c06e620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f014c15d700 tx=0x7f014402bec0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f3a1d400640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f3a2015df90 0x7f3a200d0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:42494/0 (socket says 172.21.15.63:42494) 2024-03-26T06:17:24.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7efe87400640 1 -- 172.21.15.63:0/1916246048 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efe8004d020 con 0x7efe740039b0 2024-03-26T06:17:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7f861fe00640 1 -- 172.21.15.63:0/185016429 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8620047020 con 0x7f862815df90 2024-03-26T06:17:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe64001030 con 0x7efe8c159d00 2024-03-26T06:17:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7fae3e800640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4015bd50 0x7fae401e54c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae400b6b20 tx=0x7fae3800f6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f0151c00640 1 -- 172.21.15.63:0/3551568987 shutdown_connections 2024-03-26T06:17:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f0151c00640 1 --2- 172.21.15.63:0/3551568987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f014c06f3e0 0x7f014c06e620 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f0151c00640 1 --2- 172.21.15.63:0/3551568987 >> v2:172.21.15.204:3300/0 conn(0x7f014c159ed0 0x7f014c06e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f0151c00640 1 -- 172.21.15.63:0/3551568987 >> 172.21.15.63:0/3551568987 conn(0x7f014c06ac90 msgr2=0x7f014c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f3a1d400640 1 -- 172.21.15.63:0/2425405575 learned_addr learned my addr 172.21.15.63:0/2425405575 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f3a1e800640 1 --2- 172.21.15.63:0/2425405575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a200d0b30 0x7f3a20168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.524+0000 7fba76e00640 1 -- start start 2024-03-26T06:17:24.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f0151c00640 1 -- 172.21.15.63:0/3551568987 shutdown_connections 2024-03-26T06:17:24.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f0151c00640 1 -- 172.21.15.63:0/3551568987 wait complete. 2024-03-26T06:17:24.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.525+0000 7f614f400640 1 -- 172.21.15.63:0/1413822933 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f615c0c1030 con 0x7f61540509b0 2024-03-26T06:17:24.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7fae36000640 1 -- 172.21.15.63:0/3195217040 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3801c070 con 0x7fae4015bd50 2024-03-26T06:17:24.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7f861fe00640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f860806bc20 0x7f860806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7efe87400640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe7006bca0 0x7efe7006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4015c200 con 0x7fae4015bd50 2024-03-26T06:17:24.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae401f7f00 con 0x7fae4015bd50 2024-03-26T06:17:24.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7f861fe00640 1 -- 172.21.15.63:0/185016429 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f86200ada10 con 0x7f862815df90 2024-03-26T06:17:24.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7efe87400640 1 -- 172.21.15.63:0/1916246048 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efe800b5750 con 0x7efe740039b0 2024-03-26T06:17:24.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7f3a1e800640 1 -- 172.21.15.63:0/2425405575 >> v1:172.21.15.204:6789/0 conn(0x7f3a2015df90 legacy=0x7f3a200d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7f3a1e800640 1 -- 172.21.15.63:0/2425405575 >> v1:172.21.15.63:6789/0 conn(0x7f3a2015dbb0 legacy=0x7f3a200d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7f3a1e800640 1 -- 172.21.15.63:0/2425405575 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200d2a50 con 0x7f3a200d0b30 2024-03-26T06:17:24.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.526+0000 7fba76e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba70071f20 0x7fba700b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7efe87400640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6816/2715082202,v1:172.21.15.63:6817/2715082202] conn(0x7efe70075410 0x7efe70077850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7fae36000640 1 -- 172.21.15.63:0/3195217040 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae38017600 con 0x7fae4015bd50 2024-03-26T06:17:24.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7fae36000640 1 -- 172.21.15.63:0/3195217040 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae380179f0 con 0x7fae4015bd50 2024-03-26T06:17:24.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7fba76e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba700b4010 con 0x7fba70158f60 2024-03-26T06:17:24.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7efe87400640 1 -- 172.21.15.63:0/1916246048 --> [v2:172.21.15.63:6816/2715082202,v1:172.21.15.63:6817/2715082202] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe80041e90 con 0x7efe70075410 2024-03-26T06:17:24.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7efe8ea00640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe7006bca0 0x7efe7006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7efe87400640 1 -- 172.21.15.63:0/1916246048 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe800b5b40 con 0x7efe740039b0 2024-03-26T06:17:24.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7fba76e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba700b42d0 con 0x7fba700b3380 2024-03-26T06:17:24.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7fba76e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba700b4c00 con 0x7fba70071f20 2024-03-26T06:17:24.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7f861fe00640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6800/2347448899,v1:172.21.15.63:6801/2347448899] conn(0x7f86080753a0 0x7f86080777e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7f861fe00640 1 -- 172.21.15.63:0/185016429 --> [v2:172.21.15.63:6800/2347448899,v1:172.21.15.63:6801/2347448899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86200020b0 con 0x7f86080753a0 2024-03-26T06:17:24.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7f861fe00640 1 -- 172.21.15.63:0/185016429 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86200adef0 con 0x7f862815df90 2024-03-26T06:17:24.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.528+0000 7f8627400640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6800/2347448899,v1:172.21.15.63:6801/2347448899] conn(0x7f86080753a0 0x7f86080777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.528+0000 7efe8fe00640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6816/2715082202,v1:172.21.15.63:6817/2715082202] conn(0x7efe70075410 0x7efe70077850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.528+0000 7efe8ea00640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe7006bca0 0x7efe7006e160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe901f2c20 tx=0x7efe88003bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.528+0000 7f8627e00640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f860806bc20 0x7f860806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.528+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae18001030 con 0x7fae4015bd50 2024-03-26T06:17:24.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7fba6fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fba70158f60 0x7fba70071810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43878/0 (socket says 172.21.15.63:43878) 2024-03-26T06:17:24.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7fba6fe00640 1 -- 172.21.15.63:0/838721156 learned_addr learned my addr 172.21.15.63:0/838721156 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7f614f400640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f613c06be00 0x7f613c06e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7fba6f400640 1 --2- 172.21.15.63:0/838721156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba70071f20 0x7fba700b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7f614f400640 1 -- 172.21.15.63:0/1413822933 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f615c0b4040 con 0x7f61540509b0 2024-03-26T06:17:24.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7f8627400640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6800/2347448899,v1:172.21.15.63:6801/2347448899] conn(0x7f86080753a0 0x7f86080777e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.527+0000 7efe83e00640 1 -- 172.21.15.63:0/3261866697 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efe8401a070 con 0x7efe8c159d00 2024-03-26T06:17:24.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7efe83e00640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe6c06bca0 0x7efe6c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7efe83e00640 1 -- 172.21.15.63:0/3261866697 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efe8408ac30 con 0x7efe8c159d00 2024-03-26T06:17:24.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7efe83e00640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6819/1727607660,v1:172.21.15.63:6821/1727607660] conn(0x7efe6c075420 0x7efe6c077860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7efe83e00640 1 -- 172.21.15.63:0/3261866697 --> [v2:172.21.15.63:6819/1727607660,v1:172.21.15.63:6821/1727607660] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe8400ae50 con 0x7efe6c075420 2024-03-26T06:17:24.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7efe83e00640 1 -- 172.21.15.63:0/3261866697 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe8408b020 con 0x7efe8c159d00 2024-03-26T06:17:24.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7f8627e00640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f860806bc20 0x7f860806e0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8618007b10 tx=0x7f8618007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7efe8fe00640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6816/2715082202,v1:172.21.15.63:6817/2715082202] conn(0x7efe70075410 0x7efe70077850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7f614f400640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6808/3026376468,v1:172.21.15.63:6809/3026376468] conn(0x7f613c075500 0x7f613c077940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.529+0000 7f614f400640 1 -- 172.21.15.63:0/1413822933 --> [v2:172.21.15.63:6808/3026376468,v1:172.21.15.63:6809/3026376468] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f613c078010 con 0x7f613c075500 2024-03-26T06:17:24.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7f615be00640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6808/3026376468,v1:172.21.15.63:6809/3026376468] conn(0x7f613c075500 0x7f613c077940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7f615b400640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f613c06be00 0x7f613c06e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.531+0000 7f615be00640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6808/3026376468,v1:172.21.15.63:6809/3026376468] conn(0x7f613c075500 0x7f613c077940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7efe8be00640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe6c06bca0 0x7efe6c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.528+0000 7f0151c00640 1 Processor -- start 2024-03-26T06:17:24.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7f3a1e800640 1 --2- 172.21.15.63:0/2425405575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a200d0b30 0x7f3a20168950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009dc0 tx=0x7f3a1802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfa4b7d1efb10e98 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7f3a1ca00640 1 -- 172.21.15.63:0/2425405575 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18039070 con 0x7f3a200d0b30 2024-03-26T06:17:24.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.531+0000 7f3a1ca00640 1 -- 172.21.15.63:0/2425405575 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1802cce0 con 0x7f3a200d0b30 2024-03-26T06:17:24.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.531+0000 7f3a1ca00640 1 -- 172.21.15.63:0/2425405575 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18034660 con 0x7f3a200d0b30 2024-03-26T06:17:24.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7fba6f400640 1 -- 172.21.15.63:0/838721156 >> v1:172.21.15.204:6789/0 conn(0x7fba700b3380 legacy=0x7fba7006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7fba6f400640 1 -- 172.21.15.63:0/838721156 >> v1:172.21.15.63:6789/0 conn(0x7fba70158f60 legacy=0x7fba70071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7fba6f400640 1 -- 172.21.15.63:0/838721156 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba700b45b0 con 0x7fba70071f20 2024-03-26T06:17:24.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.531+0000 7f861fe00640 1 -- 172.21.15.63:0/185016429 <== osd.0 v2:172.21.15.63:6800/2347448899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f86200020b0 con 0x7f86080753a0 2024-03-26T06:17:24.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.530+0000 7fae36000640 1 -- 172.21.15.63:0/3195217040 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fae3801f070 con 0x7fae4015bd50 2024-03-26T06:17:24.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.531+0000 7efe8b400640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6819/1727607660,v1:172.21.15.63:6821/1727607660] conn(0x7efe6c075420 0x7efe6c077860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.531+0000 7f614f400640 1 -- 172.21.15.63:0/1413822933 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f615c12d050 con 0x7f61540509b0 2024-03-26T06:17:24.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.531+0000 7efe87400640 1 -- 172.21.15.63:0/1916246048 <== osd.1 v2:172.21.15.63:6816/2715082202 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efe80041e90 con 0x7efe70075410 2024-03-26T06:17:24.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7f3a25000640 1 -- 172.21.15.63:0/2425405575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a200d0b30 msgr2=0x7f3a20168950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7f3a25000640 1 --2- 172.21.15.63:0/2425405575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a200d0b30 0x7f3a20168950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009dc0 tx=0x7f3a1802bf30 comp rx=0 tx=0).stop 2024-03-26T06:17:24.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7f615b400640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f613c06be00 0x7f613c06e2c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6150007fd0 tx=0x7f6150012af0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7efe8b400640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6819/1727607660,v1:172.21.15.63:6821/1727607660] conn(0x7efe6c075420 0x7efe6c077860 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7efe8be00640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe6c06bca0 0x7efe6c06e160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00a950 tx=0x7efe7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7fae36000640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fae2006bbd0 0x7fae2006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7fae36000640 1 -- 172.21.15.63:0/3195217040 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fae3808b270 con 0x7fae4015bd50 2024-03-26T06:17:24.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7f3a25000640 1 -- 172.21.15.63:0/2425405575 shutdown_connections 2024-03-26T06:17:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7f3a25000640 1 --2- 172.21.15.63:0/2425405575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a200d0b30 0x7f3a20168950 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7f3a25000640 1 -- 172.21.15.63:0/2425405575 >> 172.21.15.63:0/2425405575 conn(0x7f3a200b5540 msgr2=0x7f3a200b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7f3a25000640 1 -- 172.21.15.63:0/2425405575 shutdown_connections 2024-03-26T06:17:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7f3a25000640 1 -- 172.21.15.63:0/2425405575 wait complete. 2024-03-26T06:17:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7fae36000640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:6820/2165493882,v1:172.21.15.204:6823/2165493882] conn(0x7fae20075350 0x7fae20077790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7fae36000640 1 -- 172.21.15.63:0/3195217040 --> [v2:172.21.15.204:6820/2165493882,v1:172.21.15.204:6823/2165493882] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae38022ec0 con 0x7fae20075350 2024-03-26T06:17:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7fae36000640 1 -- 172.21.15.63:0/3195217040 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae38092050 con 0x7fae4015bd50 2024-03-26T06:17:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7fae3de00640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fae2006bbd0 0x7fae2006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.532+0000 7f0151c00640 1 -- start start 2024-03-26T06:17:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7f0151c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f014c06f3e0 0x7f014c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7f0151c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f014c159af0 0x7f014c16a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7f0151c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f014c159ed0 0x7f014c16a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7f0151c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15b1d0 con 0x7f014c159af0 2024-03-26T06:17:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7f0151c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15aef0 con 0x7f014c159ed0 2024-03-26T06:17:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7f0151c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15a360 con 0x7f014c06f3e0 2024-03-26T06:17:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7fae3d400640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:6820/2165493882,v1:172.21.15.204:6823/2165493882] conn(0x7fae20075350 0x7fae20077790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7f614f400640 1 -- 172.21.15.63:0/1413822933 <== osd.2 v2:172.21.15.63:6808/3026376468 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f613c078010 con 0x7f613c075500 2024-03-26T06:17:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.533+0000 7fba6f400640 1 --2- 172.21.15.63:0/838721156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba70071f20 0x7fba700b2e40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba600097d0 tx=0x7fba6002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a19ecc4efa762ecf server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7f014aa00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f014c06f3e0 0x7f014c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7fba6ea00640 1 -- 172.21.15.63:0/838721156 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60034070 con 0x7fba70071f20 2024-03-26T06:17:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7efe83e00640 1 -- 172.21.15.63:0/3261866697 <== osd.3 v2:172.21.15.63:6819/1727607660 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efe8400ae50 con 0x7efe6c075420 2024-03-26T06:17:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7fba6ea00640 1 -- 172.21.15.63:0/838721156 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60030800 con 0x7fba70071f20 2024-03-26T06:17:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7fba6ea00640 1 -- 172.21.15.63:0/838721156 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60034070 con 0x7fba70071f20 2024-03-26T06:17:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7f014aa00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f014c06f3e0 0x7f014c158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47740/0 (socket says 172.21.15.63:47740) 2024-03-26T06:17:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7f014aa00640 1 -- 172.21.15.63:0/3120737868 learned_addr learned my addr 172.21.15.63:0/3120737868 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7f014b400640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f014c159ed0 0x7f014c16a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7f014a000640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f014c159af0 0x7f014c16a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.535+0000 7f3a25000640 1 Processor -- start 2024-03-26T06:17:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.535+0000 7f014aa00640 1 -- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f014c159ed0 msgr2=0x7f014c16a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.535+0000 7f014aa00640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f014c159ed0 0x7f014c16a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.535+0000 7f014aa00640 1 -- 172.21.15.63:0/3120737868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f014c159af0 msgr2=0x7f014c16a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.535+0000 7f014aa00640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f014c159af0 0x7f014c16a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.535+0000 7f014aa00640 1 -- 172.21.15.63:0/3120737868 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0ce930 con 0x7f014c06f3e0 2024-03-26T06:17:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.535+0000 7f3a25000640 1 -- start start 2024-03-26T06:17:24.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.534+0000 7fae3de00640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fae2006bbd0 0x7fae2006e090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae30001eb0 tx=0x7fae30001b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.535+0000 7fae3d400640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:6820/2165493882,v1:172.21.15.204:6823/2165493882] conn(0x7fae20075350 0x7fae20077790 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7fba76e00640 1 -- 172.21.15.63:0/838721156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba70071f20 msgr2=0x7fba700b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7fba76e00640 1 --2- 172.21.15.63:0/838721156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba70071f20 0x7fba700b2e40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba600097d0 tx=0x7fba6002b940 comp rx=0 tx=0).stop 2024-03-26T06:17:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7f014aa00640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f014c06f3e0 0x7f014c158f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f013c00c430 tx=0x7f013c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7fba76e00640 1 -- 172.21.15.63:0/838721156 shutdown_connections 2024-03-26T06:17:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7fba76e00640 1 --2- 172.21.15.63:0/838721156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba70071f20 0x7fba700b2e40 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba600097d0 tx=0x7fba6002b940 comp rx=0 tx=0).stop 2024-03-26T06:17:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7fba76e00640 1 -- 172.21.15.63:0/838721156 >> 172.21.15.63:0/838721156 conn(0x7fba700cfa90 msgr2=0x7fba700cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7fba76e00640 1 -- 172.21.15.63:0/838721156 shutdown_connections 2024-03-26T06:17:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7f0142a00640 1 -- 172.21.15.63:0/3120737868 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c017070 con 0x7f014c06f3e0 2024-03-26T06:17:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7f0142a00640 1 -- 172.21.15.63:0/3120737868 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c005ce0 con 0x7f014c06f3e0 2024-03-26T06:17:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7f0142a00640 1 -- 172.21.15.63:0/3120737868 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0072f0 con 0x7f014c06f3e0 2024-03-26T06:17:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c1484c0 con 0x7f014c06f3e0 2024-03-26T06:17:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7fba76e00640 1 -- 172.21.15.63:0/838721156 wait complete. 2024-03-26T06:17:24.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.536+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0ce090 con 0x7f014c06f3e0 2024-03-26T06:17:24.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.537+0000 7f3a25000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a200d0b30 0x7f3a20071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.537+0000 7f3a25000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a2015dbb0 0x7f3a200cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.537+0000 7f3a25000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2015df90 0x7f3a200cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.537+0000 7f3a25000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200d36b0 con 0x7f3a2015df90 2024-03-26T06:17:24.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.537+0000 7f3a25000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200d3530 con 0x7f3a2015dbb0 2024-03-26T06:17:24.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.537+0000 7f3a25000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200b96e0 con 0x7f3a200d0b30 2024-03-26T06:17:24.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.537+0000 7f3a1d400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a2015dbb0 0x7f3a200cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.538+0000 7fae36000640 1 -- 172.21.15.63:0/3195217040 <== osd.4 v2:172.21.15.204:6820/2165493882 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fae38022ec0 con 0x7fae20075350 2024-03-26T06:17:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.538+0000 7f3a1e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2015df90 0x7f3a200cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.538+0000 7f3a1e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2015df90 0x7f3a200cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49768/0 (socket says 172.21.15.63:49768) 2024-03-26T06:17:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.538+0000 7f3a1e800640 1 -- 172.21.15.63:0/801076509 learned_addr learned my addr 172.21.15.63:0/801076509 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.538+0000 7f3a1e800640 1 -- 172.21.15.63:0/801076509 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a200d0b30 msgr2=0x7f3a20071a90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-26T06:17:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.538+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0124001030 con 0x7f014c06f3e0 2024-03-26T06:17:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.538+0000 7f3a1e800640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a200d0b30 0x7f3a20071a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.538+0000 7f3a1e800640 1 -- 172.21.15.63:0/801076509 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a2015dbb0 msgr2=0x7f3a200cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.538+0000 7f3a1e800640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a2015dbb0 0x7f3a200cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.539+0000 7f3a1e800640 1 -- 172.21.15.63:0/801076509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2015e540 con 0x7f3a2015df90 2024-03-26T06:17:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.539+0000 7f3a1e800640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2015df90 0x7f3a200cbf00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009eb0 tx=0x7f3a18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.541+0000 7fba76e00640 1 Processor -- start 2024-03-26T06:17:24.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.541+0000 7fba76e00640 1 -- start start 2024-03-26T06:17:24.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.543+0000 7f3a16000640 1 -- 172.21.15.63:0/801076509 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18044020 con 0x7f3a2015df90 2024-03-26T06:17:24.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.543+0000 7f3a16000640 1 -- 172.21.15.63:0/801076509 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1803a040 con 0x7f3a2015df90 2024-03-26T06:17:24.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.543+0000 7f3a16000640 1 -- 172.21.15.63:0/801076509 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18039070 con 0x7f3a2015df90 2024-03-26T06:17:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.543+0000 7fba76e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba700b3380 0x7fba70153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.543+0000 7fba76e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba70158f60 0x7fba701506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.544+0000 7fba76e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba70151f80 0x7fba701ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.544+0000 7fba6fe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba700b3380 0x7fba70153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.544+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a200cc440 con 0x7f3a2015df90 2024-03-26T06:17:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.544+0000 7fba6f400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba70158f60 0x7fba701506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.544+0000 7fba6f400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba70158f60 0x7fba701506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43658/0 (socket says 172.21.15.63:43658) 2024-03-26T06:17:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.544+0000 7fba6f400640 1 -- 172.21.15.63:0/95251129 learned_addr learned my addr 172.21.15.63:0/95251129 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.545+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700b3830 con 0x7fba70151f80 2024-03-26T06:17:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.544+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2015eac0 con 0x7f3a2015df90 2024-03-26T06:17:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.544+0000 7f0142a00640 1 -- 172.21.15.63:0/3120737868 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f013c01a070 con 0x7f014c06f3e0 2024-03-26T06:17:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.545+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba70159340 con 0x7fba70158f60 2024-03-26T06:17:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.545+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7006e940 con 0x7fba700b3380 2024-03-26T06:17:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.546+0000 7f0142a00640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f012c06bca0 0x7f012c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.546+0000 7fba6f400640 1 -- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba700b3380 msgr2=0x7fba70153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.546+0000 7fba6f400640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba700b3380 0x7fba70153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.546+0000 7fba6f400640 1 -- 172.21.15.63:0/95251129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba70151f80 msgr2=0x7fba701ed7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-26T06:17:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.546+0000 7f0142a00640 1 -- 172.21.15.63:0/3120737868 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f013c08a900 con 0x7f014c06f3e0 2024-03-26T06:17:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.547+0000 7f014a000640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f012c06bca0 0x7f012c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.547+0000 7f0142a00640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:6800/2623219727,v1:172.21.15.204:6801/2623219727] conn(0x7f012c075420 0x7f012c077860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.547+0000 7f0142a00640 1 -- 172.21.15.63:0/3120737868 --> [v2:172.21.15.204:6800/2623219727,v1:172.21.15.204:6801/2623219727] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f013c01fe50 con 0x7f012c075420 2024-03-26T06:17:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.547+0000 7f0142a00640 1 -- 172.21.15.63:0/3120737868 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f013c08acf0 con 0x7f014c06f3e0 2024-03-26T06:17:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.548+0000 7fba74e00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba70151f80 0x7fba701ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.548+0000 7f014b400640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:6800/2623219727,v1:172.21.15.204:6801/2623219727] conn(0x7f012c075420 0x7f012c077860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.548+0000 7f014a000640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f012c06bca0 0x7f012c06e160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f014c1fb4c0 tx=0x7f0138008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.548+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a20074730 con 0x7f3a2015df90 2024-03-26T06:17:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.548+0000 7fba6f400640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba70151f80 0x7fba701ed7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.548+0000 7fba6f400640 1 -- 172.21.15.63:0/95251129 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba70153050 con 0x7fba70158f60 2024-03-26T06:17:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.548+0000 7fba74e00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba70151f80 0x7fba701ed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.549+0000 7fba6f400640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba70158f60 0x7fba701506d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba6002bed0 tx=0x7fba600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.550+0000 7fba67e00640 1 -- 172.21.15.63:0/95251129 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60034050 con 0x7fba70158f60 2024-03-26T06:17:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.550+0000 7fba67e00640 1 -- 172.21.15.63:0/95251129 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60003820 con 0x7fba70158f60 2024-03-26T06:17:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.550+0000 7fba67e00640 1 -- 172.21.15.63:0/95251129 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60003bf0 con 0x7fba70158f60 2024-03-26T06:17:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.550+0000 7f3a16000640 1 -- 172.21.15.63:0/801076509 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3a18047020 con 0x7f3a2015df90 2024-03-26T06:17:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.550+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba70154370 con 0x7fba70158f60 2024-03-26T06:17:24.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.550+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba701527b0 con 0x7fba70158f60 2024-03-26T06:17:24.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.551+0000 7f014b400640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:6800/2623219727,v1:172.21.15.204:6801/2623219727] conn(0x7f012c075420 0x7f012c077860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.552+0000 7f3a16000640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f39fc06bc20 0x7f39fc06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.552+0000 7f3a16000640 1 -- 172.21.15.63:0/801076509 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3a180ad720 con 0x7f3a2015df90 2024-03-26T06:17:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.552+0000 7f3a16000640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.204:6808/2062532645,v1:172.21.15.204:6809/2062532645] conn(0x7f39fc0753a0 0x7f39fc0777e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.552+0000 7f3a16000640 1 -- 172.21.15.63:0/801076509 --> [v2:172.21.15.204:6808/2062532645,v1:172.21.15.204:6809/2062532645] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39fc077eb0 con 0x7f39fc0753a0 2024-03-26T06:17:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.552+0000 7f3a16000640 1 -- 172.21.15.63:0/801076509 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a180b4050 con 0x7f3a2015df90 2024-03-26T06:17:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.553+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba70074730 con 0x7fba70158f60 2024-03-26T06:17:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.553+0000 7f3a1de00640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f39fc06bc20 0x7f39fc06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.554+0000 7f3a1d400640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.204:6808/2062532645,v1:172.21.15.204:6809/2062532645] conn(0x7f39fc0753a0 0x7f39fc0777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.555+0000 7f3a1de00640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f39fc06bc20 0x7f39fc06e0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a080014f0 tx=0x7f3a08007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.556+0000 7f3a1d400640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.204:6808/2062532645,v1:172.21.15.204:6809/2062532645] conn(0x7f39fc0753a0 0x7f39fc0777e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.556+0000 7f0142a00640 1 -- 172.21.15.63:0/3120737868 <== osd.5 v2:172.21.15.204:6800/2623219727 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f013c01fe50 con 0x7f012c075420 2024-03-26T06:17:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.557+0000 7fba67e00640 1 -- 172.21.15.63:0/95251129 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fba6004a060 con 0x7fba70158f60 2024-03-26T06:17:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.558+0000 7fba67e00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fba4c06bcd0 0x7fba4c06e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.559+0000 7fba67e00640 1 -- 172.21.15.63:0/95251129 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fba600ad010 con 0x7fba70158f60 2024-03-26T06:17:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.559+0000 7fba67e00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:6816/3622865395,v1:172.21.15.204:6817/3622865395] conn(0x7fba4c075450 0x7fba4c077890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.559+0000 7fba67e00640 1 -- 172.21.15.63:0/95251129 --> [v2:172.21.15.204:6816/3622865395,v1:172.21.15.204:6817/3622865395] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba6003ae50 con 0x7fba4c075450 2024-03-26T06:17:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.559+0000 7fba67e00640 1 -- 172.21.15.63:0/95251129 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba600ad400 con 0x7fba70158f60 2024-03-26T06:17:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.559+0000 7fba6fe00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fba4c06bcd0 0x7fba4c06e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.559+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 --> [v2:172.21.15.204:6820/2165493882,v1:172.21.15.204:6823/2165493882] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae18002dd0 con 0x7fae20075350 2024-03-26T06:17:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.560+0000 7fba6fe00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fba4c06bcd0 0x7fba4c06e190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba58005880 tx=0x7fba58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.561+0000 7fae36000640 1 -- 172.21.15.63:0/3195217040 <== osd.4 v2:172.21.15.204:6820/2165493882 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae18002dd0 con 0x7fae20075350 2024-03-26T06:17:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.561+0000 7f3a16000640 1 -- 172.21.15.63:0/801076509 <== osd.6 v2:172.21.15.204:6808/2062532645 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f39fc077eb0 con 0x7f39fc0753a0 2024-03-26T06:17:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.561+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:6820/2165493882,v1:172.21.15.204:6823/2165493882] conn(0x7fae20075350 msgr2=0x7fae20077790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.561+0000 7fae44a00640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:6820/2165493882,v1:172.21.15.204:6823/2165493882] conn(0x7fae20075350 0x7fae20077790 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.561+0000 7fba74e00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:6816/3622865395,v1:172.21.15.204:6817/3622865395] conn(0x7fba4c075450 0x7fba4c077890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.562+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fae2006bbd0 msgr2=0x7fae2006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.562+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 --> [v2:172.21.15.63:6816/2715082202,v1:172.21.15.63:6817/2715082202] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe900d1580 con 0x7efe70075410 2024-03-26T06:17:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.562+0000 7fae44a00640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fae2006bbd0 0x7fae2006e090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae30001eb0 tx=0x7fae30001b50 comp rx=0 tx=0).stop 2024-03-26T06:17:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.562+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4015bd50 msgr2=0x7fae401e54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.562+0000 7fae44a00640 1 --2- 172.21.15.63:0/3195217040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4015bd50 0x7fae401e54c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae400b6b20 tx=0x7fae3800f6d0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.562+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 --> [v2:172.21.15.63:6800/2347448899,v1:172.21.15.63:6801/2347448899] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f86280b3240 con 0x7f86080753a0 2024-03-26T06:17:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.562+0000 7efe87400640 1 -- 172.21.15.63:0/1916246048 <== osd.1 v2:172.21.15.63:6816/2715082202 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe900d1580 con 0x7efe70075410 2024-03-26T06:17:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.563+0000 7f861fe00640 1 -- 172.21.15.63:0/185016429 <== osd.0 v2:172.21.15.63:6800/2347448899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f86280b3240 con 0x7f86080753a0 2024-03-26T06:17:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.563+0000 7fae3e800640 1 -- 172.21.15.63:0/3195217040 reap_dead start 2024-03-26T06:17:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.563+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 shutdown_connections 2024-03-26T06:17:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.563+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 >> 172.21.15.63:0/3195217040 conn(0x7fae400b5540 msgr2=0x7fae4015ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.563+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 shutdown_connections 2024-03-26T06:17:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.563+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6800/2347448899,v1:172.21.15.63:6801/2347448899] conn(0x7f86080753a0 msgr2=0x7f86080777e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.563+0000 7f862f200640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6800/2347448899,v1:172.21.15.63:6801/2347448899] conn(0x7f86080753a0 0x7f86080777e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.563+0000 7fae44a00640 1 -- 172.21.15.63:0/3195217040 wait complete. 2024-03-26T06:17:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6816/2715082202,v1:172.21.15.63:6817/2715082202] conn(0x7efe70075410 msgr2=0x7efe70077850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7efe96200640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6816/2715082202,v1:172.21.15.63:6817/2715082202] conn(0x7efe70075410 0x7efe70077850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f860806bc20 msgr2=0x7f860806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7f862f200640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f860806bc20 0x7f860806e0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8618007b10 tx=0x7f8618007a60 comp rx=0 tx=0).stop 2024-03-26T06:17:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815df90 msgr2=0x7f862815e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7f862f200640 1 --2- 172.21.15.63:0/185016429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815df90 0x7f862815e410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8620033000 tx=0x7f8620004a40 comp rx=0 tx=0).stop 2024-03-26T06:17:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe7006bca0 msgr2=0x7efe7006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7f862d200640 1 -- 172.21.15.63:0/185016429 reap_dead start 2024-03-26T06:17:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7efe96200640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe7006bca0 0x7efe7006e160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe901f2c20 tx=0x7efe88003bb0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe740039b0 msgr2=0x7efe900cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7efe96200640 1 --2- 172.21.15.63:0/1916246048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe740039b0 0x7efe900cd3a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe80009a90 tx=0x7efe80004730 comp rx=0 tx=0).stop 2024-03-26T06:17:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 shutdown_connections 2024-03-26T06:17:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 >> 172.21.15.63:0/185016429 conn(0x7f86280b5540 msgr2=0x7f86280b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7efe8fe00640 1 -- 172.21.15.63:0/1916246048 reap_dead start 2024-03-26T06:17:24.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 shutdown_connections 2024-03-26T06:17:24.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.564+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 >> 172.21.15.63:0/1916246048 conn(0x7efe9006c2f0 msgr2=0x7efe90157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.565+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 shutdown_connections 2024-03-26T06:17:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.565+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 shutdown_connections 2024-03-26T06:17:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.565+0000 7efe96200640 1 -- 172.21.15.63:0/1916246048 wait complete. 2024-03-26T06:17:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.567+0000 7fba74e00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:6816/3622865395,v1:172.21.15.204:6817/3622865395] conn(0x7fba4c075450 0x7fba4c077890 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.567+0000 7f862f200640 1 -- 172.21.15.63:0/185016429 wait complete. 2024-03-26T06:17:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.567+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 --> [v2:172.21.15.63:6808/3026376468,v1:172.21.15.63:6809/3026376468] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6138002dd0 con 0x7f613c075500 2024-03-26T06:17:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.568+0000 7f614f400640 1 -- 172.21.15.63:0/1413822933 <== osd.2 v2:172.21.15.63:6808/3026376468 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6138002dd0 con 0x7f613c075500 2024-03-26T06:17:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.569+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6808/3026376468,v1:172.21.15.63:6809/3026376468] conn(0x7f613c075500 msgr2=0x7f613c077940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.569+0000 7f6162600640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6808/3026376468,v1:172.21.15.63:6809/3026376468] conn(0x7f613c075500 0x7f613c077940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.569+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f613c06be00 msgr2=0x7f613c06e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.569+0000 7f6162600640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f613c06be00 0x7f613c06e2c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6150007fd0 tx=0x7f6150012af0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.569+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61540509b0 msgr2=0x7f6154049710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.569+0000 7f6162600640 1 --2- 172.21.15.63:0/1413822933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61540509b0 0x7f6154049710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f615c02d400 tx=0x7f615c074400 comp rx=0 tx=0).stop 2024-03-26T06:17:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.570+0000 7f615be00640 1 -- 172.21.15.63:0/1413822933 reap_dead start 2024-03-26T06:17:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.570+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 --> [v2:172.21.15.63:6819/1727607660,v1:172.21.15.63:6821/1727607660] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe64002dd0 con 0x7efe6c075420 2024-03-26T06:17:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.570+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 shutdown_connections 2024-03-26T06:17:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.570+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 >> 172.21.15.63:0/1413822933 conn(0x7f6154055be0 msgr2=0x7f61540353d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.570+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 shutdown_connections 2024-03-26T06:17:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.570+0000 7f6162600640 1 -- 172.21.15.63:0/1413822933 wait complete. 2024-03-26T06:17:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.570+0000 7efe83e00640 1 -- 172.21.15.63:0/3261866697 <== osd.3 v2:172.21.15.63:6819/1727607660 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe64002dd0 con 0x7efe6c075420 2024-03-26T06:17:24.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.571+0000 7fba67e00640 1 -- 172.21.15.63:0/95251129 <== osd.7 v2:172.21.15.204:6816/3622865395 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fba6003ae50 con 0x7fba4c075450 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.571+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6819/1727607660,v1:172.21.15.63:6821/1727607660] conn(0x7efe6c075420 msgr2=0x7efe6c077860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.571+0000 7efe93200640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6819/1727607660,v1:172.21.15.63:6821/1727607660] conn(0x7efe6c075420 0x7efe6c077860 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.574+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe6c06bca0 msgr2=0x7efe6c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.574+0000 7efe93200640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7efe6c06bca0 0x7efe6c06e160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00a950 tx=0x7efe7c008040 comp rx=0 tx=0).stop 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.574+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe8c159d00 msgr2=0x7efe8c0af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.574+0000 7efe93200640 1 --2- 172.21.15.63:0/3261866697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe8c159d00 0x7efe8c0af9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efe84001560 tx=0x7efe8400cc70 comp rx=0 tx=0).stop 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.575+0000 7efe91200640 1 -- 172.21.15.63:0/3261866697 reap_dead start 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.575+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 shutdown_connections 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.575+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 >> 172.21.15.63:0/3261866697 conn(0x7efe8c06b0b0 msgr2=0x7efe8c155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.576+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 shutdown_connections 2024-03-26T06:17:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.576+0000 7efe93200640 1 -- 172.21.15.63:0/3261866697 wait complete. 2024-03-26T06:17:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.587+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 --> [v2:172.21.15.204:6800/2623219727,v1:172.21.15.204:6801/2623219727] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0124002dd0 con 0x7f012c075420 2024-03-26T06:17:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.589+0000 7f0142a00640 1 -- 172.21.15.63:0/3120737868 <== osd.5 v2:172.21.15.204:6800/2623219727 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0124002dd0 con 0x7f012c075420 2024-03-26T06:17:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.589+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:6800/2623219727,v1:172.21.15.204:6801/2623219727] conn(0x7f012c075420 msgr2=0x7f012c077860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.589+0000 7f0151c00640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:6800/2623219727,v1:172.21.15.204:6801/2623219727] conn(0x7f012c075420 0x7f012c077860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.590+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f012c06bca0 msgr2=0x7f012c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.590+0000 7f0151c00640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f012c06bca0 0x7f012c06e160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f014c1fb4c0 tx=0x7f0138008040 comp rx=0 tx=0).stop 2024-03-26T06:17:24.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.590+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f014c06f3e0 msgr2=0x7f014c158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.590+0000 7f0151c00640 1 --2- 172.21.15.63:0/3120737868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f014c06f3e0 0x7f014c158f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f013c00c430 tx=0x7f013c00c8f0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.618 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:24.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.590+0000 7f014b400640 1 -- 172.21.15.63:0/3120737868 reap_dead start 2024-03-26T06:17:24.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-26T06:17:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.591+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 shutdown_connections 2024-03-26T06:17:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.591+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 >> 172.21.15.63:0/3120737868 conn(0x7f014c06ac90 msgr2=0x7f014c0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.591+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 shutdown_connections 2024-03-26T06:17:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.591+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 --> [v2:172.21.15.204:6808/2062532645,v1:172.21.15.204:6809/2062532645] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a200b5300 con 0x7f39fc0753a0 2024-03-26T06:17:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.591+0000 7f0151c00640 1 -- 172.21.15.63:0/3120737868 wait complete. 2024-03-26T06:17:24.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.593+0000 7f3a16000640 1 -- 172.21.15.63:0/801076509 <== osd.6 v2:172.21.15.204:6808/2062532645 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a200b5300 con 0x7f39fc0753a0 2024-03-26T06:17:24.621 INFO:teuthology.orchestra.run.smithi063.stdout:55834574859 2024-03-26T06:17:24.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-26T06:17:24.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 >> [v2:172.21.15.204:6808/2062532645,v1:172.21.15.204:6809/2062532645] conn(0x7f39fc0753a0 msgr2=0x7f39fc0777e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a25000640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.204:6808/2062532645,v1:172.21.15.204:6809/2062532645] conn(0x7f39fc0753a0 0x7f39fc0777e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.622 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:24.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f39fc06bc20 msgr2=0x7f39fc06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a25000640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f39fc06bc20 0x7f39fc06e0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a080014f0 tx=0x7f3a08007990 comp rx=0 tx=0).stop 2024-03-26T06:17:24.623 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-26T06:17:24.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2015df90 msgr2=0x7f3a200cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a25000640 1 --2- 172.21.15.63:0/801076509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2015df90 0x7f3a200cbf00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009eb0 tx=0x7f3a18004a40 comp rx=0 tx=0).stop 2024-03-26T06:17:24.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a1e800640 1 -- 172.21.15.63:0/801076509 reap_dead start 2024-03-26T06:17:24.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 shutdown_connections 2024-03-26T06:17:24.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 >> 172.21.15.63:0/801076509 conn(0x7f3a200b5540 msgr2=0x7f3a200c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.594+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 shutdown_connections 2024-03-26T06:17:24.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.595+0000 7f3a25000640 1 -- 172.21.15.63:0/801076509 wait complete. 2024-03-26T06:17:24.625 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:24.626 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-26T06:17:24.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.601+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 --> [v2:172.21.15.204:6816/3622865395,v1:172.21.15.204:6817/3622865395] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba70163010 con 0x7fba4c075450 2024-03-26T06:17:24.627 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-03-26T06:17:24.627 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-26T06:17:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.602+0000 7fba67e00640 1 -- 172.21.15.63:0/95251129 <== osd.7 v2:172.21.15.204:6816/3622865395 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fba70163010 con 0x7fba4c075450 2024-03-26T06:17:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.602+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:6816/3622865395,v1:172.21.15.204:6817/3622865395] conn(0x7fba4c075450 msgr2=0x7fba4c077890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.602+0000 7fba76e00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:6816/3622865395,v1:172.21.15.204:6817/3622865395] conn(0x7fba4c075450 0x7fba4c077890 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.602+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fba4c06bcd0 msgr2=0x7fba4c06e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.602+0000 7fba76e00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fba4c06bcd0 0x7fba4c06e190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba58005880 tx=0x7fba58009040 comp rx=0 tx=0).stop 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.602+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba70158f60 msgr2=0x7fba701506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.602+0000 7fba76e00640 1 --2- 172.21.15.63:0/95251129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba70158f60 0x7fba701506d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba6002bed0 tx=0x7fba600046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.603+0000 7fba74e00640 1 -- 172.21.15.63:0/95251129 reap_dead start 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.603+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 shutdown_connections 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.603+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 >> 172.21.15.63:0/95251129 conn(0x7fba700cfa90 msgr2=0x7fba700cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.603+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 shutdown_connections 2024-03-26T06:17:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.603+0000 7fba76e00640 1 -- 172.21.15.63:0/95251129 wait complete. 2024-03-26T06:17:24.630 INFO:teuthology.orchestra.run.smithi063.stdout:55834574859 2024-03-26T06:17:24.630 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-26T06:17:24.631 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-03-26T06:17:24.631 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-26T06:17:24.632 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:24.632 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-26T06:17:24.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.963+0000 7f8d0dc00640 1 Processor -- start 2024-03-26T06:17:24.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.963+0000 7f8d0dc00640 1 -- start start 2024-03-26T06:17:24.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.966+0000 7f8d0dc00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d0815dbb0 0x7f8d080d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.967+0000 7f8d0dc00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080d2490 con 0x7f8d0815df90 2024-03-26T06:17:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.967+0000 7f8d0dc00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080d2770 con 0x7f8d080d0b30 2024-03-26T06:17:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.967+0000 7f8d0dc00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080d2a50 con 0x7f8d0815dbb0 2024-03-26T06:17:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.967+0000 7f8d06a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d0815dbb0 0x7f8d080d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.967+0000 7fdbca400640 1 Processor -- start 2024-03-26T06:17:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.967+0000 7f8d06a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d0815dbb0 0x7f8d080d1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49776/0 (socket says 172.21.15.63:49776) 2024-03-26T06:17:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.967+0000 7f8d06a00640 1 -- 172.21.15.63:0/1916239916 learned_addr learned my addr 172.21.15.63:0/1916239916 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.967+0000 7fdbca400640 1 -- start start 2024-03-26T06:17:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.968+0000 7f8d06a00640 1 -- 172.21.15.63:0/1916239916 >> v1:172.21.15.204:6789/0 conn(0x7f8d080d0b30 legacy=0x7f8d080b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.968+0000 7f8d06a00640 1 -- 172.21.15.63:0/1916239916 >> v1:172.21.15.63:6789/0 conn(0x7f8d0815df90 legacy=0x7f8d080d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.969+0000 7f8d06a00640 1 -- 172.21.15.63:0/1916239916 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d080d2d30 con 0x7f8d0815dbb0 2024-03-26T06:17:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.969+0000 7fdbca400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdbc415dbb0 0x7fdbc40d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.970+0000 7fdbca400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbc40d0b30 0x7fdbc40b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.970+0000 7fdbca400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc40d2490 con 0x7fdbc415df90 2024-03-26T06:17:24.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.970+0000 7fdbca400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc40d2770 con 0x7fdbc415dbb0 2024-03-26T06:17:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.970+0000 7fdbca400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40d2a50 con 0x7fdbc40d0b30 2024-03-26T06:17:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.970+0000 7fdbc3400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdbc415dbb0 0x7fdbc40d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.970+0000 7fdbbaa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdbc415df90 0x7fdbc40d0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43888/0 (socket says 172.21.15.63:43888) 2024-03-26T06:17:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.970+0000 7fdbbaa00640 1 -- 172.21.15.63:0/4022168628 learned_addr learned my addr 172.21.15.63:0/4022168628 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.971+0000 7fdbc3e00640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbc40d0b30 0x7fdbc40b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.971+0000 7f8d06a00640 1 --2- 172.21.15.63:0/1916239916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 0x7f8d080d1bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009870 tx=0x7f8cf802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2fb6066ff35350 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.971+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831666306 0 0) 0x7fdbc40d2490 con 0x7fdbc415df90 2024-03-26T06:17:24.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.971+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba8003520 con 0x7fdbc415df90 2024-03-26T06:17:24.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 904063014 0 0) 0x7fdba8003520 con 0x7fdbc415df90 2024-03-26T06:17:24.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7f8d05600640 1 -- 172.21.15.63:0/1916239916 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf802f840 con 0x7f8d0815dbb0 2024-03-26T06:17:24.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbc40d0b30 msgr2=0x7fdbc40b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbc40d0b30 0x7fdbc40b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 >> v2:172.21.15.204:3300/0 conn(0x7fdbc415dbb0 msgr2=0x7fdbc40d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 --2- 172.21.15.63:0/4022168628 >> v2:172.21.15.204:3300/0 conn(0x7fdbc415dbb0 0x7fdbc40d1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc40d2d30 con 0x7fdbc415df90 2024-03-26T06:17:24.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fdbac001650 con 0x7fdbc415df90 2024-03-26T06:17:24.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.973+0000 7f8d05600640 1 -- 172.21.15.63:0/1916239916 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf802f9e0 con 0x7f8d0815dbb0 2024-03-26T06:17:24.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.973+0000 7f8d05600640 1 -- 172.21.15.63:0/1916239916 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf802fdb0 con 0x7f8d0815dbb0 2024-03-26T06:17:24.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 >> v1:172.21.15.63:6789/0 conn(0x7fdbc415df90 legacy=0x7fdbc40d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdba80039b0 0x7fdba8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.973+0000 7fda3ac00640 1 Processor -- start 2024-03-26T06:17:24.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.973+0000 7fda3ac00640 1 -- start start 2024-03-26T06:17:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdba8004800 0x7fdba8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbc40d0b30 0x7fdba80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40d2770 con 0x7fdba80039b0 2024-03-26T06:17:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40d2a50 con 0x7fdba8004800 2024-03-26T06:17:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.972+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba800ba80 con 0x7fdbc40d0b30 2024-03-26T06:17:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.973+0000 7fdbbaa00640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdba8004800 0x7fdba8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.973+0000 7fdbc3400640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdba80039b0 0x7fdba8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.974+0000 7fdbc3e00640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbc40d0b30 0x7fdba80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.975+0000 7fda3ac00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.975+0000 7fda3ac00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fda2c053c70 0x7fda2c0df220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.975+0000 7fda3ac00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0df760 con 0x7fda2c033ef0 2024-03-26T06:17:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.975+0000 7fda3ac00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c0544c0 con 0x7fda2c053c70 2024-03-26T06:17:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.975+0000 7fda3ac00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0541e0 con 0x7fda2c00c0a0 2024-03-26T06:17:24.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.974+0000 7fdbc3400640 1 -- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbc40d0b30 msgr2=0x7fdba80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.974+0000 7fdbc3400640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbc40d0b30 0x7fdba80051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.974+0000 7fdbc3400640 1 -- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdba8004800 msgr2=0x7fdba8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.974+0000 7fdbc3400640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdba8004800 0x7fdba8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.974+0000 7fdbc3400640 1 -- 172.21.15.63:0/4022168628 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba8003520 con 0x7fdba80039b0 2024-03-26T06:17:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.975+0000 7fda33e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.975+0000 7f8d0dc00640 1 -- 172.21.15.63:0/1916239916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 msgr2=0x7f8d080d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.975+0000 7f8d0dc00640 1 --2- 172.21.15.63:0/1916239916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 0x7f8d080d1bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009870 tx=0x7f8cf802ba20 comp rx=0 tx=0).stop 2024-03-26T06:17:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.976+0000 7f8d0dc00640 1 -- 172.21.15.63:0/1916239916 shutdown_connections 2024-03-26T06:17:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.976+0000 7f8d0dc00640 1 --2- 172.21.15.63:0/1916239916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 0x7f8d080d1bb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.976+0000 7f8d0dc00640 1 -- 172.21.15.63:0/1916239916 >> 172.21.15.63:0/1916239916 conn(0x7f8d080b5540 msgr2=0x7f8d080b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.975+0000 7fda33e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c038080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47796/0 (socket says 172.21.15.63:47796) 2024-03-26T06:17:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.976+0000 7fda33e00640 1 -- 172.21.15.63:0/322921369 learned_addr learned my addr 172.21.15.63:0/322921369 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.976+0000 7fda33400640 1 --2- 172.21.15.63:0/322921369 >> v2:172.21.15.204:3300/0 conn(0x7fda2c053c70 0x7fda2c0df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.976+0000 7f8d0dc00640 1 -- 172.21.15.63:0/1916239916 shutdown_connections 2024-03-26T06:17:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.977+0000 7f8d0dc00640 1 -- 172.21.15.63:0/1916239916 wait complete. 2024-03-26T06:17:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.977+0000 7fda33400640 1 -- 172.21.15.63:0/322921369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 msgr2=0x7fda2c038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.977+0000 7fda33400640 1 --2- 172.21.15.63:0/322921369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c038080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.977+0000 7fda33400640 1 -- 172.21.15.63:0/322921369 >> v1:172.21.15.204:6789/0 conn(0x7fda2c033ef0 legacy=0x7fda2c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.977+0000 7fda33400640 1 -- 172.21.15.63:0/322921369 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c005f30 con 0x7fda2c053c70 2024-03-26T06:17:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.977+0000 7fe498a00640 1 Processor -- start 2024-03-26T06:17:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.977+0000 7fe498a00640 1 -- start start 2024-03-26T06:17:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.977+0000 7fdbc3400640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdba80039b0 0x7fdba8003dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400e3a0 tx=0x7fdba8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7fe9564762cf7e server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.978+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4009c10 con 0x7fdba80039b0 2024-03-26T06:17:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.978+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb40366b0 con 0x7fdba80039b0 2024-03-26T06:17:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.979+0000 7fdbc2a00640 1 -- 172.21.15.63:0/4022168628 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4036aa0 con 0x7fdba80039b0 2024-03-26T06:17:24.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.979+0000 7fda33400640 1 --2- 172.21.15.63:0/322921369 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda2c053c70 0x7fda2c0df220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda34064a50 tx=0x7fda340a8bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5520b220d69bbe75 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.979+0000 7fdbca400640 1 -- 172.21.15.63:0/4022168628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdba80039b0 msgr2=0x7fdba8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.979+0000 7fdbca400640 1 --2- 172.21.15.63:0/4022168628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdba80039b0 0x7fdba8003dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400e3a0 tx=0x7fdba8005830 comp rx=0 tx=0).stop 2024-03-26T06:17:24.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.979+0000 7fda32a00640 1 -- 172.21.15.63:0/322921369 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda340b6070 con 0x7fda2c053c70 2024-03-26T06:17:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.980+0000 7fdbc3e00640 1 -- 172.21.15.63:0/4022168628 reap_dead start 2024-03-26T06:17:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.980+0000 7fda32a00640 1 -- 172.21.15.63:0/322921369 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda340a9a20 con 0x7fda2c053c70 2024-03-26T06:17:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.980+0000 7fdbca400640 1 -- 172.21.15.63:0/4022168628 shutdown_connections 2024-03-26T06:17:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.980+0000 7fdbca400640 1 -- 172.21.15.63:0/4022168628 >> 172.21.15.63:0/4022168628 conn(0x7fdbc40b5540 msgr2=0x7fdbc40b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.979+0000 7fe498a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe4940cd040 0x7fe4940cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.979+0000 7fe498a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940ce440 con 0x7fe4940cc8a0 2024-03-26T06:17:24.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.979+0000 7fe498a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940cd740 con 0x7fe4940cc060 2024-03-26T06:17:24.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.979+0000 7fe498a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4940cd4f0 con 0x7fe4940cd040 2024-03-26T06:17:24.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.980+0000 7fdbca400640 1 -- 172.21.15.63:0/4022168628 shutdown_connections 2024-03-26T06:17:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.980+0000 7fda32a00640 1 -- 172.21.15.63:0/322921369 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda340b6070 con 0x7fda2c053c70 2024-03-26T06:17:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.980+0000 7f8d0dc00640 1 Processor -- start 2024-03-26T06:17:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.981+0000 7fe491400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe4940cc8a0 0x7fe4940cad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43894/0 (socket says 172.21.15.63:43894) 2024-03-26T06:17:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.981+0000 7fe491400640 1 -- 172.21.15.63:0/2905114780 learned_addr learned my addr 172.21.15.63:0/2905114780 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.981+0000 7fe492800640 1 --2- 172.21.15.63:0/2905114780 >> v2:172.21.15.204:3300/0 conn(0x7fe4940cd040 0x7fe4940cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.981+0000 7fd385a00640 1 Processor -- start 2024-03-26T06:17:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.981+0000 7fe490a00640 1 -- 172.21.15.63:0/2905114780 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026187179 0 0) 0x7fe4940cd740 con 0x7fe4940cc060 2024-03-26T06:17:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7fe490a00640 1 -- 172.21.15.63:0/2905114780 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe478003520 con 0x7fe4940cc060 2024-03-26T06:17:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.981+0000 7fda3ac00640 1 -- 172.21.15.63:0/322921369 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda2c053c70 msgr2=0x7fda2c0df220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.981+0000 7fda3ac00640 1 --2- 172.21.15.63:0/322921369 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda2c053c70 0x7fda2c0df220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda34064a50 tx=0x7fda340a8bb0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7fe490a00640 1 -- 172.21.15.63:0/2905114780 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746453189 0 0) 0x7fe4940ce440 con 0x7fe4940cc8a0 2024-03-26T06:17:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7fe490a00640 1 -- 172.21.15.63:0/2905114780 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4940cd740 con 0x7fe4940cc8a0 2024-03-26T06:17:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7fe492800640 1 -- 172.21.15.63:0/2905114780 >> v1:172.21.15.204:6789/0 conn(0x7fe4940cc060 legacy=0x7fe49406b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7fe492800640 1 -- 172.21.15.63:0/2905114780 >> v1:172.21.15.63:6789/0 conn(0x7fe4940cc8a0 legacy=0x7fe4940cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.981+0000 7f8d0dc00640 1 -- start start 2024-03-26T06:17:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7f8d0dc00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d080d0b30 0x7f8d0815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7f8d0dc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 0x7f8d08070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7f8d0dc00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d0815df90 0x7f8d081fb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7f8d0dc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080d36b0 con 0x7f8d0815dbb0 2024-03-26T06:17:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7f8d0dc00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080d3530 con 0x7f8d0815df90 2024-03-26T06:17:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7fe492800640 1 -- 172.21.15.63:0/2905114780 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940cda20 con 0x7fe4940cd040 2024-03-26T06:17:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.982+0000 7f8d0dc00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080b96e0 con 0x7f8d080d0b30 2024-03-26T06:17:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7f8d06000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 0x7f8d08070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7f8d06000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 0x7f8d08070bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49788/0 (socket says 172.21.15.63:49788) 2024-03-26T06:17:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7f8d06000640 1 -- 172.21.15.63:0/3384670855 learned_addr learned my addr 172.21.15.63:0/3384670855 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fda3ac00640 1 -- 172.21.15.63:0/322921369 shutdown_connections 2024-03-26T06:17:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fda3ac00640 1 --2- 172.21.15.63:0/322921369 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda2c053c70 0x7fda2c0df220 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fda3ac00640 1 --2- 172.21.15.63:0/322921369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c038080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fda3ac00640 1 -- 172.21.15.63:0/322921369 >> 172.21.15.63:0/322921369 conn(0x7fda2c009fb0 msgr2=0x7fda2c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.981+0000 7fd385a00640 1 -- start start 2024-03-26T06:17:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fd385a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3800cfb40 0x7fd3800b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fd385a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3800b3630 0x7fd380165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fd385a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3801633c0 con 0x7fd3800aeb80 2024-03-26T06:17:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fd385a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3800b3aa0 con 0x7fd3800cfb40 2024-03-26T06:17:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fd385a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800cffd0 con 0x7fd3800b3630 2024-03-26T06:17:24.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fda3ac00640 1 -- 172.21.15.63:0/322921369 shutdown_connections 2024-03-26T06:17:24.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7f8d06a00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d080d0b30 0x7f8d0815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7fda3ac00640 1 -- 172.21.15.63:0/322921369 wait complete. 2024-03-26T06:17:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7f8d07400640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d0815df90 0x7f8d081fb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7f1b63400640 1 Processor -- start 2024-03-26T06:17:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7fd37e000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3800cfb40 0x7fd3800b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7fd37ea00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd3800aeb80 0x7fd38006de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43904/0 (socket says 172.21.15.63:43904) 2024-03-26T06:17:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7fd37ea00640 1 -- 172.21.15.63:0/1481045767 learned_addr learned my addr 172.21.15.63:0/1481045767 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7fd37f400640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3800b3630 0x7fd380165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7f8d06a00640 1 -- 172.21.15.63:0/3384670855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d0815df90 msgr2=0x7f8d081fb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7f8d06a00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d0815df90 0x7f8d081fb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7f8d06a00640 1 -- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 msgr2=0x7f8d08070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7f8d06a00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 0x7f8d08070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7f8d06a00640 1 -- 172.21.15.63:0/3384670855 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08071570 con 0x7f8d080d0b30 2024-03-26T06:17:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7fe492800640 1 --2- 172.21.15.63:0/2905114780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4940cd040 0x7fe4940cfa30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009d90 tx=0x7fe48c02bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65881489fbdc09e server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160010264 0 0) 0x7fd3801633c0 con 0x7fd3800aeb80 2024-03-26T06:17:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd364003520 con 0x7fd3800aeb80 2024-03-26T06:17:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7f8d06000640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 0x7f8d08070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:17:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7fe490a00640 1 -- 172.21.15.63:0/2905114780 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c039070 con 0x7fe4940cd040 2024-03-26T06:17:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7fe490a00640 1 -- 172.21.15.63:0/2905114780 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c02ccf0 con 0x7fe4940cd040 2024-03-26T06:17:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7fe490a00640 1 -- 172.21.15.63:0/2905114780 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c034660 con 0x7fe4940cd040 2024-03-26T06:17:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7f8d06a00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d080d0b30 0x7f8d0815a350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8d0806c2c0 tx=0x7f8cf8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3657365284 0 0) 0x7fd364003520 con 0x7fd3800aeb80 2024-03-26T06:17:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3800b3630 msgr2=0x7fd380165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.985+0000 7fd37d600640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3800b3630 0x7fd380165dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 >> v2:172.21.15.63:3300/0 conn(0x7fd3800cfb40 msgr2=0x7fd3800b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 --2- 172.21.15.63:0/1481045767 >> v2:172.21.15.63:3300/0 conn(0x7fd3800cfb40 0x7fd3800b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380162840 con 0x7fd3800aeb80 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fd370001670 con 0x7fd3800aeb80 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 >> v1:172.21.15.63:6789/0 conn(0x7fd3800aeb80 legacy=0x7fd38006de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640039b0 0x7fd364003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd364004800 0x7fd364004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3640051c0 0x7fd36400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800b3aa0 con 0x7fd3640051c0 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800cffd0 con 0x7fd364004800 2024-03-26T06:17:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36400c0e0 con 0x7fd3640039b0 2024-03-26T06:17:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fe498a00640 1 -- 172.21.15.63:0/2905114780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4940cd040 msgr2=0x7fe4940cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fe498a00640 1 --2- 172.21.15.63:0/2905114780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4940cd040 0x7fe4940cfa30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009d90 tx=0x7fe48c02bf40 comp rx=0 tx=0).stop 2024-03-26T06:17:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fe498a00640 1 -- 172.21.15.63:0/2905114780 shutdown_connections 2024-03-26T06:17:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fe498a00640 1 --2- 172.21.15.63:0/2905114780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4940cd040 0x7fe4940cfa30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fe498a00640 1 -- 172.21.15.63:0/2905114780 >> 172.21.15.63:0/2905114780 conn(0x7fe4940b2250 msgr2=0x7fe4940b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7f8cfea00640 1 -- 172.21.15.63:0/3384670855 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf802f800 con 0x7f8d080d0b30 2024-03-26T06:17:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7f8cfea00640 1 -- 172.21.15.63:0/3384670855 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf8046070 con 0x7f8d080d0b30 2024-03-26T06:17:24.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7f8cfea00640 1 -- 172.21.15.63:0/3384670855 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8041640 con 0x7f8d080d0b30 2024-03-26T06:17:24.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.980+0000 7fdbca400640 1 -- 172.21.15.63:0/4022168628 wait complete. 2024-03-26T06:17:24.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fdbca400640 1 Processor -- start 2024-03-26T06:17:24.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.983+0000 7fdbca400640 1 -- start start 2024-03-26T06:17:24.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7fd37f400640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3640051c0 0x7fd36400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7fd37e000640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd364004800 0x7fd364004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fdbca400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdba80039b0 0x7fdbc4160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fdbca400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40cf960 0x7fdbc40c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fdbca400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbc4154240 0x7fdbc41546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fdbca400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40d36b0 con 0x7fdbc40cf960 2024-03-26T06:17:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fdbca400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40d3530 con 0x7fdbc4154240 2024-03-26T06:17:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fdbca400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40b96e0 con 0x7fdba80039b0 2024-03-26T06:17:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7fdbc3400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdba80039b0 0x7fdbc4160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7fdbc3400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdba80039b0 0x7fdbc4160f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47824/0 (socket says 172.21.15.63:47824) 2024-03-26T06:17:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7fdbc3400640 1 -- 172.21.15.63:0/2180621214 learned_addr learned my addr 172.21.15.63:0/2180621214 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d08071850 con 0x7f8d080d0b30 2024-03-26T06:17:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d08071e10 con 0x7f8d080d0b30 2024-03-26T06:17:25.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7fd37ea00640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640039b0 0x7fd364003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7fdbc3e00640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbc4154240 0x7fdbc41546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7fda3ac00640 1 Processor -- start 2024-03-26T06:17:25.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fda3ac00640 1 -- start start 2024-03-26T06:17:25.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.984+0000 7f1b63400640 1 -- start start 2024-03-26T06:17:25.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.986+0000 7f1b63400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 0x7f1b5c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7f1b63400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1b5c0b3800 0x7f1b5c165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fe498a00640 1 -- 172.21.15.63:0/2905114780 shutdown_connections 2024-03-26T06:17:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7f1b63400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5c1633c0 con 0x7f1b5c06de00 2024-03-26T06:17:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7f1b63400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5c162840 con 0x7f1b5c0b3800 2024-03-26T06:17:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.987+0000 7f1b63400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c162b20 con 0x7f1b5c0aeb80 2024-03-26T06:17:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7f1b60a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 0x7f1b5c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7f1b61400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1b5c0b3800 0x7f1b5c165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7f1b60a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 0x7f1b5c0cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47842/0 (socket says 172.21.15.63:47842) 2024-03-26T06:17:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7f1b60a00640 1 -- 172.21.15.63:0/62991608 learned_addr learned my addr 172.21.15.63:0/62991608 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7f1b5be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1b5c06de00 0x7f1b5c0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43912/0 (socket says 172.21.15.63:43912) 2024-03-26T06:17:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fd37f400640 1 -- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640039b0 msgr2=0x7fd364003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fd37f400640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640039b0 0x7fd364003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fd37f400640 1 -- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd364004800 msgr2=0x7fd364004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fd37f400640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd364004800 0x7fd364004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fd37f400640 1 -- 172.21.15.63:0/1481045767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380162840 con 0x7fd3640051c0 2024-03-26T06:17:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fe498a00640 1 -- 172.21.15.63:0/2905114780 wait complete. 2024-03-26T06:17:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fdbbaa00640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40cf960 0x7fdbc40c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fdbc3400640 1 -- 172.21.15.63:0/2180621214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbc4154240 msgr2=0x7fdbc41546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fdbc3400640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbc4154240 0x7fdbc41546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fdbc3400640 1 -- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40cf960 msgr2=0x7fdbc40c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fdbc3400640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40cf960 0x7fdbc40c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fdbc3400640 1 -- 172.21.15.63:0/2180621214 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc40c8110 con 0x7fdba80039b0 2024-03-26T06:17:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.988+0000 7fdbbaa00640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40cf960 0x7fdbc40c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7fda3ac00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c04c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7fda3ac00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda2c033ef0 0x7fda2c04d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7fda3ac00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda2c053c70 0x7fda2c0d6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7fda3ac00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c037910 con 0x7fda2c033ef0 2024-03-26T06:17:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7fda3ac00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0064f0 con 0x7fda2c053c70 2024-03-26T06:17:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7fda3ac00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c037a90 con 0x7fda2c00c0a0 2024-03-26T06:17:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7fee83200640 1 Processor -- start 2024-03-26T06:17:25.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7fee83200640 1 -- start start 2024-03-26T06:17:25.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.990+0000 7fda33e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c04c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.990+0000 7fdbc3400640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdba80039b0 0x7fdbc4160f60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400e4c0 tx=0x7fdbb4009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.990+0000 7fda33400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda2c033ef0 0x7fda2c04d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.990+0000 7fda33e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c04c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47844/0 (socket says 172.21.15.63:47844) 2024-03-26T06:17:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.990+0000 7fda33e00640 1 -- 172.21.15.63:0/572214881 learned_addr learned my addr 172.21.15.63:0/572214881 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.990+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d08072150 con 0x7f8d080d0b30 2024-03-26T06:17:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7f1b61400640 1 -- 172.21.15.63:0/62991608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 msgr2=0x7f1b5c0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7f1b61400640 1 --2- 172.21.15.63:0/62991608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 0x7f1b5c0cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7f1b61400640 1 -- 172.21.15.63:0/62991608 >> v1:172.21.15.63:6789/0 conn(0x7f1b5c06de00 legacy=0x7f1b5c0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.989+0000 7f1b61400640 1 -- 172.21.15.63:0/62991608 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c162e00 con 0x7f1b5c0b3800 2024-03-26T06:17:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fda38c00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda2c053c70 0x7fda2c0d6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fe498a00640 1 Processor -- start 2024-03-26T06:17:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fe498a00640 1 -- start start 2024-03-26T06:17:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fdbbbe00640 1 -- 172.21.15.63:0/2180621214 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4017440 con 0x7fdba80039b0 2024-03-26T06:17:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fda33400640 1 -- 172.21.15.63:0/572214881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 msgr2=0x7fda2c04c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fda33400640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c04c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fda33400640 1 -- 172.21.15.63:0/572214881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda2c053c70 msgr2=0x7fda2c0d6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fda33400640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda2c053c70 0x7fda2c0d6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fda33400640 1 -- 172.21.15.63:0/572214881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c04dc90 con 0x7fda2c033ef0 2024-03-26T06:17:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fd37f400640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3640051c0 0x7fd36400b9c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3800b3a10 tx=0x7fd364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8120b8f912523b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fee83200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fee7c161fa0 0x7fee7c0afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7f8cfea00640 1 -- 172.21.15.63:0/3384670855 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8cf8040070 con 0x7f8d080d0b30 2024-03-26T06:17:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fee83200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378039070 con 0x7fd3640051c0 2024-03-26T06:17:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc4154ef0 con 0x7fdba80039b0 2024-03-26T06:17:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc4154c00 con 0x7fdba80039b0 2024-03-26T06:17:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7f1b61400640 1 --2- 172.21.15.63:0/62991608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0b3800 0x7f1b5c165dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0097a0 tx=0x7f1b4c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c266ac71bbef4534 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7fd37d600640 1 -- 172.21.15.63:0/1481045767 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37802cb90 con 0x7fd3640051c0 2024-03-26T06:17:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7fdbbbe00640 1 -- 172.21.15.63:0/2180621214 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb40175e0 con 0x7fdba80039b0 2024-03-26T06:17:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7fdbbbe00640 1 -- 172.21.15.63:0/2180621214 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4003990 con 0x7fdba80039b0 2024-03-26T06:17:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fee83200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c0b2e90 con 0x7fee7c162380 2024-03-26T06:17:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fee83200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c06fef0 con 0x7fee7c161fa0 2024-03-26T06:17:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.991+0000 7fee83200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0b2bb0 con 0x7fee7c06e800 2024-03-26T06:17:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7fee81200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7fee7b400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fee7c162380 0x7fee7c0cfa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43916/0 (socket says 172.21.15.63:43916) 2024-03-26T06:17:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7fee7b400640 1 -- 172.21.15.63:0/3408188628 learned_addr learned my addr 172.21.15.63:0/3408188628 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.992+0000 7fee81200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47854/0 (socket says 172.21.15.63:47854) 2024-03-26T06:17:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fe498a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4940cc060 0x7fe4940cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fda33400640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda2c033ef0 0x7fda2c04d750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fda34075a00 tx=0x7fda34068a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fe498a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4940cc8a0 0x7fe4940af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fe498a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4940cd040 0x7fe4940af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fe498a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940cc440 con 0x7fe4940cd040 2024-03-26T06:17:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fe498a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49406ae30 con 0x7fe4940cc8a0 2024-03-26T06:17:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fe498a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49406ba60 con 0x7fe4940cc060 2024-03-26T06:17:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fd385a00640 1 -- 172.21.15.63:0/1481045767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3640051c0 msgr2=0x7fd36400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fd385a00640 1 --2- 172.21.15.63:0/1481045767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3640051c0 0x7fd36400b9c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3800b3a10 tx=0x7fd364005830 comp rx=0 tx=0).stop 2024-03-26T06:17:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7f1b5b400640 1 -- 172.21.15.63:0/62991608 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c038070 con 0x7f1b5c0b3800 2024-03-26T06:17:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fd37f400640 1 -- 172.21.15.63:0/1481045767 reap_dead start 2024-03-26T06:17:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7f1b5b400640 1 -- 172.21.15.63:0/62991608 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c031710 con 0x7f1b5c0b3800 2024-03-26T06:17:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fd385a00640 1 -- 172.21.15.63:0/1481045767 shutdown_connections 2024-03-26T06:17:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fd385a00640 1 -- 172.21.15.63:0/1481045767 >> 172.21.15.63:0/1481045767 conn(0x7fd38006ac90 msgr2=0x7fd38006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fd385a00640 1 -- 172.21.15.63:0/1481045767 shutdown_connections 2024-03-26T06:17:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fd385a00640 1 -- 172.21.15.63:0/1481045767 wait complete. 2024-03-26T06:17:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe492800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4940cd040 0x7fe4940af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe491400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4940cc8a0 0x7fe4940af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe492800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4940cd040 0x7fe4940af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49872/0 (socket says 172.21.15.63:49872) 2024-03-26T06:17:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe492800640 1 -- 172.21.15.63:0/2241531689 learned_addr learned my addr 172.21.15.63:0/2241531689 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe491e00640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4940cc060 0x7fe4940cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7f8cfea00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ce806bc20 0x7f8ce806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc4074730 con 0x7fdba80039b0 2024-03-26T06:17:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fda27e00640 1 -- 172.21.15.63:0/572214881 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda340c1070 con 0x7fda2c033ef0 2024-03-26T06:17:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7fda27e00640 1 -- 172.21.15.63:0/572214881 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda340b8050 con 0x7fda2c033ef0 2024-03-26T06:17:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7fda27e00640 1 -- 172.21.15.63:0/572214881 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda340b6030 con 0x7fda2c033ef0 2024-03-26T06:17:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe492800640 1 -- 172.21.15.63:0/2241531689 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4940cc060 msgr2=0x7fe4940cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe492800640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4940cc060 0x7fe4940cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe492800640 1 -- 172.21.15.63:0/2241531689 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4940cc8a0 msgr2=0x7fe4940af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe492800640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4940cc8a0 0x7fe4940af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7fe492800640 1 -- 172.21.15.63:0/2241531689 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940cb6c0 con 0x7fe4940cd040 2024-03-26T06:17:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c048720 con 0x7fda2c033ef0 2024-03-26T06:17:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c048ce0 con 0x7fda2c033ef0 2024-03-26T06:17:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.996+0000 7fe492800640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4940cd040 0x7fe4940af7b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe48c02c550 tx=0x7fe48c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7f1b5b400640 1 -- 172.21.15.63:0/62991608 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c031b20 con 0x7f1b5c0b3800 2024-03-26T06:17:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7f8cfea00640 1 -- 172.21.15.63:0/3384670855 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8cf80ad460 con 0x7f8d080d0b30 2024-03-26T06:17:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.996+0000 7f8d06000640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ce806bc20 0x7f8ce806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7f1b63400640 1 -- 172.21.15.63:0/62991608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0b3800 msgr2=0x7f1b5c165dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.994+0000 7f1b63400640 1 --2- 172.21.15.63:0/62991608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0b3800 0x7f1b5c165dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0097a0 tx=0x7f1b4c02b7b0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.993+0000 7fee7be00640 1 --2- 172.21.15.63:0/3408188628 >> v2:172.21.15.204:3300/0 conn(0x7fee7c161fa0 0x7fee7c0afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7fee81200640 1 -- 172.21.15.63:0/3408188628 >> v2:172.21.15.204:3300/0 conn(0x7fee7c161fa0 msgr2=0x7fee7c0afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7fee81200640 1 --2- 172.21.15.63:0/3408188628 >> v2:172.21.15.204:3300/0 conn(0x7fee7c161fa0 0x7fee7c0afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7fee81200640 1 -- 172.21.15.63:0/3408188628 >> v1:172.21.15.63:6789/0 conn(0x7fee7c162380 legacy=0x7fee7c0cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.995+0000 7fee81200640 1 -- 172.21.15.63:0/3408188628 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0cefa0 con 0x7fee7c06e800 2024-03-26T06:17:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.996+0000 7f5f04e00640 1 Processor -- start 2024-03-26T06:17:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.996+0000 7fee7be00640 1 --2- 172.21.15.63:0/3408188628 >> v2:172.21.15.204:3300/0 conn(0x7fee7c161fa0 0x7fee7c0afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.996+0000 7fd385a00640 1 Processor -- start 2024-03-26T06:17:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.996+0000 7fdbbbe00640 1 -- 172.21.15.63:0/2180621214 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fdbb4005d10 con 0x7fdba80039b0 2024-03-26T06:17:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7f1b63400640 1 -- 172.21.15.63:0/62991608 shutdown_connections 2024-03-26T06:17:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7fee81200640 1 --2- 172.21.15.63:0/3408188628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c36e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fee74009d90 tx=0x7fee7402bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7198423d3fea5b0b server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7f1b63400640 1 --2- 172.21.15.63:0/62991608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0b3800 0x7f1b5c165dc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7f1b63400640 1 --2- 172.21.15.63:0/62991608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 0x7f1b5c0cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7f1b63400640 1 -- 172.21.15.63:0/62991608 >> 172.21.15.63:0/62991608 conn(0x7f1b5c06ac90 msgr2=0x7f1b5c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7fd385a00640 1 -- start start 2024-03-26T06:17:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7fe48a000640 1 -- 172.21.15.63:0/2241531689 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c044020 con 0x7fe4940cd040 2024-03-26T06:17:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7fe48a000640 1 -- 172.21.15.63:0/2241531689 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c035e50 con 0x7fe4940cd040 2024-03-26T06:17:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49414e580 con 0x7fe4940cd040 2024-03-26T06:17:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7f1b63400640 1 -- 172.21.15.63:0/62991608 shutdown_connections 2024-03-26T06:17:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.996+0000 7f5f04e00640 1 -- start start 2024-03-26T06:17:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fd385a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640051c0 0x7fd3800cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7f8d06000640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ce806bc20 0x7f8ce806e0e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d080ce6e0 tx=0x7f8cf4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.997+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4941f6e50 con 0x7fe4940cd040 2024-03-26T06:17:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fd385a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd38015b570 0x7fd380159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fe48a000640 1 -- 172.21.15.63:0/2241531689 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c039040 con 0x7fe4940cd040 2024-03-26T06:17:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fd37ea00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640051c0 0x7fd3800cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fd385a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd380148870 0x7fd38015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fd385a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801630e0 con 0x7fd38015b570 2024-03-26T06:17:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fd385a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380162e00 con 0x7fd380148870 2024-03-26T06:17:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fd385a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800aef60 con 0x7fd3640051c0 2024-03-26T06:17:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.999+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c005390 con 0x7fda2c033ef0 2024-03-26T06:17:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.999+0000 7fd37e000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd38015b570 0x7fd380159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.999+0000 7fd37ea00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640051c0 0x7fd3800cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47874/0 (socket says 172.21.15.63:47874) 2024-03-26T06:17:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.999+0000 7fd37ea00640 1 -- 172.21.15.63:0/914813395 learned_addr learned my addr 172.21.15.63:0/914813395 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.999+0000 7f5f04e00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5f000aeb80 0x7f5f000cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.999+0000 7f5f04e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f001633c0 con 0x7f5f0006de00 2024-03-26T06:17:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.999+0000 7f5f04e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f00162840 con 0x7f5f000b3800 2024-03-26T06:17:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.999+0000 7f5f04e00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f00162b20 con 0x7f5f000aeb80 2024-03-26T06:17:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fdbbbe00640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdba006bc00 0x7fdba006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7fdbbbe00640 1 -- 172.21.15.63:0/2180621214 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdbb40ad7c0 con 0x7fdba80039b0 2024-03-26T06:17:25.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.999+0000 7fd37f400640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd380148870 0x7fd38015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:24.998+0000 7f1b63400640 1 -- 172.21.15.63:0/62991608 wait complete. 2024-03-26T06:17:25.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7f5efd400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5f0006de00 0x7f5f000b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43930/0 (socket says 172.21.15.63:43930) 2024-03-26T06:17:25.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7f5efd400640 1 -- 172.21.15.63:0/3415424165 learned_addr learned my addr 172.21.15.63:0/3415424165 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:25.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7f5efde00640 1 --2- 172.21.15.63:0/3415424165 >> v2:172.21.15.204:3300/0 conn(0x7f5f000aeb80 0x7f5f000cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7fd37ea00640 1 -- 172.21.15.63:0/914813395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd380148870 msgr2=0x7fd38015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7fd37ea00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd380148870 0x7fd38015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7f1b63400640 1 Processor -- start 2024-03-26T06:17:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7fd37ea00640 1 -- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd38015b570 msgr2=0x7fd380159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7fd37ea00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd38015b570 0x7fd380159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7fd37ea00640 1 -- 172.21.15.63:0/914813395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38015a200 con 0x7fd3640051c0 2024-03-26T06:17:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.001+0000 7fda27e00640 1 -- 172.21.15.63:0/572214881 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fda340c4360 con 0x7fda2c033ef0 2024-03-26T06:17:25.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7fd37e000640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd38015b570 0x7fd380159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:17:25.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.000+0000 7fd37f400640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd380148870 0x7fd38015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:25.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.001+0000 7f1b63400640 1 -- start start 2024-03-26T06:17:25.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.001+0000 7fdbbaa00640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdba006bc00 0x7fdba006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.001+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c005290 con 0x7fe4940cd040 2024-03-26T06:17:25.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.001+0000 7f5efca00640 1 -- 172.21.15.63:0/3415424165 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447428287 0 0) 0x7f5f00162840 con 0x7f5f000b3800 2024-03-26T06:17:25.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.001+0000 7fd37ea00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640051c0 0x7fd3800cf220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd3700073c0 tx=0x7fd370007880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.002+0000 7fdbbaa00640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdba006bc00 0x7fdba006e0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdbc41585e0 tx=0x7fdbac001950 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.002+0000 7fe48a000640 1 -- 172.21.15.63:0/2241531689 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe48c047020 con 0x7fe4940cd040 2024-03-26T06:17:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.002+0000 7f5efca00640 1 -- 172.21.15.63:0/3415424165 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee4003520 con 0x7f5f000b3800 2024-03-26T06:17:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.002+0000 7f5efca00640 1 -- 172.21.15.63:0/3415424165 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513567094 0 0) 0x7f5f001633c0 con 0x7f5f0006de00 2024-03-26T06:17:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.002+0000 7f5efca00640 1 -- 172.21.15.63:0/3415424165 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f00162840 con 0x7f5f0006de00 2024-03-26T06:17:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.002+0000 7f1b63400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c06de00 0x7f1b5c14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.002+0000 7f5efde00640 1 -- 172.21.15.63:0/3415424165 >> v1:172.21.15.204:6789/0 conn(0x7f5f000b3800 legacy=0x7f5f00165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.002+0000 7f5efde00640 1 -- 172.21.15.63:0/3415424165 >> v1:172.21.15.63:6789/0 conn(0x7f5f0006de00 legacy=0x7f5f000b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.002+0000 7f5efde00640 1 -- 172.21.15.63:0/3415424165 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f00162e00 con 0x7f5f000aeb80 2024-03-26T06:17:25.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b63400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 0x7f1b5c14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b63400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b5c0b3800 0x7f1b5c14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b63400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c0af0e0 con 0x7f1b5c06de00 2024-03-26T06:17:25.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b63400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c0aef60 con 0x7f1b5c0b3800 2024-03-26T06:17:25.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b63400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c06e260 con 0x7f1b5c0aeb80 2024-03-26T06:17:25.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7fe48a000640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe47406bc20 0x7fe47406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7fda27e00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda1406bcd0 0x7fda1406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7fda27e00640 1 -- 172.21.15.63:0/572214881 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fda34126d80 con 0x7fda2c033ef0 2024-03-26T06:17:25.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b60a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c06de00 0x7f1b5c14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7fe48a000640 1 -- 172.21.15.63:0/2241531689 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe48c0ad480 con 0x7fe4940cd040 2024-03-26T06:17:25.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b60a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c06de00 0x7f1b5c14e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49896/0 (socket says 172.21.15.63:49896) 2024-03-26T06:17:25.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b60a00640 1 -- 172.21.15.63:0/3817596444 learned_addr learned my addr 172.21.15.63:0/3817596444 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:25.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b5be00640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 0x7f1b5c14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.003+0000 7f1b61400640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b5c0b3800 0x7f1b5c14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7fe491e00640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe47406bc20 0x7fe47406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f1b60a00640 1 -- 172.21.15.63:0/3817596444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 msgr2=0x7f1b5c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f1b60a00640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 0x7f1b5c14fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7fda33e00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda1406bcd0 0x7fda1406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f1b60a00640 1 -- 172.21.15.63:0/3817596444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b5c0b3800 msgr2=0x7f1b5c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f1b60a00640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b5c0b3800 0x7f1b5c14ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f1b60a00640 1 -- 172.21.15.63:0/3817596444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c150c70 con 0x7f1b5c06de00 2024-03-26T06:17:25.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f5efde00640 1 --2- 172.21.15.63:0/3415424165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f000aeb80 0x7f5f000cfb40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80097a0 tx=0x7f5ee802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b61234f1f2ba3e server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f1b60a00640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c06de00 0x7f1b5c14e6d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b54007dd0 tx=0x7f1b5400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7fe491e00640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe47406bc20 0x7fe47406e0e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4840011e0 tx=0x7fe484009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f5efca00640 1 -- 172.21.15.63:0/3415424165 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80315a0 con 0x7f5f000aeb80 2024-03-26T06:17:25.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f5efca00640 1 -- 172.21.15.63:0/3415424165 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8037070 con 0x7f5f000aeb80 2024-03-26T06:17:25.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.004+0000 7f5efca00640 1 -- 172.21.15.63:0/3415424165 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80315a0 con 0x7f5f000aeb80 2024-03-26T06:17:25.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.005+0000 7fda33e00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda1406bcd0 0x7fda1406e190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda2c04d6e0 tx=0x7fda20009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.005+0000 7f5f04e00640 1 -- 172.21.15.63:0/3415424165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f000aeb80 msgr2=0x7f5f000cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.005+0000 7f5f04e00640 1 --2- 172.21.15.63:0/3415424165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f000aeb80 0x7f5f000cfb40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80097a0 tx=0x7f5ee802b840 comp rx=0 tx=0).stop 2024-03-26T06:17:25.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.005+0000 7f5f04e00640 1 -- 172.21.15.63:0/3415424165 shutdown_connections 2024-03-26T06:17:25.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.005+0000 7f5f04e00640 1 --2- 172.21.15.63:0/3415424165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f000aeb80 0x7f5f000cfb40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.005+0000 7f5f04e00640 1 -- 172.21.15.63:0/3415424165 >> 172.21.15.63:0/3415424165 conn(0x7f5f0006ac90 msgr2=0x7f5f0006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.006+0000 7f5f04e00640 1 -- 172.21.15.63:0/3415424165 shutdown_connections 2024-03-26T06:17:25.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.006+0000 7f5f04e00640 1 -- 172.21.15.63:0/3415424165 wait complete. 2024-03-26T06:17:25.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.007+0000 7f5f04e00640 1 Processor -- start 2024-03-26T06:17:25.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.008+0000 7fda27e00640 1 -- 172.21.15.63:0/572214881 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fda2c04dc90 con 0x7fda2c033ef0 2024-03-26T06:17:25.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.008+0000 7f5f04e00640 1 -- start start 2024-03-26T06:17:25.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.008+0000 7f5f04e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f0006de00 0x7f5f000a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5f04e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000aeb80 0x7f5f000af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5f04e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f000b3800 0x7f5f000ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5f04e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000aef60 con 0x7f5f000aeb80 2024-03-26T06:17:25.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5f04e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006e290 con 0x7f5f000b3800 2024-03-26T06:17:25.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5f04e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000af0e0 con 0x7f5f0006de00 2024-03-26T06:17:25.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5efd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000aeb80 0x7f5f000af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5efd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000aeb80 0x7f5f000af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49898/0 (socket says 172.21.15.63:49898) 2024-03-26T06:17:25.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5efd400640 1 -- 172.21.15.63:0/2922105410 learned_addr learned my addr 172.21.15.63:0/2922105410 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:25.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5efde00640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f0006de00 0x7f5f000a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5efd400640 1 -- 172.21.15.63:0/2922105410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f0006de00 msgr2=0x7f5f000a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5efd400640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f0006de00 0x7f5f000a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5efd400640 1 -- 172.21.15.63:0/2922105410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f000b3800 msgr2=0x7f5f000ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5efd400640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f000b3800 0x7f5f000ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.009+0000 7f5efd400640 1 -- 172.21.15.63:0/2922105410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000cf2c0 con 0x7f5f000aeb80 2024-03-26T06:17:25.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.010+0000 7f5efd400640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000aeb80 0x7f5f000af4d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0001eb0 tx=0x7f5ef000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.013+0000 7f8cfea00640 1 -- 172.21.15.63:0/3384670855 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8d08072150 con 0x7f8d080d0b30 2024-03-26T06:17:25.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.013+0000 7f1b58c00640 1 -- 172.21.15.63:0/3817596444 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5401a070 con 0x7f1b5c06de00 2024-03-26T06:17:25.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.013+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5c150f50 con 0x7f1b5c06de00 2024-03-26T06:17:25.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.013+0000 7fe48a000640 1 -- 172.21.15.63:0/2241531689 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe48c04e030 con 0x7fe4940cd040 2024-03-26T06:17:25.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.013+0000 7f5ef6000640 1 -- 172.21.15.63:0/2922105410 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0017070 con 0x7f5f000aeb80 2024-03-26T06:17:25.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.013+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c151510 con 0x7f1b5c06de00 2024-03-26T06:17:25.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.013+0000 7f1b58c00640 1 -- 172.21.15.63:0/3817596444 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b54009e40 con 0x7f1b5c06de00 2024-03-26T06:17:25.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.013+0000 7f1b58c00640 1 -- 172.21.15.63:0/3817596444 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54015620 con 0x7f1b5c06de00 2024-03-26T06:17:25.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.014+0000 7f5ef6000640 1 -- 172.21.15.63:0/2922105410 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0005ce0 con 0x7f5f000aeb80 2024-03-26T06:17:25.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.014+0000 7f5ef6000640 1 -- 172.21.15.63:0/2922105410 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00072b0 con 0x7f5f000aeb80 2024-03-26T06:17:25.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.014+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f000a9620 con 0x7f5f000aeb80 2024-03-26T06:17:25.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.014+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f000a8600 con 0x7f5f000aeb80 2024-03-26T06:17:25.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.016+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b34005290 con 0x7f1b5c06de00 2024-03-26T06:17:25.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.016+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f00074730 con 0x7f5f000aeb80 2024-03-26T06:17:25.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.017+0000 7f5ef6000640 1 -- 172.21.15.63:0/2922105410 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5ef001a070 con 0x7f5f000aeb80 2024-03-26T06:17:25.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.017+0000 7f1b58c00640 1 -- 172.21.15.63:0/3817596444 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1b5401d070 con 0x7f1b5c06de00 2024-03-26T06:17:25.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.018+0000 7f5ef6000640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5edc06bc50 0x7f5edc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.018+0000 7f5ef6000640 1 -- 172.21.15.63:0/2922105410 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5ef008a160 con 0x7f5f000aeb80 2024-03-26T06:17:25.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.018+0000 7f5efde00640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5edc06bc50 0x7f5edc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.019+0000 7f1b58c00640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1b3c06bbd0 0x7f1b3c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.019+0000 7f1b58c00640 1 -- 172.21.15.63:0/3817596444 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1b5408ad60 con 0x7f1b5c06de00 2024-03-26T06:17:25.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.020+0000 7f1b5be00640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1b3c06bbd0 0x7f1b3c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.020+0000 7f5efde00640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5edc06bc50 0x7f5edc06e110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8036000 tx=0x7f5ee8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.020+0000 7f1b5be00640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1b3c06bbd0 0x7f1b3c06e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c161d90 tx=0x7f1b48007c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.024+0000 7f5ef6000640 1 -- 172.21.15.63:0/2922105410 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f5ef0058980 con 0x7f5f000aeb80 2024-03-26T06:17:25.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.026+0000 7fd376a00640 1 -- 172.21.15.63:0/914813395 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37001a070 con 0x7fd3640051c0 2024-03-26T06:17:25.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.026+0000 7fd376a00640 1 -- 172.21.15.63:0/914813395 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37000fa80 con 0x7fd3640051c0 2024-03-26T06:17:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.027+0000 7fdbbbe00640 1 -- 172.21.15.63:0/2180621214 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fdbb4010040 con 0x7fdba80039b0 2024-03-26T06:17:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.027+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38015a4d0 con 0x7fd3640051c0 2024-03-26T06:17:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.027+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38015aa90 con 0x7fd3640051c0 2024-03-26T06:17:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.028+0000 7fee7aa00640 1 -- 172.21.15.63:0/3408188628 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74039070 con 0x7fee7c06e800 2024-03-26T06:17:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.028+0000 7fee7aa00640 1 -- 172.21.15.63:0/3408188628 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7402ca30 con 0x7fee7c06e800 2024-03-26T06:17:25.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.028+0000 7fd376a00640 1 -- 172.21.15.63:0/914813395 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37000fe70 con 0x7fd3640051c0 2024-03-26T06:17:25.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.028+0000 7fee7aa00640 1 -- 172.21.15.63:0/3408188628 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7402ce40 con 0x7fee7c06e800 2024-03-26T06:17:25.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.028+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3800b2b20 con 0x7fd3640051c0 2024-03-26T06:17:25.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.029+0000 7fee83200640 1 -- 172.21.15.63:0/3408188628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 msgr2=0x7fee7c0c36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.030+0000 7f1b58c00640 1 -- 172.21.15.63:0/3817596444 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1b54010070 con 0x7f1b5c06de00 2024-03-26T06:17:25.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.029+0000 7fee83200640 1 --2- 172.21.15.63:0/3408188628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c36e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fee74009d90 tx=0x7fee7402bd00 comp rx=0 tx=0).stop 2024-03-26T06:17:25.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.030+0000 7fee83200640 1 -- 172.21.15.63:0/3408188628 shutdown_connections 2024-03-26T06:17:25.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.030+0000 7fee83200640 1 --2- 172.21.15.63:0/3408188628 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c36e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.030+0000 7fee83200640 1 --2- 172.21.15.63:0/3408188628 >> v2:172.21.15.204:3300/0 conn(0x7fee7c161fa0 0x7fee7c0afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.030+0000 7fee83200640 1 -- 172.21.15.63:0/3408188628 >> 172.21.15.63:0/3408188628 conn(0x7fee7c099a70 msgr2=0x7fee7c0b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.031+0000 7fee83200640 1 -- 172.21.15.63:0/3408188628 shutdown_connections 2024-03-26T06:17:25.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.031+0000 7fee83200640 1 -- 172.21.15.63:0/3408188628 wait complete. 2024-03-26T06:17:25.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.034+0000 7fee83200640 1 Processor -- start 2024-03-26T06:17:25.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.032+0000 7fd376a00640 1 -- 172.21.15.63:0/914813395 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd37001d360 con 0x7fd3640051c0 2024-03-26T06:17:25.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.034+0000 7fd376a00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd36006bc00 0x7fd36006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.034+0000 7fd376a00640 1 -- 172.21.15.63:0/914813395 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd37008b0c0 con 0x7fd3640051c0 2024-03-26T06:17:25.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.034+0000 7fee83200640 1 -- start start 2024-03-26T06:17:25.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.035+0000 7fd37e000640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd36006bc00 0x7fd36006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.037+0000 7fee83200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.037+0000 7fd37e000640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd36006bc00 0x7fd36006e0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd3801566f0 tx=0x7fd36c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.037+0000 7fee83200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee7c161fa0 0x7fee7c1ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.037+0000 7fee83200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee7c162380 0x7fee7c203ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.038+0000 7fee7be00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.038+0000 7fee7be00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47912/0 (socket says 172.21.15.63:47912) 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.038+0000 7fee7b400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee7c161fa0 0x7fee7c1ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.038+0000 7fee7b400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee7c161fa0 0x7fee7c1ecd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43804/0 (socket says 172.21.15.63:43804) 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.038+0000 7fee81200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee7c162380 0x7fee7c203ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.038+0000 7fee81200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee7c162380 0x7fee7c203ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49902/0 (socket says 172.21.15.63:49902) 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.039+0000 7fee7be00640 1 -- 172.21.15.63:0/3467067462 learned_addr learned my addr 172.21.15.63:0/3467067462 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.039+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0d0190 con 0x7fee7c162380 2024-03-26T06:17:25.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.039+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0cf560 con 0x7fee7c161fa0 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.039+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0c3c20 con 0x7fee7c06e800 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.040+0000 7fee81200640 1 -- 172.21.15.63:0/3467067462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 msgr2=0x7fee7c0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.040+0000 7fee81200640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.040+0000 7fee81200640 1 -- 172.21.15.63:0/3467067462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee7c161fa0 msgr2=0x7fee7c1ecd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.040+0000 7fee81200640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee7c161fa0 0x7fee7c1ecd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.041+0000 7fee81200640 1 -- 172.21.15.63:0/3467067462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0c6340 con 0x7fee7c162380 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.041+0000 7fee81200640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee7c162380 0x7fee7c203ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee74033000 tx=0x7fee74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.043+0000 7fee73e00640 1 -- 172.21.15.63:0/3467067462 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74039050 con 0x7fee7c162380 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.043+0000 7fee73e00640 1 -- 172.21.15.63:0/3467067462 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee74045070 con 0x7fee7c162380 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.043+0000 7fee73e00640 1 -- 172.21.15.63:0/3467067462 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74040690 con 0x7fee7c162380 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.043+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c0c6620 con 0x7fee7c162380 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.044+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c1eaf00 con 0x7fee7c162380 2024-03-26T06:17:25.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.045+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c074730 con 0x7fee7c162380 2024-03-26T06:17:25.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.046+0000 7fd376a00640 1 -- 172.21.15.63:0/914813395 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fd3800b2b20 con 0x7fd3640051c0 2024-03-26T06:17:25.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.047+0000 7fee73e00640 1 -- 172.21.15.63:0/3467067462 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fee74040830 con 0x7fee7c162380 2024-03-26T06:17:25.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.049+0000 7fee73e00640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5c06bc00 0x7fee5c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:25.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.049+0000 7fee73e00640 1 -- 172.21.15.63:0/3467067462 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fee740acd00 con 0x7fee7c162380 2024-03-26T06:17:25.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.051+0000 7fee7be00640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5c06bc00 0x7fee5c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:25.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.056+0000 7fee7be00640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5c06bc00 0x7fee5c06e0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee6800ac20 tx=0x7fee68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:25.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.057+0000 7fee73e00640 1 -- 172.21.15.63:0/3467067462 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fee740b4070 con 0x7fee7c162380 2024-03-26T06:17:25.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.446+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d08074730 con 0x7f8d080d0b30 2024-03-26T06:17:25.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.447+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fda2c053840 con 0x7fda2c033ef0 2024-03-26T06:17:25.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.447+0000 7f8cfea00640 1 -- 172.21.15.63:0/3384670855 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8cf8033030 con 0x7f8d080d0b30 2024-03-26T06:17:25.447 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:25.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.448+0000 7fda27e00640 1 -- 172.21.15.63:0/572214881 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda3406ce20 con 0x7fda2c033ef0 2024-03-26T06:17:25.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.451+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ce806bc20 msgr2=0x7f8ce806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.451+0000 7f8d0dc00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ce806bc20 0x7f8ce806e0e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d080ce6e0 tx=0x7f8cf4009040 comp rx=0 tx=0).stop 2024-03-26T06:17:25.451 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-03-26T06:17:25.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.451+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda1406bcd0 msgr2=0x7fda1406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.451+0000 7fda3ac00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda1406bcd0 0x7fda1406e190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda2c04d6e0 tx=0x7fda20009240 comp rx=0 tx=0).stop 2024-03-26T06:17:25.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.451+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda2c033ef0 msgr2=0x7fda2c04d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.451+0000 7fda3ac00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda2c033ef0 0x7fda2c04d750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fda34075a00 tx=0x7fda34068a60 comp rx=0 tx=0).stop 2024-03-26T06:17:25.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.451+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d080d0b30 msgr2=0x7f8d0815a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.451+0000 7f8d0dc00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d080d0b30 0x7f8d0815a350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8d0806c2c0 tx=0x7f8cf8004730 comp rx=0 tx=0).stop 2024-03-26T06:17:25.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 shutdown_connections 2024-03-26T06:17:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7f8d0dc00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ce806bc20 0x7f8ce806e0e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7f8d0dc00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d0815df90 0x7f8d081fb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7f8d0dc00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d0815dbb0 0x7f8d08070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7f8d0dc00640 1 --2- 172.21.15.63:0/3384670855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d080d0b30 0x7f8d0815a350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 >> 172.21.15.63:0/3384670855 conn(0x7f8d080b5540 msgr2=0x7f8d080b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 shutdown_connections 2024-03-26T06:17:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7fda3ac00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fda1406bcd0 0x7fda1406e190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7fda3ac00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda2c053c70 0x7fda2c0d6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7fda3ac00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda2c033ef0 0x7fda2c04d750 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7fda3ac00640 1 --2- 172.21.15.63:0/572214881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda2c00c0a0 0x7fda2c04c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 >> 172.21.15.63:0/572214881 conn(0x7fda2c009fb0 msgr2=0x7fda2c036590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 shutdown_connections 2024-03-26T06:17:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7fda3ac00640 1 -- 172.21.15.63:0/572214881 wait complete. 2024-03-26T06:17:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 shutdown_connections 2024-03-26T06:17:25.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.452+0000 7f8d0dc00640 1 -- 172.21.15.63:0/3384670855 wait complete. 2024-03-26T06:17:25.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.456+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe46c005850 con 0x7fe4940cd040 2024-03-26T06:17:25.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.457+0000 7fe48a000640 1 -- 172.21.15.63:0/2241531689 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe48c07b790 con 0x7fe4940cd040 2024-03-26T06:17:25.460 INFO:teuthology.orchestra.run.smithi063.stdout:55834574856 2024-03-26T06:17:25.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.461+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe47406bc20 msgr2=0x7fe47406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.461+0000 7fe498a00640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe47406bc20 0x7fe47406e0e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4840011e0 tx=0x7fe484009040 comp rx=0 tx=0).stop 2024-03-26T06:17:25.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.462+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4940cd040 msgr2=0x7fe4940af7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.462+0000 7fe498a00640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4940cd040 0x7fe4940af7b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe48c02c550 tx=0x7fe48c004a40 comp rx=0 tx=0).stop 2024-03-26T06:17:25.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.462+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 shutdown_connections 2024-03-26T06:17:25.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.462+0000 7fe498a00640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe47406bc20 0x7fe47406e0e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.462+0000 7fe498a00640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4940cd040 0x7fe4940af7b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.462+0000 7fe498a00640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4940cc8a0 0x7fe4940af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.462+0000 7fe498a00640 1 --2- 172.21.15.63:0/2241531689 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4940cc060 0x7fe4940cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.462+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 >> 172.21.15.63:0/2241531689 conn(0x7fe4940b2250 msgr2=0x7fe4940b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.463+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 shutdown_connections 2024-03-26T06:17:25.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.463+0000 7fe498a00640 1 -- 172.21.15.63:0/2241531689 wait complete. 2024-03-26T06:17:25.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.465+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5f00160c00 con 0x7f5f000aeb80 2024-03-26T06:17:25.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.467+0000 7f5ef6000640 1 -- 172.21.15.63:0/2922105410 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ef0058280 con 0x7f5f000aeb80 2024-03-26T06:17:25.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.467+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdbc415d160 con 0x7fdba80039b0 2024-03-26T06:17:25.468 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-03-26T06:17:25.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.468+0000 7fdbbbe00640 1 -- 172.21.15.63:0/2180621214 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdbb407b910 con 0x7fdba80039b0 2024-03-26T06:17:25.471 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-03-26T06:17:25.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.470+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5edc06bc50 msgr2=0x7f5edc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.470+0000 7f5f04e00640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5edc06bc50 0x7f5edc06e110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8036000 tx=0x7f5ee8008030 comp rx=0 tx=0).stop 2024-03-26T06:17:25.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.471+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000aeb80 msgr2=0x7f5f000af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.471+0000 7f5f04e00640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000aeb80 0x7f5f000af4d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0001eb0 tx=0x7f5ef000c960 comp rx=0 tx=0).stop 2024-03-26T06:17:25.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.471+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 shutdown_connections 2024-03-26T06:17:25.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.471+0000 7f5f04e00640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5edc06bc50 0x7f5edc06e110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.471+0000 7f5f04e00640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f000b3800 0x7f5f000ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.471+0000 7f5f04e00640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000aeb80 0x7f5f000af4d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.471+0000 7f5f04e00640 1 --2- 172.21.15.63:0/2922105410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f0006de00 0x7f5f000a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.471+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 >> 172.21.15.63:0/2922105410 conn(0x7f5f0006ac90 msgr2=0x7f5f000b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdba006bc00 msgr2=0x7fdba006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 shutdown_connections 2024-03-26T06:17:25.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdba006bc00 0x7fdba006e0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdbc41585e0 tx=0x7fdbac001950 comp rx=0 tx=0).stop 2024-03-26T06:17:25.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdba80039b0 msgr2=0x7fdbc4160f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdba80039b0 0x7fdbc4160f60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400e4c0 tx=0x7fdbb4009750 comp rx=0 tx=0).stop 2024-03-26T06:17:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 shutdown_connections 2024-03-26T06:17:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdba006bc00 0x7fdba006e0c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7f5f04e00640 1 -- 172.21.15.63:0/2922105410 wait complete. 2024-03-26T06:17:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbc4154240 0x7fdbc41546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40cf960 0x7fdbc40c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 --2- 172.21.15.63:0/2180621214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdba80039b0 0x7fdbc4160f60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.472+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 >> 172.21.15.63:0/2180621214 conn(0x7fdbc40b5540 msgr2=0x7fdbc40cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.474+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 shutdown_connections 2024-03-26T06:17:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.474+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1b34005580 con 0x7f1b5c06de00 2024-03-26T06:17:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.474+0000 7fdbca400640 1 -- 172.21.15.63:0/2180621214 wait complete. 2024-03-26T06:17:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.474+0000 7f1b58c00640 1 -- 172.21.15.63:0/3817596444 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b54058e20 con 0x7f1b5c06de00 2024-03-26T06:17:25.476 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:25.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.478+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1b3c06bbd0 msgr2=0x7f1b3c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.478+0000 7f1b63400640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1b3c06bbd0 0x7f1b3c06e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c161d90 tx=0x7f1b48007c80 comp rx=0 tx=0).stop 2024-03-26T06:17:25.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.478+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c06de00 msgr2=0x7f1b5c14e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.478+0000 7f1b63400640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c06de00 0x7f1b5c14e6d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b54007dd0 tx=0x7f1b5400d4a0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.479+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 shutdown_connections 2024-03-26T06:17:25.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.479+0000 7f1b63400640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1b3c06bbd0 0x7f1b3c06e090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.479+0000 7f1b63400640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b5c0b3800 0x7f1b5c14ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.479+0000 7f1b63400640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b5c0aeb80 0x7f1b5c14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.479+0000 7f1b63400640 1 --2- 172.21.15.63:0/3817596444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c06de00 0x7f1b5c14e6d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.479+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 >> 172.21.15.63:0/3817596444 conn(0x7f1b5c06ac90 msgr2=0x7f1b5c163590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-03-26T06:17:25.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.480+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 shutdown_connections 2024-03-26T06:17:25.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.480+0000 7f1b63400640 1 -- 172.21.15.63:0/3817596444 wait complete. 2024-03-26T06:17:25.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-03-26T06:17:25.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.490+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fee7c1ea1c0 con 0x7fee7c162380 2024-03-26T06:17:25.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-03-26T06:17:25.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.491+0000 7fee73e00640 1 -- 172.21.15.63:0/3467067462 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee7407fe20 con 0x7fee7c162380 2024-03-26T06:17:25.491 INFO:teuthology.orchestra.run.smithi063.stdout:55834574856 2024-03-26T06:17:25.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.491+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd380074730 con 0x7fd3640051c0 2024-03-26T06:17:25.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.492+0000 7fd376a00640 1 -- 172.21.15.63:0/914813395 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd370059210 con 0x7fd3640051c0 2024-03-26T06:17:25.492 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-03-26T06:17:25.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.493+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5c06bc00 msgr2=0x7fee5c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.493+0000 7fee83200640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5c06bc00 0x7fee5c06e0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee6800ac20 tx=0x7fee68008040 comp rx=0 tx=0).stop 2024-03-26T06:17:25.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.493+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee7c162380 msgr2=0x7fee7c203ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.493+0000 7fee83200640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee7c162380 0x7fee7c203ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee74033000 tx=0x7fee74004a40 comp rx=0 tx=0).stop 2024-03-26T06:17:25.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.494+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 shutdown_connections 2024-03-26T06:17:25.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.494+0000 7fee83200640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fee5c06bc00 0x7fee5c06e0c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.494+0000 7fee83200640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee7c162380 0x7fee7c203ca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.494+0000 7fee83200640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee7c161fa0 0x7fee7c1ecd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.494+0000 7fee83200640 1 --2- 172.21.15.63:0/3467067462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee7c06e800 0x7fee7c0c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.494+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 >> 172.21.15.63:0/3467067462 conn(0x7fee7c099a70 msgr2=0x7fee7c0af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.494+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 shutdown_connections 2024-03-26T06:17:25.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.494+0000 7fee83200640 1 -- 172.21.15.63:0/3467067462 wait complete. 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd36006bc00 msgr2=0x7fd36006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd36006bc00 0x7fd36006e0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd3801566f0 tx=0x7fd36c008040 comp rx=0 tx=0).stop 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640051c0 msgr2=0x7fd3800cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640051c0 0x7fd3800cf220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd3700073c0 tx=0x7fd370007880 comp rx=0 tx=0).stop 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 shutdown_connections 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd36006bc00 0x7fd36006e0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd380148870 0x7fd38015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd38015b570 0x7fd380159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 --2- 172.21.15.63:0/914813395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3640051c0 0x7fd3800cf220 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.495+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 >> 172.21.15.63:0/914813395 conn(0x7fd38006ac90 msgr2=0x7fd3800b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.496+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 shutdown_connections 2024-03-26T06:17:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:25.496+0000 7fd385a00640 1 -- 172.21.15.63:0/914813395 wait complete. 2024-03-26T06:17:25.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-03-26T06:17:25.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-03-26T06:17:25.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-03-26T06:17:25.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-03-26T06:17:25.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-03-26T06:17:26.481 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-26T06:17:26.482 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-26T06:17:26.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-26T06:17:26.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-26T06:17:26.503 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-26T06:17:26.505 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-26T06:17:26.514 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-26T06:17:26.517 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-26T06:17:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.764+0000 7f415fe00640 1 Processor -- start 2024-03-26T06:17:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.764+0000 7f415fe00640 1 -- start start 2024-03-26T06:17:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.766+0000 7f415fe00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f41580e3160 0x7f41580e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.766+0000 7f415fe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4158053cb0 0x7f4158054100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.766+0000 7f415fe00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4158058810 con 0x7f415803c0a0 2024-03-26T06:17:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.766+0000 7f415fe00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4158007b70 con 0x7f4158053cb0 2024-03-26T06:17:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.766+0000 7f415fe00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4158058af0 con 0x7f41580e3160 2024-03-26T06:17:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.767+0000 7f415ea00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f41580e3160 0x7f41580e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.767+0000 7f415ea00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f41580e3160 0x7f41580e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43814/0 (socket says 172.21.15.63:43814) 2024-03-26T06:17:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.767+0000 7f415ea00640 1 -- 172.21.15.63:0/3285766226 learned_addr learned my addr 172.21.15.63:0/3285766226 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.767+0000 7f415f400640 1 --2- 172.21.15.63:0/3285766226 >> v2:172.21.15.63:3300/0 conn(0x7f4158053cb0 0x7f4158054100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.768+0000 7f415ea00640 1 -- 172.21.15.63:0/3285766226 >> v2:172.21.15.63:3300/0 conn(0x7f4158053cb0 msgr2=0x7f4158054100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.768+0000 7f415ea00640 1 --2- 172.21.15.63:0/3285766226 >> v2:172.21.15.63:3300/0 conn(0x7f4158053cb0 0x7f4158054100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.768+0000 7f415ea00640 1 -- 172.21.15.63:0/3285766226 >> v1:172.21.15.204:6789/0 conn(0x7f415803c0a0 legacy=0x7f4158058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.768+0000 7f415ea00640 1 -- 172.21.15.63:0/3285766226 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4158006360 con 0x7f41580e3160 2024-03-26T06:17:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.770+0000 7f415f400640 1 --2- 172.21.15.63:0/3285766226 >> v2:172.21.15.63:3300/0 conn(0x7f4158053cb0 0x7f4158054100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:17:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.771+0000 7f415ea00640 1 --2- 172.21.15.63:0/3285766226 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41580e3160 0x7f41580e7780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4158038910 tx=0x7f415002b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18970b9e669bd231 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.771+0000 7f415d600640 1 -- 172.21.15.63:0/3285766226 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150037070 con 0x7f41580e3160 2024-03-26T06:17:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.772+0000 7f415d600640 1 -- 172.21.15.63:0/3285766226 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4150030710 con 0x7f41580e3160 2024-03-26T06:17:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.772+0000 7f415d600640 1 -- 172.21.15.63:0/3285766226 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150030b20 con 0x7f41580e3160 2024-03-26T06:17:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.773+0000 7f415fe00640 1 -- 172.21.15.63:0/3285766226 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41580e3160 msgr2=0x7f41580e7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.773+0000 7f415fe00640 1 --2- 172.21.15.63:0/3285766226 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41580e3160 0x7f41580e7780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4158038910 tx=0x7f415002b800 comp rx=0 tx=0).stop 2024-03-26T06:17:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.774+0000 7f415fe00640 1 -- 172.21.15.63:0/3285766226 shutdown_connections 2024-03-26T06:17:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.774+0000 7f415fe00640 1 --2- 172.21.15.63:0/3285766226 >> v2:172.21.15.63:3300/0 conn(0x7f4158053cb0 0x7f4158054100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.774+0000 7f415fe00640 1 --2- 172.21.15.63:0/3285766226 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41580e3160 0x7f41580e7780 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.774+0000 7f415fe00640 1 -- 172.21.15.63:0/3285766226 >> 172.21.15.63:0/3285766226 conn(0x7f4158058ee0 msgr2=0x7f41580592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.774+0000 7fa7a6200640 1 Processor -- start 2024-03-26T06:17:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.774+0000 7fa7a6200640 1 -- start start 2024-03-26T06:17:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.775+0000 7f415fe00640 1 -- 172.21.15.63:0/3285766226 shutdown_connections 2024-03-26T06:17:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.775+0000 7f415fe00640 1 -- 172.21.15.63:0/3285766226 wait complete. 2024-03-26T06:17:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.776+0000 7fa7a6200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa7a00cc8a0 0x7fa7a00cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.776+0000 7fa7a6200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a00ce440 con 0x7fa7a00cc060 2024-03-26T06:17:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.776+0000 7fa7a6200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a00cd740 con 0x7fa7a00cad10 2024-03-26T06:17:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.776+0000 7fa7a6200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a00cda20 con 0x7fa7a00cc8a0 2024-03-26T06:17:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.777+0000 7fa79fe00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fa7a00cad10 0x7fa7a00cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:42536/0 (socket says 172.21.15.63:42536) 2024-03-26T06:17:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.777+0000 7fa79fe00640 1 -- 172.21.15.63:0/1215406902 learned_addr learned my addr 172.21.15.63:0/1215406902 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:26.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.777+0000 7f415fe00640 1 Processor -- start 2024-03-26T06:17:26.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.777+0000 7fa79ea00640 1 --2- 172.21.15.63:0/1215406902 >> v2:172.21.15.204:3300/0 conn(0x7fa7a00cc8a0 0x7fa7a00cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.778+0000 7f415fe00640 1 -- start start 2024-03-26T06:17:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.779+0000 7fa79ea00640 1 -- 172.21.15.63:0/1215406902 >> v1:172.21.15.204:6789/0 conn(0x7fa7a00cad10 legacy=0x7fa7a00cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.779+0000 7fa79e000640 1 -- 172.21.15.63:0/1215406902 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986659949 0 0) 0x7fa7a00cd740 con 0x7fa7a00cad10 2024-03-26T06:17:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.779+0000 7fa79ea00640 1 -- 172.21.15.63:0/1215406902 >> v1:172.21.15.63:6789/0 conn(0x7fa7a00cc060 legacy=0x7fa7a006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.780+0000 7f415fe00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f415803c0a0 0x7f41580d7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.780+0000 7f415fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4158053cb0 0x7f4158051a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.781+0000 7f415ea00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f415803c0a0 0x7f41580d7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.781+0000 7f415ea00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f415803c0a0 0x7f41580d7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43832/0 (socket says 172.21.15.63:43832) 2024-03-26T06:17:26.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.780+0000 7fa79ea00640 1 -- 172.21.15.63:0/1215406902 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a00cdd00 con 0x7fa7a00cc8a0 2024-03-26T06:17:26.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.781+0000 7f415e000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4158053cb0 0x7f4158051a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.781+0000 7f415ea00640 1 -- 172.21.15.63:0/2884237443 learned_addr learned my addr 172.21.15.63:0/2884237443 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.781+0000 7f415fe00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41580e3160 0x7f415816e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.781+0000 7fa79ea00640 1 --2- 172.21.15.63:0/1215406902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cc8a0 0x7fa7a00cd040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7900097a0 tx=0x7fa79002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cf9b53ca7ee009a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.782+0000 7f415fe00640 1 -- 172.21.15.63:0/2884237443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580e3540 con 0x7f4158053cb0 2024-03-26T06:17:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.782+0000 7f415fe00640 1 -- 172.21.15.63:0/2884237443 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4158054640 con 0x7f415803c0a0 2024-03-26T06:17:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.782+0000 7fa79e000640 1 -- 172.21.15.63:0/1215406902 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790034070 con 0x7fa7a00cc8a0 2024-03-26T06:17:26.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.782+0000 7f415f400640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41580e3160 0x7f415816e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.782+0000 7f415fe00640 1 -- 172.21.15.63:0/2884237443 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4158006b60 con 0x7f41580e3160 2024-03-26T06:17:26.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.784+0000 7f415f400640 1 -- 172.21.15.63:0/2884237443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f415803c0a0 msgr2=0x7f41580d7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.783+0000 7fa79e000640 1 -- 172.21.15.63:0/1215406902 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790030840 con 0x7fa7a00cc8a0 2024-03-26T06:17:26.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.783+0000 7fa79e000640 1 -- 172.21.15.63:0/1215406902 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790030c10 con 0x7fa7a00cc8a0 2024-03-26T06:17:26.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.784+0000 7fa7a6200640 1 -- 172.21.15.63:0/1215406902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cc8a0 msgr2=0x7fa7a00cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.784+0000 7fa7a6200640 1 --2- 172.21.15.63:0/1215406902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cc8a0 0x7fa7a00cd040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7900097a0 tx=0x7fa79002b980 comp rx=0 tx=0).stop 2024-03-26T06:17:26.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.784+0000 7f415f400640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f415803c0a0 0x7f41580d7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.784+0000 7f415f400640 1 -- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4158053cb0 msgr2=0x7f4158051a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.784+0000 7fa7a6200640 1 -- 172.21.15.63:0/1215406902 shutdown_connections 2024-03-26T06:17:26.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.784+0000 7fa7a6200640 1 --2- 172.21.15.63:0/1215406902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cc8a0 0x7fa7a00cd040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.784+0000 7fa7a6200640 1 -- 172.21.15.63:0/1215406902 >> 172.21.15.63:0/1215406902 conn(0x7fa7a00b2250 msgr2=0x7fa7a00b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:26.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.784+0000 7f415f400640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4158053cb0 0x7f4158051a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.785+0000 7f415f400640 1 -- 172.21.15.63:0/2884237443 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415816d050 con 0x7f41580e3160 2024-03-26T06:17:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.785+0000 7f415e000640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4158053cb0 0x7f4158051a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:17:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.786+0000 7fa7a6200640 1 -- 172.21.15.63:0/1215406902 shutdown_connections 2024-03-26T06:17:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.786+0000 7f415f400640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41580e3160 0x7f415816e0f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f416004fe00 tx=0x7f41600734b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.786+0000 7fa7a6200640 1 -- 172.21.15.63:0/1215406902 wait complete. 2024-03-26T06:17:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.786+0000 7f4156a00640 1 -- 172.21.15.63:0/2884237443 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160074870 con 0x7f41580e3160 2024-03-26T06:17:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.787+0000 7f4156a00640 1 -- 172.21.15.63:0/2884237443 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160095480 con 0x7f41580e3160 2024-03-26T06:17:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.787+0000 7f415fe00640 1 -- 172.21.15.63:0/2884237443 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415816d330 con 0x7f41580e3160 2024-03-26T06:17:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.787+0000 7f415fe00640 1 -- 172.21.15.63:0/2884237443 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415816d8f0 con 0x7f41580e3160 2024-03-26T06:17:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.789+0000 7f4156a00640 1 -- 172.21.15.63:0/2884237443 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41600958b0 con 0x7f41580e3160 2024-03-26T06:17:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.789+0000 7f415fe00640 1 -- 172.21.15.63:0/2884237443 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4158005390 con 0x7f41580e3160 2024-03-26T06:17:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.790+0000 7fa7a6200640 1 Processor -- start 2024-03-26T06:17:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.791+0000 7f4156a00640 1 -- 172.21.15.63:0/2884237443 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4160095a50 con 0x7f41580e3160 2024-03-26T06:17:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.790+0000 7fa7a6200640 1 -- start start 2024-03-26T06:17:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.792+0000 7fa7a6200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cad10 0x7fa7a00afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.792+0000 7fa7a6200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a00cc060 0x7fa7a00b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.792+0000 7f4156a00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f414006bc20 0x7f414006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.793+0000 7f4156a00640 1 -- 172.21.15.63:0/2884237443 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f41600d1ba0 con 0x7f41580e3160 2024-03-26T06:17:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.793+0000 7fa79f400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cad10 0x7fa7a00afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.793+0000 7fa79f400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cad10 0x7fa7a00afb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43840/0 (socket says 172.21.15.63:43840) 2024-03-26T06:17:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.793+0000 7fa7a6200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a00cc8a0 0x7fa7a0150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.793+0000 7fa7a6200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a006ba60 con 0x7fa7a00cc060 2024-03-26T06:17:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.793+0000 7fa7a6200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a00cc440 con 0x7fa7a00cad10 2024-03-26T06:17:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.793+0000 7fa7a6200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a00d0140 con 0x7fa7a00cc8a0 2024-03-26T06:17:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.793+0000 7fa79f400640 1 -- 172.21.15.63:0/1817602038 learned_addr learned my addr 172.21.15.63:0/1817602038 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.794+0000 7f415ea00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f414006bc20 0x7f414006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.794+0000 7fa79ea00640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a00cc060 0x7fa7a00b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.794+0000 7fa79f400640 1 -- 172.21.15.63:0/1817602038 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a00cc8a0 msgr2=0x7fa7a0150030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-26T06:17:26.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.794+0000 7fa79f400640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a00cc8a0 0x7fa7a0150030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.794+0000 7fa79f400640 1 -- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a00cc060 msgr2=0x7fa7a00b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.794+0000 7fa79f400640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a00cc060 0x7fa7a00b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.794+0000 7fa79f400640 1 -- 172.21.15.63:0/1817602038 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a00aeab0 con 0x7fa7a00cad10 2024-03-26T06:17:26.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.795+0000 7fa79ea00640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a00cc060 0x7fa7a00b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:26.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.796+0000 7f415ea00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f414006bc20 0x7f414006e0e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f41500090b0 tx=0x7f4150008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.796+0000 7fa79f400640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cad10 0x7fa7a00afb50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7980021c0 tx=0x7fa7980021f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.796+0000 7fa797400640 1 -- 172.21.15.63:0/1817602038 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798015d70 con 0x7fa7a00cad10 2024-03-26T06:17:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.797+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a00aed90 con 0x7fa7a00cad10 2024-03-26T06:17:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.797+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a00af350 con 0x7fa7a00cad10 2024-03-26T06:17:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.797+0000 7fa797400640 1 -- 172.21.15.63:0/1817602038 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798003970 con 0x7fa7a00cad10 2024-03-26T06:17:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.797+0000 7fa797400640 1 -- 172.21.15.63:0/1817602038 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798003d60 con 0x7fa7a00cad10 2024-03-26T06:17:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.799+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa778005290 con 0x7fa7a00cad10 2024-03-26T06:17:26.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.802+0000 7fa797400640 1 -- 172.21.15.63:0/1817602038 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa7980050d0 con 0x7fa7a00cad10 2024-03-26T06:17:26.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.803+0000 7fa797400640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa78006bbd0 0x7fa78006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.804+0000 7fa797400640 1 -- 172.21.15.63:0/1817602038 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa798093490 con 0x7fa7a00cad10 2024-03-26T06:17:26.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.804+0000 7fa79ea00640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa78006bbd0 0x7fa78006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.805+0000 7fa79ea00640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa78006bbd0 0x7fa78006e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa790036000 tx=0x7fa79003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.808+0000 7f4156a00640 1 -- 172.21.15.63:0/2884237443 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f416009a060 con 0x7f41580e3160 2024-03-26T06:17:26.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.820+0000 7fa797400640 1 -- 172.21.15.63:0/1817602038 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa798061c20 con 0x7fa7a00cad10 2024-03-26T06:17:26.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.833+0000 7f208c800640 1 Processor -- start 2024-03-26T06:17:26.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.833+0000 7f208c800640 1 -- start start 2024-03-26T06:17:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.835+0000 7f208c800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f208415df90 0x7f20840d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.835+0000 7f208c800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840d2490 con 0x7f208415dbb0 2024-03-26T06:17:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.835+0000 7f208c800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840d2770 con 0x7f20840b96e0 2024-03-26T06:17:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.835+0000 7f208c800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20840d2a50 con 0x7f208415df90 2024-03-26T06:17:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.836+0000 7f208a800640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f20840b96e0 0x7f20840b6bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:42538/0 (socket says 172.21.15.63:42538) 2024-03-26T06:17:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.836+0000 7f208a800640 1 -- 172.21.15.63:0/352262485 learned_addr learned my addr 172.21.15.63:0/352262485 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.836+0000 7f2089400640 1 --2- 172.21.15.63:0/352262485 >> v2:172.21.15.63:3300/0 conn(0x7f208415df90 0x7f20840d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.837+0000 7f2089400640 1 -- 172.21.15.63:0/352262485 >> v1:172.21.15.204:6789/0 conn(0x7f20840b96e0 legacy=0x7f20840b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.837+0000 7f2089400640 1 -- 172.21.15.63:0/352262485 >> v1:172.21.15.63:6789/0 conn(0x7f208415dbb0 legacy=0x7f20840d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.837+0000 7f2089400640 1 -- 172.21.15.63:0/352262485 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20840d2d30 con 0x7f208415df90 2024-03-26T06:17:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.837+0000 7fc943200640 1 Processor -- start 2024-03-26T06:17:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.838+0000 7fc943200640 1 -- start start 2024-03-26T06:17:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.839+0000 7f2089400640 1 --2- 172.21.15.63:0/352262485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415df90 0x7f20840d0420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20740097a0 tx=0x7f207402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7054ed17ee0b592 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.840+0000 7fc943200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc93c0712f0 0x7fc93c071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.840+0000 7fc943200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc93c0cf550 0x7fc93c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.840+0000 7fc943200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c06e880 con 0x7fc93c159d00 2024-03-26T06:17:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.840+0000 7fc943200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c0ccac0 con 0x7fc93c0712f0 2024-03-26T06:17:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.840+0000 7fc943200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c06eb60 con 0x7fc93c0cf550 2024-03-26T06:17:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.841+0000 7fc93be00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fc93c159d00 0x7fc93c0b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:42554/0 (socket says 172.21.15.63:42554) 2024-03-26T06:17:26.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.841+0000 7fc93be00640 1 -- 172.21.15.63:0/656107688 learned_addr learned my addr 172.21.15.63:0/656107688 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:26.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.841+0000 7fc941200640 1 --2- 172.21.15.63:0/656107688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc93c0cf550 0x7fc93c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.841+0000 7fc93b400640 1 --2- 172.21.15.63:0/656107688 >> v2:172.21.15.204:3300/0 conn(0x7fc93c0712f0 0x7fc93c071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.840+0000 7f2088a00640 1 -- 172.21.15.63:0/352262485 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074034070 con 0x7f208415df90 2024-03-26T06:17:26.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.840+0000 7f2088a00640 1 -- 172.21.15.63:0/352262485 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2074030610 con 0x7f208415df90 2024-03-26T06:17:26.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.840+0000 7f2088a00640 1 -- 172.21.15.63:0/352262485 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740309e0 con 0x7f208415df90 2024-03-26T06:17:26.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.841+0000 7f208c800640 1 -- 172.21.15.63:0/352262485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415df90 msgr2=0x7f20840d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.842+0000 7fc93aa00640 1 -- 172.21.15.63:0/656107688 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115108969 0 0) 0x7fc93c06e880 con 0x7fc93c159d00 2024-03-26T06:17:26.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.841+0000 7f208c800640 1 --2- 172.21.15.63:0/352262485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415df90 0x7f20840d0420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20740097a0 tx=0x7f207402b960 comp rx=0 tx=0).stop 2024-03-26T06:17:26.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.842+0000 7fc93aa00640 1 -- 172.21.15.63:0/656107688 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc920003520 con 0x7fc93c159d00 2024-03-26T06:17:26.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.842+0000 7fc93b400640 1 -- 172.21.15.63:0/656107688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc93c0cf550 msgr2=0x7fc93c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.842+0000 7fc93b400640 1 --2- 172.21.15.63:0/656107688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc93c0cf550 0x7fc93c0ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.842+0000 7fc93b400640 1 -- 172.21.15.63:0/656107688 >> v1:172.21.15.204:6789/0 conn(0x7fc93c159d00 legacy=0x7fc93c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.842+0000 7fc93b400640 1 -- 172.21.15.63:0/656107688 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c06ee40 con 0x7fc93c0712f0 2024-03-26T06:17:26.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.844+0000 7f208c800640 1 -- 172.21.15.63:0/352262485 shutdown_connections 2024-03-26T06:17:26.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.844+0000 7f208c800640 1 --2- 172.21.15.63:0/352262485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415df90 0x7f20840d0420 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.844+0000 7f208c800640 1 -- 172.21.15.63:0/352262485 >> 172.21.15.63:0/352262485 conn(0x7f20840b5540 msgr2=0x7f20840b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.844+0000 7f208c800640 1 -- 172.21.15.63:0/352262485 shutdown_connections 2024-03-26T06:17:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.844+0000 7f208c800640 1 -- 172.21.15.63:0/352262485 wait complete. 2024-03-26T06:17:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.845+0000 7fc93b400640 1 --2- 172.21.15.63:0/656107688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc93c0712f0 0x7fc93c071780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc9280097a0 tx=0x7fc92802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2a9d5cb8d82ba5f server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.846+0000 7fc93aa00640 1 -- 172.21.15.63:0/656107688 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9280317c0 con 0x7fc93c0712f0 2024-03-26T06:17:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.846+0000 7fc93aa00640 1 -- 172.21.15.63:0/656107688 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc928037070 con 0x7fc93c0712f0 2024-03-26T06:17:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.846+0000 7fc93aa00640 1 -- 172.21.15.63:0/656107688 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928031bc0 con 0x7fc93c0712f0 2024-03-26T06:17:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.847+0000 7f208c800640 1 Processor -- start 2024-03-26T06:17:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.847+0000 7f208c800640 1 -- start start 2024-03-26T06:17:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.848+0000 7fc943200640 1 -- 172.21.15.63:0/656107688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc93c0712f0 msgr2=0x7fc93c071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.848+0000 7fc943200640 1 --2- 172.21.15.63:0/656107688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc93c0712f0 0x7fc93c071780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc9280097a0 tx=0x7fc92802b860 comp rx=0 tx=0).stop 2024-03-26T06:17:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.848+0000 7fc943200640 1 -- 172.21.15.63:0/656107688 shutdown_connections 2024-03-26T06:17:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.848+0000 7fc943200640 1 --2- 172.21.15.63:0/656107688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc93c0cf550 0x7fc93c0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.848+0000 7fc943200640 1 --2- 172.21.15.63:0/656107688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc93c0712f0 0x7fc93c071780 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.848+0000 7fc943200640 1 -- 172.21.15.63:0/656107688 >> 172.21.15.63:0/656107688 conn(0x7fc93c06b0b0 msgr2=0x7fc93c06b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.848+0000 7fc943200640 1 -- 172.21.15.63:0/656107688 shutdown_connections 2024-03-26T06:17:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.849+0000 7fc943200640 1 -- 172.21.15.63:0/656107688 wait complete. 2024-03-26T06:17:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.849+0000 7f208c800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840b96e0 0x7f2084148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.849+0000 7f208c800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415dbb0 0x7f208414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.849+0000 7f208c800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f208415df90 0x7f208414c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.849+0000 7f208c800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840d0ae0 con 0x7f208415dbb0 2024-03-26T06:17:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.849+0000 7f208c800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840d0960 con 0x7f208415df90 2024-03-26T06:17:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.849+0000 7f208c800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20840d0c60 con 0x7f20840b96e0 2024-03-26T06:17:26.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.851+0000 7fc943200640 1 Processor -- start 2024-03-26T06:17:26.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.851+0000 7f2089e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840b96e0 0x7f2084148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.851+0000 7f2089400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415dbb0 0x7f208414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.851+0000 7f2089400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415dbb0 0x7f208414a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49962/0 (socket says 172.21.15.63:49962) 2024-03-26T06:17:26.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.851+0000 7f2089400640 1 -- 172.21.15.63:0/2820847578 learned_addr learned my addr 172.21.15.63:0/2820847578 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.851+0000 7f208a800640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f208415df90 0x7f208414c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.851+0000 7fc943200640 1 -- start start 2024-03-26T06:17:26.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.852+0000 7f2089400640 1 -- 172.21.15.63:0/2820847578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840b96e0 msgr2=0x7f2084148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.852+0000 7f2089400640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840b96e0 0x7f2084148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.852+0000 7f2089400640 1 -- 172.21.15.63:0/2820847578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f208415df90 msgr2=0x7f208414c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.853+0000 7f2089400640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f208415df90 0x7f208414c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.853+0000 7f2089400640 1 -- 172.21.15.63:0/2820847578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20841495b0 con 0x7f208415dbb0 2024-03-26T06:17:26.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.854+0000 7fc943200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc93c0712f0 0x7fc93c14c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.854+0000 7fc943200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc93c0cf550 0x7fc93c15bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.854+0000 7fc943200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc93c159d00 0x7fc93c15c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.854+0000 7f2089400640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415dbb0 0x7f208414a650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f207402bf70 tx=0x7f20740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.854+0000 7f8392400640 1 Processor -- start 2024-03-26T06:17:26.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.855+0000 7fc943200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c06f120 con 0x7fc93c0712f0 2024-03-26T06:17:26.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.855+0000 7fc93be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc93c0712f0 0x7fc93c14c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.855+0000 7fc93be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc93c0712f0 0x7fc93c14c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49978/0 (socket says 172.21.15.63:49978) 2024-03-26T06:17:26.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.855+0000 7fc93be00640 1 -- 172.21.15.63:0/3547210276 learned_addr learned my addr 172.21.15.63:0/3547210276 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.855+0000 7f8392400640 1 -- start start 2024-03-26T06:17:26.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.855+0000 7fc941200640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc93c159d00 0x7fc93c15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.855+0000 7fc943200640 1 -- 172.21.15.63:0/3547210276 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c06e510 con 0x7fc93c159d00 2024-03-26T06:17:26.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.855+0000 7fc943200640 1 -- 172.21.15.63:0/3547210276 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c06f2a0 con 0x7fc93c0cf550 2024-03-26T06:17:26.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.856+0000 7fc93be00640 1 -- 172.21.15.63:0/3547210276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc93c0cf550 msgr2=0x7fc93c15bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.856+0000 7fc93be00640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc93c0cf550 0x7fc93c15bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.856+0000 7fc93be00640 1 -- 172.21.15.63:0/3547210276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc93c159d00 msgr2=0x7fc93c15c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.856+0000 7fc93be00640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc93c159d00 0x7fc93c15c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.856+0000 7fc93be00640 1 -- 172.21.15.63:0/3547210276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c144770 con 0x7fc93c0712f0 2024-03-26T06:17:26.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.856+0000 7f207e000640 1 -- 172.21.15.63:0/2820847578 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074034040 con 0x7f208415dbb0 2024-03-26T06:17:26.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.856+0000 7f207e000640 1 -- 172.21.15.63:0/2820847578 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207403ad10 con 0x7f208415dbb0 2024-03-26T06:17:26.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.856+0000 7f207e000640 1 -- 172.21.15.63:0/2820847578 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074044630 con 0x7f208415dbb0 2024-03-26T06:17:26.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.856+0000 7fc93be00640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc93c0712f0 0x7fc93c14c9b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc92c001870 tx=0x7fc92c001d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.857+0000 7f8392400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f838c0b9320 0x7f838c1685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.857+0000 7f8392400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c0d22d0 con 0x7f838c0d3840 2024-03-26T06:17:26.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.857+0000 7f8392400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c0d25b0 con 0x7f838c15dca0 2024-03-26T06:17:26.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.857+0000 7f8392400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838c0d2070 con 0x7f838c0b9320 2024-03-26T06:17:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.857+0000 7f98bf400640 1 Processor -- start 2024-03-26T06:17:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.858+0000 7f98bf400640 1 -- start start 2024-03-26T06:17:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.858+0000 7fc933e00640 1 -- 172.21.15.63:0/3547210276 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0058b0 con 0x7fc93c0712f0 2024-03-26T06:17:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.858+0000 7fc933e00640 1 -- 172.21.15.63:0/3547210276 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c005a50 con 0x7fc93c0712f0 2024-03-26T06:17:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.858+0000 7fc933e00640 1 -- 172.21.15.63:0/3547210276 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c007070 con 0x7fc93c0712f0 2024-03-26T06:17:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.858+0000 7fc943200640 1 -- 172.21.15.63:0/3547210276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c15c9d0 con 0x7fc93c0712f0 2024-03-26T06:17:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.859+0000 7fc943200640 1 -- 172.21.15.63:0/3547210276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c15a840 con 0x7fc93c0712f0 2024-03-26T06:17:26.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.858+0000 7f8391a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f838c0b9320 0x7f838c1685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.858+0000 7f8391a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f838c0b9320 0x7f838c1685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49992/0 (socket says 172.21.15.63:49992) 2024-03-26T06:17:26.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.858+0000 7f8391a00640 1 -- 172.21.15.63:0/3712289217 learned_addr learned my addr 172.21.15.63:0/3712289217 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.859+0000 7f8391a00640 1 -- 172.21.15.63:0/3712289217 >> v1:172.21.15.204:6789/0 conn(0x7f838c15dca0 legacy=0x7f838c0d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.859+0000 7f8391a00640 1 -- 172.21.15.63:0/3712289217 >> v1:172.21.15.63:6789/0 conn(0x7f838c0d3840 legacy=0x7f838c0d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.859+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2084149890 con 0x7f208415dbb0 2024-03-26T06:17:26.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.859+0000 7faf3a400640 1 Processor -- start 2024-03-26T06:17:26.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.859+0000 7faf3a400640 1 -- start start 2024-03-26T06:17:26.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.860+0000 7f98bf400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b8165830 0x7f98b806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.860+0000 7f98bf400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98b80c4df0 0x7f98b806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.860+0000 7f98bf400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f98b806ccf0 0x7f98b8070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.859+0000 7f8391a00640 1 -- 172.21.15.63:0/3712289217 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c0d2890 con 0x7f838c0b9320 2024-03-26T06:17:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.860+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2084149e50 con 0x7f208415dbb0 2024-03-26T06:17:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.861+0000 7faf3a400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 0x7faf3415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.861+0000 7faf3a400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340cd640 con 0x7faf3406f5e0 2024-03-26T06:17:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.861+0000 7faf3a400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340b3c40 con 0x7faf340ce3c0 2024-03-26T06:17:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.861+0000 7faf3a400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340cdf30 con 0x7faf3406f200 2024-03-26T06:17:26.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.860+0000 7f98bf400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b80cbfb0 con 0x7f98b80c4df0 2024-03-26T06:17:26.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7faf33400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 0x7faf3415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7faf33e00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7faf340ce3c0 0x7faf340ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:42572/0 (socket says 172.21.15.63:42572) 2024-03-26T06:17:26.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7faf33e00640 1 -- 172.21.15.63:0/667150571 learned_addr learned my addr 172.21.15.63:0/667150571 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:26.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.860+0000 7f98bf400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b80d02b0 con 0x7f98b806ccf0 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.860+0000 7f98bf400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80b0d80 con 0x7f98b8165830 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.861+0000 7f98b7e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98b80c4df0 0x7f98b806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.861+0000 7f98b7e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98b80c4df0 0x7f98b806c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49998/0 (socket says 172.21.15.63:49998) 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.861+0000 7f98b7e00640 1 -- 172.21.15.63:0/2661228187 learned_addr learned my addr 172.21.15.63:0/2661228187 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7f98bca00640 1 --2- 172.21.15.63:0/2661228187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b8165830 0x7f98b806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7f98bd400640 1 --2- 172.21.15.63:0/2661228187 >> v2:172.21.15.204:3300/0 conn(0x7f98b806ccf0 0x7f98b8070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7f98b7e00640 1 -- 172.21.15.63:0/2661228187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b8165830 msgr2=0x7f98b806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7f98b7e00640 1 --2- 172.21.15.63:0/2661228187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b8165830 0x7f98b806c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7f98b7e00640 1 -- 172.21.15.63:0/2661228187 >> v2:172.21.15.204:3300/0 conn(0x7f98b806ccf0 msgr2=0x7f98b8070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7f98b7e00640 1 --2- 172.21.15.63:0/2661228187 >> v2:172.21.15.204:3300/0 conn(0x7f98b806ccf0 0x7f98b8070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.862+0000 7f98b7e00640 1 -- 172.21.15.63:0/2661228187 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b80b1060 con 0x7f98b80c4df0 2024-03-26T06:17:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.863+0000 7fc931600640 1 -- 172.21.15.63:0/3547210276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c074730 con 0x7fc93c0712f0 2024-03-26T06:17:26.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.863+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2084074730 con 0x7f208415dbb0 2024-03-26T06:17:26.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.861+0000 7f612d400640 1 Processor -- start 2024-03-26T06:17:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.861+0000 7f612d400640 1 -- start start 2024-03-26T06:17:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.863+0000 7f612d400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f612815c660 0x7f612806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7f612d400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6128162470 0x7f61280b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7f612d400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f61280b2b50 0x7f61280712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7f612d400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61280b3c90 con 0x7f61280b2b50 2024-03-26T06:17:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7f612d400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6128162a30 con 0x7f612815c660 2024-03-26T06:17:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7f8391a00640 1 --2- 172.21.15.63:0/3712289217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c0b9320 0x7f838c1685c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8378009870 tx=0x7f837802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaeab086a062f7a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7f612d400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6128162d10 con 0x7f6128162470 2024-03-26T06:17:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7f6126800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f612815c660 0x7f612806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7f6126800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f612815c660 0x7f612806e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43888/0 (socket says 172.21.15.63:43888) 2024-03-26T06:17:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7f6126800640 1 -- 172.21.15.63:0/2356085311 learned_addr learned my addr 172.21.15.63:0/2356085311 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f6125e00640 1 --2- 172.21.15.63:0/2356085311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6128162470 0x7f61280b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7fc933e00640 1 -- 172.21.15.63:0/3547210276 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc92c00e2e0 con 0x7fc93c0712f0 2024-03-26T06:17:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f98b7e00640 1 --2- 172.21.15.63:0/2661228187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 0x7f98b806c7b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f98b80c4710 tx=0x7f98a402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befd9ac6fb85639f server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f6127200640 1 --2- 172.21.15.63:0/2356085311 >> v2:172.21.15.63:3300/0 conn(0x7f61280b2b50 0x7f61280712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f6126800640 1 -- 172.21.15.63:0/2356085311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6128162470 msgr2=0x7f61280b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f6126800640 1 --2- 172.21.15.63:0/2356085311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6128162470 0x7f61280b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f6126800640 1 -- 172.21.15.63:0/2356085311 >> v2:172.21.15.63:3300/0 conn(0x7f61280b2b50 msgr2=0x7f61280712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7faf33400640 1 -- 172.21.15.63:0/667150571 >> v1:172.21.15.204:6789/0 conn(0x7faf340ce3c0 legacy=0x7faf340ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7faf33400640 1 -- 172.21.15.63:0/667150571 >> v1:172.21.15.63:6789/0 conn(0x7faf3406f5e0 legacy=0x7faf340b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.864+0000 7faf33400640 1 -- 172.21.15.63:0/667150571 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340b3f10 con 0x7faf3406f200 2024-03-26T06:17:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f98b7400640 1 -- 172.21.15.63:0/2661228187 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4035020 con 0x7f98b80c4df0 2024-03-26T06:17:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f207e000640 1 -- 172.21.15.63:0/2820847578 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2074037070 con 0x7f208415dbb0 2024-03-26T06:17:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f6126800640 1 --2- 172.21.15.63:0/2356085311 >> v2:172.21.15.63:3300/0 conn(0x7f61280b2b50 0x7f61280712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f6126800640 1 -- 172.21.15.63:0/2356085311 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6128162ff0 con 0x7f612815c660 2024-03-26T06:17:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.865+0000 7f6127200640 1 --2- 172.21.15.63:0/2356085311 >> v2:172.21.15.63:3300/0 conn(0x7f61280b2b50 0x7f61280712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.866+0000 7f838b400640 1 -- 172.21.15.63:0/3712289217 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378034070 con 0x7f838c0b9320 2024-03-26T06:17:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.866+0000 7faf33400640 1 --2- 172.21.15.63:0/667150571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 0x7faf3415ab80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0097d0 tx=0x7faf1c02dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572e0805c16ac3c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.866+0000 7fc933e00640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc91c06bca0 0x7fc91c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.867+0000 7faf32000640 1 -- 172.21.15.63:0/667150571 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c02f870 con 0x7faf3406f200 2024-03-26T06:17:26.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.867+0000 7faf32000640 1 -- 172.21.15.63:0/667150571 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c02fa10 con 0x7faf3406f200 2024-03-26T06:17:26.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.867+0000 7faf32000640 1 -- 172.21.15.63:0/667150571 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c02fde0 con 0x7faf3406f200 2024-03-26T06:17:26.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.867+0000 7fc933e00640 1 -- 172.21.15.63:0/3547210276 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc92c08e7f0 con 0x7fc93c0712f0 2024-03-26T06:17:26.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.867+0000 7f207e000640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f206806bc20 0x7f206806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.867+0000 7fc93b400640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc91c06bca0 0x7fc91c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7faf3a400640 1 -- 172.21.15.63:0/667150571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 msgr2=0x7faf3415ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7faf3a400640 1 --2- 172.21.15.63:0/667150571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 0x7faf3415ab80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0097d0 tx=0x7faf1c02dab0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.867+0000 7f6126800640 1 --2- 172.21.15.63:0/2356085311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f612815c660 0x7f612806e800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61280cfe20 tx=0x7f611802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf19967355b08d server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7faf3a400640 1 -- 172.21.15.63:0/667150571 shutdown_connections 2024-03-26T06:17:26.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7faf3a400640 1 --2- 172.21.15.63:0/667150571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 0x7faf3415ab80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7faf3a400640 1 -- 172.21.15.63:0/667150571 >> 172.21.15.63:0/667150571 conn(0x7faf3406b0b0 msgr2=0x7faf3406b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:26.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7f207e000640 1 -- 172.21.15.63:0/2820847578 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f20740acd00 con 0x7f208415dbb0 2024-03-26T06:17:26.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7f6125400640 1 -- 172.21.15.63:0/2356085311 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118035020 con 0x7f612815c660 2024-03-26T06:17:26.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7f6125400640 1 -- 172.21.15.63:0/2356085311 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118031870 con 0x7f612815c660 2024-03-26T06:17:26.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7f6125400640 1 -- 172.21.15.63:0/2356085311 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118031c40 con 0x7f612815c660 2024-03-26T06:17:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7f2089e00640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f206806bc20 0x7f206806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7fc93b400640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc91c06bca0 0x7fc91c06e160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc928036000 tx=0x7fc928030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7faf3a400640 1 -- 172.21.15.63:0/667150571 shutdown_connections 2024-03-26T06:17:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.868+0000 7faf3a400640 1 -- 172.21.15.63:0/667150571 wait complete. 2024-03-26T06:17:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.869+0000 7f2089e00640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f206806bc20 0x7f206806e0e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2080001db0 tx=0x7f2080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.869+0000 7f612d400640 1 -- 172.21.15.63:0/2356085311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f612815c660 msgr2=0x7f612806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.869+0000 7f612d400640 1 --2- 172.21.15.63:0/2356085311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f612815c660 0x7f612806e800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61280cfe20 tx=0x7f611802b910 comp rx=0 tx=0).stop 2024-03-26T06:17:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.869+0000 7f612d400640 1 -- 172.21.15.63:0/2356085311 shutdown_connections 2024-03-26T06:17:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.869+0000 7f612d400640 1 --2- 172.21.15.63:0/2356085311 >> v2:172.21.15.63:3300/0 conn(0x7f61280b2b50 0x7f61280712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.869+0000 7f612d400640 1 --2- 172.21.15.63:0/2356085311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6128162470 0x7f61280b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.869+0000 7f612d400640 1 --2- 172.21.15.63:0/2356085311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f612815c660 0x7f612806e800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.869+0000 7f612d400640 1 -- 172.21.15.63:0/2356085311 >> 172.21.15.63:0/2356085311 conn(0x7f612806b0b0 msgr2=0x7f612806b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.870+0000 7f612d400640 1 -- 172.21.15.63:0/2356085311 shutdown_connections 2024-03-26T06:17:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.870+0000 7f612d400640 1 -- 172.21.15.63:0/2356085311 wait complete. 2024-03-26T06:17:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.871+0000 7faf3a400640 1 Processor -- start 2024-03-26T06:17:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.871+0000 7faf3a400640 1 -- start start 2024-03-26T06:17:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.872+0000 7f612d400640 1 Processor -- start 2024-03-26T06:17:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.872+0000 7faf3a400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 0x7faf34150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.872+0000 7faf3a400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf3406f5e0 0x7faf34156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.872+0000 7f612d400640 1 -- start start 2024-03-26T06:17:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.873+0000 7faf3a400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf340ce3c0 0x7faf34156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.873+0000 7faf3a400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3406fa40 con 0x7faf3406f5e0 2024-03-26T06:17:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.873+0000 7faf3a400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340cdbc0 con 0x7faf340ce3c0 2024-03-26T06:17:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.873+0000 7faf3a400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b27d0 con 0x7faf3406f200 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.873+0000 7faf32a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf3406f5e0 0x7faf34156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.873+0000 7faf32a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf3406f5e0 0x7faf34156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50020/0 (socket says 172.21.15.63:50020) 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.873+0000 7faf32a00640 1 -- 172.21.15.63:0/2904702475 learned_addr learned my addr 172.21.15.63:0/2904702475 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.873+0000 7faf33400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 0x7faf34150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.873+0000 7faf33e00640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf340ce3c0 0x7faf34156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7faf32a00640 1 -- 172.21.15.63:0/2904702475 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 msgr2=0x7faf34150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7faf32a00640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 0x7faf34150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7faf32a00640 1 -- 172.21.15.63:0/2904702475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf340ce3c0 msgr2=0x7faf34156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7faf32a00640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf340ce3c0 0x7faf34156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7faf32a00640 1 -- 172.21.15.63:0/2904702475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340a8960 con 0x7faf3406f5e0 2024-03-26T06:17:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7f612d400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61280b2b50 0x7f61281612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7f612d400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f612815c660 0x7f612815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7f612d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6128162470 0x7f612815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7f612d400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128071830 con 0x7f6128162470 2024-03-26T06:17:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7f612d400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612806ed40 con 0x7f61280b2b50 2024-03-26T06:17:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7f612d400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280719b0 con 0x7f612815c660 2024-03-26T06:17:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.874+0000 7faf32a00640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf3406f5e0 0x7faf34156640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c410 tx=0x7faf2c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.875+0000 7f838b400640 1 -- 172.21.15.63:0/3712289217 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378030850 con 0x7f838c0b9320 2024-03-26T06:17:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.875+0000 7f838b400640 1 -- 172.21.15.63:0/3712289217 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378030c20 con 0x7f838c0b9320 2024-03-26T06:17:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.876+0000 7f98b7400640 1 -- 172.21.15.63:0/2661228187 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4031880 con 0x7f98b80c4df0 2024-03-26T06:17:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.876+0000 7f98b7400640 1 -- 172.21.15.63:0/2661228187 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4031c50 con 0x7f98b80c4df0 2024-03-26T06:17:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.876+0000 7f8392400640 1 -- 172.21.15.63:0/3712289217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c0b9320 msgr2=0x7f838c1685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.876+0000 7f8392400640 1 --2- 172.21.15.63:0/3712289217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c0b9320 0x7f838c1685c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8378009870 tx=0x7f837802b990 comp rx=0 tx=0).stop 2024-03-26T06:17:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.876+0000 7f6125e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f612815c660 0x7f612815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.876+0000 7f6125e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f612815c660 0x7f612815ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47976/0 (socket says 172.21.15.63:47976) 2024-03-26T06:17:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.876+0000 7f6125e00640 1 -- 172.21.15.63:0/2728000237 learned_addr learned my addr 172.21.15.63:0/2728000237 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f98bf400640 1 -- 172.21.15.63:0/2661228187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 msgr2=0x7f98b806c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f98bf400640 1 --2- 172.21.15.63:0/2661228187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 0x7f98b806c7b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f98b80c4710 tx=0x7f98a402b920 comp rx=0 tx=0).stop 2024-03-26T06:17:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7fc933e00640 1 -- 172.21.15.63:0/3547210276 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc93c144770 con 0x7fc93c0712f0 2024-03-26T06:17:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f98bf400640 1 -- 172.21.15.63:0/2661228187 shutdown_connections 2024-03-26T06:17:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f98bf400640 1 --2- 172.21.15.63:0/2661228187 >> v2:172.21.15.204:3300/0 conn(0x7f98b806ccf0 0x7f98b8070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f98bf400640 1 --2- 172.21.15.63:0/2661228187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 0x7f98b806c7b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f98bf400640 1 --2- 172.21.15.63:0/2661228187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b8165830 0x7f98b806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f98bf400640 1 -- 172.21.15.63:0/2661228187 >> 172.21.15.63:0/2661228187 conn(0x7f98b806f630 msgr2=0x7f98b806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f8392400640 1 -- 172.21.15.63:0/3712289217 shutdown_connections 2024-03-26T06:17:26.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f8392400640 1 --2- 172.21.15.63:0/3712289217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c0b9320 0x7f838c1685c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f8392400640 1 -- 172.21.15.63:0/3712289217 >> 172.21.15.63:0/3712289217 conn(0x7f838c06c570 msgr2=0x7f838c06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:26.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.879+0000 7f98bf400640 1 -- 172.21.15.63:0/2661228187 shutdown_connections 2024-03-26T06:17:26.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.879+0000 7f98bf400640 1 -- 172.21.15.63:0/2661228187 wait complete. 2024-03-26T06:17:26.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.877+0000 7f6126800640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61280b2b50 0x7f61281612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.878+0000 7f6127200640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6128162470 0x7f612815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.878+0000 7f6127200640 1 -- 172.21.15.63:0/2728000237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f612815c660 msgr2=0x7f612815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.878+0000 7f6127200640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f612815c660 0x7f612815ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.878+0000 7f6127200640 1 -- 172.21.15.63:0/2728000237 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61280b2b50 msgr2=0x7f61281612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.878+0000 7f6127200640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61280b2b50 0x7f61281612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.878+0000 7f6127200640 1 -- 172.21.15.63:0/2728000237 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61281edf80 con 0x7f6128162470 2024-03-26T06:17:26.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.881+0000 7f98bf400640 1 Processor -- start 2024-03-26T06:17:26.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.882+0000 7f98bf400640 1 -- start start 2024-03-26T06:17:26.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.881+0000 7f6127200640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6128162470 0x7f612815cf80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6120007d10 tx=0x7f612000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.883+0000 7f98bf400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b806ccf0 0x7f98b81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.883+0000 7f98bf400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 0x7f98b815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.883+0000 7f98bf400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98b8165830 0x7f98b80ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.883+0000 7f98bf400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80714e0 con 0x7f98b80c4df0 2024-03-26T06:17:26.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.883+0000 7f98bf400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8071360 con 0x7f98b8165830 2024-03-26T06:17:26.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.883+0000 7f98bf400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8071660 con 0x7f98b806ccf0 2024-03-26T06:17:26.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.879+0000 7f8392400640 1 -- 172.21.15.63:0/3712289217 shutdown_connections 2024-03-26T06:17:26.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.880+0000 7f8392400640 1 -- 172.21.15.63:0/3712289217 wait complete. 2024-03-26T06:17:26.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.882+0000 7f8392400640 1 Processor -- start 2024-03-26T06:17:26.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.884+0000 7f8392400640 1 -- start start 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.884+0000 7f98bca00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b806ccf0 0x7f98b81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.884+0000 7f98bca00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b806ccf0 0x7f98b81581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:47990/0 (socket says 172.21.15.63:47990) 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.884+0000 7f98bca00640 1 -- 172.21.15.63:0/3018982280 learned_addr learned my addr 172.21.15.63:0/3018982280 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.885+0000 7f98b7e00640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 0x7f98b815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.885+0000 7f98b7e00640 1 -- 172.21.15.63:0/3018982280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b806ccf0 msgr2=0x7f98b81581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.885+0000 7f98b7e00640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b806ccf0 0x7f98b81581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.885+0000 7f98b7e00640 1 -- 172.21.15.63:0/3018982280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98b8165830 msgr2=0x7f98b80ca980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.885+0000 7f98b7e00640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98b8165830 0x7f98b80ca980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.885+0000 7f98b7e00640 1 -- 172.21.15.63:0/3018982280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b8157a00 con 0x7f98b80c4df0 2024-03-26T06:17:26.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f8392400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f838c0b9320 0x7f838c14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f98b7e00640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 0x7f98b815ae70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f98a4033000 tx=0x7f98a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f8392400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f838c0d3840 0x7f838c0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f8392400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c15dca0 0x7f838c14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f8392400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0d3370 con 0x7f838c15dca0 2024-03-26T06:17:26.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f8392400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0d2e50 con 0x7f838c0b9320 2024-03-26T06:17:26.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f8392400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0d34f0 con 0x7f838c0d3840 2024-03-26T06:17:26.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f611ea00640 1 -- 172.21.15.63:0/2728000237 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612001a070 con 0x7f6128162470 2024-03-26T06:17:26.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f611ea00640 1 -- 172.21.15.63:0/2728000237 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120003990 con 0x7f6128162470 2024-03-26T06:17:26.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f611ea00640 1 -- 172.21.15.63:0/2728000237 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120003d60 con 0x7f6128162470 2024-03-26T06:17:26.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f8391000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f838c0b9320 0x7f838c14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6128146500 con 0x7f6128162470 2024-03-26T06:17:26.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128161830 con 0x7f6128162470 2024-03-26T06:17:26.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f8391000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f838c0b9320 0x7f838c14e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:43902/0 (socket says 172.21.15.63:43902) 2024-03-26T06:17:26.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.886+0000 7f8391000640 1 -- 172.21.15.63:0/674219916 learned_addr learned my addr 172.21.15.63:0/674219916 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:26.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.887+0000 7f207e000640 1 -- 172.21.15.63:0/2820847578 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f20740b0030 con 0x7f208415dbb0 2024-03-26T06:17:26.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.887+0000 7f838be00640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f838c0d3840 0x7f838c0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.887+0000 7f8391a00640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c15dca0 0x7f838c14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.887+0000 7faf2b400640 1 -- 172.21.15.63:0/2904702475 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c017070 con 0x7faf3406f5e0 2024-03-26T06:17:26.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.887+0000 7faf2b400640 1 -- 172.21.15.63:0/2904702475 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0035f0 con 0x7faf3406f5e0 2024-03-26T06:17:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.887+0000 7faf2b400640 1 -- 172.21.15.63:0/2904702475 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0039e0 con 0x7faf3406f5e0 2024-03-26T06:17:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.887+0000 7f98b4c00640 1 -- 172.21.15.63:0/3018982280 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a403ad60 con 0x7f98b80c4df0 2024-03-26T06:17:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f98b4c00640 1 -- 172.21.15.63:0/3018982280 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a40443f0 con 0x7f98b80c4df0 2024-03-26T06:17:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f98b4c00640 1 -- 172.21.15.63:0/3018982280 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40447e0 con 0x7f98b80c4df0 2024-03-26T06:17:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b80c9990 con 0x7f98b80c4df0 2024-03-26T06:17:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b80c9f50 con 0x7f98b80c4df0 2024-03-26T06:17:26.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f8391a00640 1 -- 172.21.15.63:0/674219916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f838c0d3840 msgr2=0x7f838c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f8391a00640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f838c0d3840 0x7f838c0c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f8391a00640 1 -- 172.21.15.63:0/674219916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f838c0b9320 msgr2=0x7f838c14e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:26.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f8391a00640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f838c0b9320 0x7f838c14e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:26.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f8391a00640 1 -- 172.21.15.63:0/674219916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c0c9490 con 0x7f838c15dca0 2024-03-26T06:17:26.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.888+0000 7f8391a00640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c15dca0 0x7f838c14b0e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f838c0d4660 tx=0x7f83780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.890+0000 7f8388c00640 1 -- 172.21.15.63:0/674219916 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378034040 con 0x7f838c15dca0 2024-03-26T06:17:26.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.890+0000 7f8388c00640 1 -- 172.21.15.63:0/674219916 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83780433f0 con 0x7f838c15dca0 2024-03-26T06:17:26.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.890+0000 7f8388c00640 1 -- 172.21.15.63:0/674219916 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780437e0 con 0x7f838c15dca0 2024-03-26T06:17:26.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.890+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf340a8c40 con 0x7faf3406f5e0 2024-03-26T06:17:26.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.890+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf340a9200 con 0x7faf3406f5e0 2024-03-26T06:17:26.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.890+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838c0c9770 con 0x7f838c15dca0 2024-03-26T06:17:26.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.890+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c0c7330 con 0x7f838c15dca0 2024-03-26T06:17:26.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.891+0000 7f611ea00640 1 -- 172.21.15.63:0/2728000237 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f612001d070 con 0x7f6128162470 2024-03-26T06:17:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.891+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6100005290 con 0x7f6128162470 2024-03-26T06:17:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.892+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf34074730 con 0x7faf3406f5e0 2024-03-26T06:17:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.892+0000 7f611ea00640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f610806bca0 0x7f610806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.892+0000 7f611ea00640 1 -- 172.21.15.63:0/2728000237 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f612008ae50 con 0x7f6128162470 2024-03-26T06:17:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.893+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b80b2400 con 0x7f98b80c4df0 2024-03-26T06:17:26.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.893+0000 7f6126800640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f610806bca0 0x7f610806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.895+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c04f0c0 con 0x7f838c15dca0 2024-03-26T06:17:26.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.895+0000 7f6126800640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f610806bca0 0x7f610806e160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6118036000 tx=0x7f611803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.896+0000 7f8388c00640 1 -- 172.21.15.63:0/674219916 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8378037070 con 0x7f838c15dca0 2024-03-26T06:17:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.897+0000 7faf2b400640 1 -- 172.21.15.63:0/2904702475 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7faf2c01a070 con 0x7faf3406f5e0 2024-03-26T06:17:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.897+0000 7f8388c00640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f836c06bc20 0x7f836c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.898+0000 7f8391000640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f836c06bc20 0x7f836c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.898+0000 7faf2b400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf1006bc50 0x7faf1006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.898+0000 7faf2b400640 1 -- 172.21.15.63:0/2904702475 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faf2c08a0c0 con 0x7faf3406f5e0 2024-03-26T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.898+0000 7f98b4c00640 1 -- 172.21.15.63:0/3018982280 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f98a404b060 con 0x7f98b80c4df0 2024-03-26T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.899+0000 7f98b4c00640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f989806bc20 0x7f989806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.899+0000 7faf33400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf1006bc50 0x7faf1006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.900+0000 7f8391000640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f836c06bc20 0x7f836c06e0e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8384001f90 tx=0x7f8384009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.900+0000 7f98bca00640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f989806bc20 0x7f989806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:26.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.900+0000 7faf33400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf1006bc50 0x7faf1006e110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf1c038000 tx=0x7faf1c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.901+0000 7f98b4c00640 1 -- 172.21.15.63:0/3018982280 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f98a404edf0 con 0x7f98b80c4df0 2024-03-26T06:17:26.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.901+0000 7f98bca00640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f989806bc20 0x7f989806e0e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98b0003aa0 tx=0x7f98b00098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:26.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.901+0000 7f8388c00640 1 -- 172.21.15.63:0/674219916 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8378079110 con 0x7f838c15dca0 2024-03-26T06:17:26.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.902+0000 7f611ea00640 1 -- 172.21.15.63:0/2728000237 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f6120010070 con 0x7f6128162470 2024-03-26T06:17:26.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.909+0000 7faf2b400640 1 -- 172.21.15.63:0/2904702475 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7faf2c058300 con 0x7faf3406f5e0 2024-03-26T06:17:26.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.918+0000 7f98b4c00640 1 -- 172.21.15.63:0/3018982280 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f98a403f070 con 0x7f98b80c4df0 2024-03-26T06:17:26.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:26.927+0000 7f8388c00640 1 -- 172.21.15.63:0/674219916 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f837803e070 con 0x7f838c15dca0 2024-03-26T06:17:27.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.234+0000 7f415fe00640 1 -- 172.21.15.63:0/2884237443 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4158056bf0 con 0x7f41580e3160 2024-03-26T06:17:27.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.235+0000 7f4156a00640 1 -- 172.21.15.63:0/2884237443 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f416006ce20 con 0x7f41580e3160 2024-03-26T06:17:27.238 INFO:teuthology.orchestra.run.smithi063.stdout:55834574859 2024-03-26T06:17:27.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.239+0000 7f414be00640 1 -- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f414006bc20 msgr2=0x7f414006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.239+0000 7f414be00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f414006bc20 0x7f414006e0e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f41500090b0 tx=0x7f4150008030 comp rx=0 tx=0).stop 2024-03-26T06:17:27.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.240+0000 7f414be00640 1 -- 172.21.15.63:0/2884237443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41580e3160 msgr2=0x7f415816e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.240+0000 7f414be00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41580e3160 0x7f415816e0f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f416004fe00 tx=0x7f41600734b0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.240+0000 7f414be00640 1 -- 172.21.15.63:0/2884237443 shutdown_connections 2024-03-26T06:17:27.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.240+0000 7f414be00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f414006bc20 0x7f414006e0e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.241+0000 7f414be00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41580e3160 0x7f415816e0f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.241+0000 7f414be00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4158053cb0 0x7f4158051a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.241+0000 7f414be00640 1 --2- 172.21.15.63:0/2884237443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f415803c0a0 0x7f41580d7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.241+0000 7f414be00640 1 -- 172.21.15.63:0/2884237443 >> 172.21.15.63:0/2884237443 conn(0x7f4158058ee0 msgr2=0x7f4158058030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.241+0000 7f414be00640 1 -- 172.21.15.63:0/2884237443 shutdown_connections 2024-03-26T06:17:27.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.242+0000 7f414be00640 1 -- 172.21.15.63:0/2884237443 wait complete. 2024-03-26T06:17:27.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.255+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa778005850 con 0x7fa7a00cad10 2024-03-26T06:17:27.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.257+0000 7fa797400640 1 -- 172.21.15.63:0/1817602038 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa798061520 con 0x7fa7a00cad10 2024-03-26T06:17:27.257 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.260+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa78006bbd0 msgr2=0x7fa78006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.260+0000 7fa7a6200640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa78006bbd0 0x7fa78006e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa790036000 tx=0x7fa79003b040 comp rx=0 tx=0).stop 2024-03-26T06:17:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.260+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cad10 msgr2=0x7fa7a00afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.260+0000 7fa7a6200640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cad10 0x7fa7a00afb50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7980021c0 tx=0x7fa7980021f0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.261+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 shutdown_connections 2024-03-26T06:17:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.261+0000 7fa7a6200640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa78006bbd0 0x7fa78006e090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.261+0000 7fa7a6200640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a00cc8a0 0x7fa7a0150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.261+0000 7fa7a6200640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a00cc060 0x7fa7a00b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.261+0000 7fa7a6200640 1 --2- 172.21.15.63:0/1817602038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7a00cad10 0x7fa7a00afb50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.261+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 >> 172.21.15.63:0/1817602038 conn(0x7fa7a00b2250 msgr2=0x7fa7a00c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.262+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 shutdown_connections 2024-03-26T06:17:27.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.262+0000 7fa7a6200640 1 -- 172.21.15.63:0/1817602038 wait complete. 2024-03-26T06:17:27.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-03-26T06:17:27.271 DEBUG:teuthology.parallel:result is None 2024-03-26T06:17:27.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-03-26T06:17:27.284 DEBUG:teuthology.parallel:result is None 2024-03-26T06:17:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.330+0000 7fc931600640 1 -- 172.21.15.63:0/3547210276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc93c0cce50 con 0x7fc93c0712f0 2024-03-26T06:17:27.332 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-03-26T06:17:27.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.332+0000 7fc933e00640 1 -- 172.21.15.63:0/3547210276 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc92c05d010 con 0x7fc93c0712f0 2024-03-26T06:17:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 -- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc91c06bca0 msgr2=0x7fc91c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc91c06bca0 0x7fc91c06e160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc928036000 tx=0x7fc928030000 comp rx=0 tx=0).stop 2024-03-26T06:17:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 -- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc93c0712f0 msgr2=0x7fc93c14c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc93c0712f0 0x7fc93c14c9b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc92c001870 tx=0x7fc92c001d30 comp rx=0 tx=0).stop 2024-03-26T06:17:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 -- 172.21.15.63:0/3547210276 shutdown_connections 2024-03-26T06:17:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc91c06bca0 0x7fc91c06e160 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc93c159d00 0x7fc93c15c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc93c0cf550 0x7fc93c15bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 --2- 172.21.15.63:0/3547210276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc93c0712f0 0x7fc93c14c9b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 -- 172.21.15.63:0/3547210276 >> 172.21.15.63:0/3547210276 conn(0x7fc93c06b0b0 msgr2=0x7fc93c06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.335+0000 7fc931600640 1 -- 172.21.15.63:0/3547210276 shutdown_connections 2024-03-26T06:17:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.336+0000 7fc931600640 1 -- 172.21.15.63:0/3547210276 wait complete. 2024-03-26T06:17:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.337+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f20840b6690 con 0x7f208415dbb0 2024-03-26T06:17:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.338+0000 7f207e000640 1 -- 172.21.15.63:0/2820847578 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f207403f070 con 0x7f208415dbb0 2024-03-26T06:17:27.338 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f206806bc20 msgr2=0x7f206806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f206806bc20 0x7f206806e0e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2080001db0 tx=0x7f2080009040 comp rx=0 tx=0).stop 2024-03-26T06:17:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415dbb0 msgr2=0x7f208414a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415dbb0 0x7f208414a650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f207402bf70 tx=0x7f20740046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6100005580 con 0x7f6128162470 2024-03-26T06:17:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 shutdown_connections 2024-03-26T06:17:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f206806bc20 0x7f206806e0e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f208415df90 0x7f208414c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f208415dbb0 0x7f208414a650 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 --2- 172.21.15.63:0/2820847578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840b96e0 0x7f2084148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.342+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 >> 172.21.15.63:0/2820847578 conn(0x7f20840b5540 msgr2=0x7f20840b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.343+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 shutdown_connections 2024-03-26T06:17:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.343+0000 7f208c800640 1 -- 172.21.15.63:0/2820847578 wait complete. 2024-03-26T06:17:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.343+0000 7f611ea00640 1 -- 172.21.15.63:0/2728000237 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6120058f90 con 0x7f6128162470 2024-03-26T06:17:27.344 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:27.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.347+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f610806bca0 msgr2=0x7f610806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.347+0000 7f612d400640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f610806bca0 0x7f610806e160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6118036000 tx=0x7f611803c040 comp rx=0 tx=0).stop 2024-03-26T06:17:27.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.347+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6128162470 msgr2=0x7f612815cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.347+0000 7f612d400640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6128162470 0x7f612815cf80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6120007d10 tx=0x7f612000d4a0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.348+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 shutdown_connections 2024-03-26T06:17:27.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.348+0000 7f612d400640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f610806bca0 0x7f610806e160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.348+0000 7f612d400640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6128162470 0x7f612815cf80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.348+0000 7f612d400640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f612815c660 0x7f612815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.348+0000 7f612d400640 1 --2- 172.21.15.63:0/2728000237 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61280b2b50 0x7f61281612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.348+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 >> 172.21.15.63:0/2728000237 conn(0x7f612806b0b0 msgr2=0x7f612806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.348+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 shutdown_connections 2024-03-26T06:17:27.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.348+0000 7f612d400640 1 -- 172.21.15.63:0/2728000237 wait complete. 2024-03-26T06:17:27.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.349+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faf340b0b00 con 0x7faf3406f5e0 2024-03-26T06:17:27.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.351+0000 7faf2b400640 1 -- 172.21.15.63:0/2904702475 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf2c05c3a0 con 0x7faf3406f5e0 2024-03-26T06:17:27.351 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-03-26T06:17:27.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.354+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf1006bc50 msgr2=0x7faf1006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.354+0000 7faf3a400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf1006bc50 0x7faf1006e110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf1c038000 tx=0x7faf1c008030 comp rx=0 tx=0).stop 2024-03-26T06:17:27.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.354+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf3406f5e0 msgr2=0x7faf34156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.354+0000 7faf3a400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf3406f5e0 0x7faf34156640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c410 tx=0x7faf2c00c8d0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.355+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 shutdown_connections 2024-03-26T06:17:27.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.355+0000 7faf3a400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf1006bc50 0x7faf1006e110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.355+0000 7faf3a400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf340ce3c0 0x7faf34156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.355+0000 7faf3a400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf3406f5e0 0x7faf34156640 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.355+0000 7faf3a400640 1 --2- 172.21.15.63:0/2904702475 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf3406f200 0x7faf34150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.355+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 >> 172.21.15.63:0/2904702475 conn(0x7faf3406b0b0 msgr2=0x7faf341537e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.356+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 shutdown_connections 2024-03-26T06:17:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.356+0000 7faf3a400640 1 -- 172.21.15.63:0/2904702475 wait complete. 2024-03-26T06:17:27.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-03-26T06:17:27.358 DEBUG:teuthology.parallel:result is None 2024-03-26T06:17:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.359+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f98b806c960 con 0x7f98b80c4df0 2024-03-26T06:17:27.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.360+0000 7f98b4c00640 1 -- 172.21.15.63:0/3018982280 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98a407b700 con 0x7f98b80c4df0 2024-03-26T06:17:27.360 INFO:teuthology.orchestra.run.smithi063.stdout:55834574859 2024-03-26T06:17:27.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.362+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f989806bc20 msgr2=0x7f989806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.362+0000 7f98bf400640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f989806bc20 0x7f989806e0e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98b0003aa0 tx=0x7f98b00098d0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.362+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 msgr2=0x7f98b815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.362+0000 7f98bf400640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 0x7f98b815ae70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f98a4033000 tx=0x7f98a40046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.363+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 shutdown_connections 2024-03-26T06:17:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.363+0000 7f98bf400640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f989806bc20 0x7f989806e0e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.363+0000 7f98bf400640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98b8165830 0x7f98b80ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.363+0000 7f98bf400640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98b80c4df0 0x7f98b815ae70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.363+0000 7f98bf400640 1 --2- 172.21.15.63:0/3018982280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98b806ccf0 0x7f98b81581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.363+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 >> 172.21.15.63:0/3018982280 conn(0x7f98b806f630 msgr2=0x7f98b80b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.363+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 shutdown_connections 2024-03-26T06:17:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.363+0000 7f98bf400640 1 -- 172.21.15.63:0/3018982280 wait complete. 2024-03-26T06:17:27.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.367+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f838c06ccd0 con 0x7f838c15dca0 2024-03-26T06:17:27.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.368+0000 7f8388c00640 1 -- 172.21.15.63:0/674219916 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f837807b070 con 0x7f838c15dca0 2024-03-26T06:17:27.368 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-03-26T06:17:27.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-03-26T06:17:27.371 DEBUG:teuthology.parallel:result is None 2024-03-26T06:17:27.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f836c06bc20 msgr2=0x7f836c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f836c06bc20 0x7f836c06e0e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8384001f90 tx=0x7f8384009040 comp rx=0 tx=0).stop 2024-03-26T06:17:27.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c15dca0 msgr2=0x7f838c14b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c15dca0 0x7f838c14b0e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f838c0d4660 tx=0x7f83780046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 shutdown_connections 2024-03-26T06:17:27.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f836c06bc20 0x7f836c06e0e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f838c15dca0 0x7f838c14b0e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f838c0d3840 0x7f838c0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 --2- 172.21.15.63:0/674219916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f838c0b9320 0x7f838c14e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 >> 172.21.15.63:0/674219916 conn(0x7f838c06c570 msgr2=0x7f838c158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 shutdown_connections 2024-03-26T06:17:27.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.372+0000 7f8392400640 1 -- 172.21.15.63:0/674219916 wait complete. 2024-03-26T06:17:27.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-03-26T06:17:27.377 DEBUG:teuthology.parallel:result is None 2024-03-26T06:17:27.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-03-26T06:17:27.381 DEBUG:teuthology.parallel:result is None 2024-03-26T06:17:27.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-03-26T06:17:27.383 DEBUG:teuthology.parallel:result is None 2024-03-26T06:17:27.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-03-26T06:17:27.389 DEBUG:teuthology.parallel:result is None 2024-03-26T06:17:27.389 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-26T06:17:27.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-26T06:17:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.629+0000 7f1e8be00640 1 Processor -- start 2024-03-26T06:17:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.629+0000 7f1e8be00640 1 -- start start 2024-03-26T06:17:27.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.631+0000 7f1e8be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1e8c0b2dc0 0x7f1e8c06ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:27.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.631+0000 7f1e8be00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c0d0140 con 0x7f1e8c15ca80 2024-03-26T06:17:27.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.631+0000 7f1e8be00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c15bfa0 con 0x7f1e8c0afa30 2024-03-26T06:17:27.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.631+0000 7f1e8be00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c15c5f0 con 0x7f1e8c0b2dc0 2024-03-26T06:17:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.631+0000 7f1e8b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1e8c0b2dc0 0x7f1e8c06ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.631+0000 7f1e8b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1e8c0b2dc0 0x7f1e8c06ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50070/0 (socket says 172.21.15.63:50070) 2024-03-26T06:17:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.631+0000 7f1e8b400640 1 -- 172.21.15.63:0/1999087097 learned_addr learned my addr 172.21.15.63:0/1999087097 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.632+0000 7f1e8b400640 1 -- 172.21.15.63:0/1999087097 >> v1:172.21.15.204:6789/0 conn(0x7f1e8c0afa30 legacy=0x7f1e8c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.632+0000 7f1e8b400640 1 -- 172.21.15.63:0/1999087097 >> v1:172.21.15.63:6789/0 conn(0x7f1e8c15ca80 legacy=0x7f1e8c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.632+0000 7f1e8b400640 1 -- 172.21.15.63:0/1999087097 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c15c280 con 0x7f1e8c0b2dc0 2024-03-26T06:17:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.633+0000 7f1e8b400640 1 --2- 172.21.15.63:0/1999087097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0b2dc0 0x7f1e8c06ac90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009e50 tx=0x7f1e8402c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f3e7e4fe2ce6fe server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.633+0000 7f1e8a000640 1 -- 172.21.15.63:0/1999087097 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8402cc30 con 0x7f1e8c0b2dc0 2024-03-26T06:17:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.634+0000 7f1e8a000640 1 -- 172.21.15.63:0/1999087097 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8402cdd0 con 0x7f1e8c0b2dc0 2024-03-26T06:17:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.634+0000 7f1e8a000640 1 -- 172.21.15.63:0/1999087097 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84034610 con 0x7f1e8c0b2dc0 2024-03-26T06:17:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.634+0000 7f1e8be00640 1 -- 172.21.15.63:0/1999087097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0b2dc0 msgr2=0x7f1e8c06ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.634+0000 7f1e8be00640 1 --2- 172.21.15.63:0/1999087097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0b2dc0 0x7f1e8c06ac90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009e50 tx=0x7f1e8402c090 comp rx=0 tx=0).stop 2024-03-26T06:17:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.634+0000 7f1e8be00640 1 -- 172.21.15.63:0/1999087097 shutdown_connections 2024-03-26T06:17:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.634+0000 7f1e8be00640 1 --2- 172.21.15.63:0/1999087097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0b2dc0 0x7f1e8c06ac90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.634+0000 7f1e8be00640 1 -- 172.21.15.63:0/1999087097 >> 172.21.15.63:0/1999087097 conn(0x7f1e8c099a70 msgr2=0x7f1e8c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.635+0000 7f1e8be00640 1 -- 172.21.15.63:0/1999087097 shutdown_connections 2024-03-26T06:17:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.635+0000 7f1e8be00640 1 -- 172.21.15.63:0/1999087097 wait complete. 2024-03-26T06:17:27.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.636+0000 7f1e8be00640 1 Processor -- start 2024-03-26T06:17:27.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.636+0000 7f1e8be00640 1 -- start start 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.637+0000 7f1e8be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0afa30 0x7f1e8c1f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.637+0000 7f1e8be00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e8c0b2dc0 0x7f1e8c0c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.637+0000 7f1e8be00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e8c15ca80 0x7f1e8c0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.637+0000 7f1e8be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c070180 con 0x7f1e8c0afa30 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.637+0000 7f1e8be00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c070000 con 0x7f1e8c0b2dc0 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.637+0000 7f1e8be00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0ae330 con 0x7f1e8c15ca80 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.637+0000 7f1e8aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0afa30 0x7f1e8c1f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e8aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0afa30 0x7f1e8c1f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50084/0 (socket says 172.21.15.63:50084) 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e8aa00640 1 -- 172.21.15.63:0/3105570888 learned_addr learned my addr 172.21.15.63:0/3105570888 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e8b400640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e8c15ca80 0x7f1e8c0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e83e00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e8c0b2dc0 0x7f1e8c0c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e8aa00640 1 -- 172.21.15.63:0/3105570888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e8c15ca80 msgr2=0x7f1e8c0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e8aa00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e8c15ca80 0x7f1e8c0c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e8aa00640 1 -- 172.21.15.63:0/3105570888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e8c0b2dc0 msgr2=0x7f1e8c0c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e8aa00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e8c0b2dc0 0x7f1e8c0c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e8aa00640 1 -- 172.21.15.63:0/3105570888 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c0ada40 con 0x7f1e8c0afa30 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.638+0000 7f1e8aa00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0afa30 0x7f1e8c1f3ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00c3c0 tx=0x7f1e7c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.639+0000 7f1e82a00640 1 -- 172.21.15.63:0/3105570888 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0052d0 con 0x7f1e8c0afa30 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.639+0000 7f1e82a00640 1 -- 172.21.15.63:0/3105570888 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c005490 con 0x7f1e8c0afa30 2024-03-26T06:17:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.639+0000 7f1e82a00640 1 -- 172.21.15.63:0/3105570888 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c007260 con 0x7f1e8c0afa30 2024-03-26T06:17:27.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.639+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c0c6c00 con 0x7f1e8c0afa30 2024-03-26T06:17:27.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.639+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c0adfc0 con 0x7f1e8c0afa30 2024-03-26T06:17:27.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.640+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c04f050 con 0x7f1e8c0afa30 2024-03-26T06:17:27.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.641+0000 7f1e82a00640 1 -- 172.21.15.63:0/3105570888 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1e7c007400 con 0x7f1e8c0afa30 2024-03-26T06:17:27.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.642+0000 7f1e82a00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1e6806bbd0 0x7f1e6806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:27.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.642+0000 7f1e82a00640 1 -- 172.21.15.63:0/3105570888 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1e7c08a330 con 0x7f1e8c0afa30 2024-03-26T06:17:27.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.642+0000 7f1e83e00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1e6806bbd0 0x7f1e6806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:27.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.642+0000 7f1e83e00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1e6806bbd0 0x7f1e6806e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0ca030 tx=0x7f1e74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:27.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.650+0000 7f1e82a00640 1 -- 172.21.15.63:0/3105570888 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1e7c058a40 con 0x7f1e8c0afa30 2024-03-26T06:17:27.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.842+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 --> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e8c072ee0 con 0x7f1e6806bbd0 2024-03-26T06:17:27.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.861+0000 7f1e82a00640 1 -- 172.21.15.63:0/3105570888 <== mgr.4104 v2:172.21.15.63:6832/3591189670 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332537 (secure 0 0 0) 0x7f1e8c072ee0 con 0x7f1e6806bbd0 2024-03-26T06:17:27.863 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:27.868 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-03-26T06:17:27.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.868+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1e6806bbd0 msgr2=0x7f1e6806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.868+0000 7f1e8be00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1e6806bbd0 0x7f1e6806e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0ca030 tx=0x7f1e74009040 comp rx=0 tx=0).stop 2024-03-26T06:17:27.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.868+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0afa30 msgr2=0x7f1e8c1f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:27.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.868+0000 7f1e8be00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0afa30 0x7f1e8c1f3ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00c3c0 tx=0x7f1e7c00c880 comp rx=0 tx=0).stop 2024-03-26T06:17:27.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.869+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 shutdown_connections 2024-03-26T06:17:27.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.869+0000 7f1e8be00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1e6806bbd0 0x7f1e6806e090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.869+0000 7f1e8be00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e8c15ca80 0x7f1e8c0c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.869+0000 7f1e8be00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e8c0b2dc0 0x7f1e8c0c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.869+0000 7f1e8be00640 1 --2- 172.21.15.63:0/3105570888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e8c0afa30 0x7f1e8c1f3ae0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:27.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.869+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 >> 172.21.15.63:0/3105570888 conn(0x7f1e8c099a70 msgr2=0x7f1e8c0cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:27.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.869+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 shutdown_connections 2024-03-26T06:17:27.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:27.869+0000 7f1e8be00640 1 -- 172.21.15.63:0/3105570888 wait complete. 2024-03-26T06:17:27.887 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-03-26T06:17:25.886024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004643"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595035+0000","last_change":"2024-03-26T06:16:57.506890+0000","last_active":"2024-03-26T06:17:03.595035+0000","last_peered":"2024-03-26T06:17:03.595035+0000","last_clean":"2024-03-26T06:17:03.595035+0000","last_became_active":"2024-03-26T06:16:57.506602+0000","last_became_peered":"2024-03-26T06:16:57.506602+0000","last_unstale":"2024-03-26T06:17:03.595035+0000","last_undegraded":"2024-03-26T06:17:03.595035+0000","last_fullsized":"2024-03-26T06:17:03.595035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:14:13.027200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557577+0000","last_change":"2024-03-26T06:16:58.527848+0000","last_active":"2024-03-26T06:17:03.557577+0000","last_peered":"2024-03-26T06:17:03.557577+0000","last_clean":"2024-03-26T06:17:03.557577+0000","last_became_active":"2024-03-26T06:16:58.527552+0000","last_became_peered":"2024-03-26T06:16:58.527552+0000","last_unstale":"2024-03-26T06:17:03.557577+0000","last_undegraded":"2024-03-26T06:17:03.557577+0000","last_fullsized":"2024-03-26T06:17:03.557577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554184+0000","last_change":"2024-03-26T06:17:02.883862+0000","last_active":"2024-03-26T06:17:03.554184+0000","last_peered":"2024-03-26T06:17:03.554184+0000","last_clean":"2024-03-26T06:17:03.554184+0000","last_became_active":"2024-03-26T06:17:02.883030+0000","last_became_peered":"2024-03-26T06:17:02.883030+0000","last_unstale":"2024-03-26T06:17:03.554184+0000","last_undegraded":"2024-03-26T06:17:03.554184+0000","last_fullsized":"2024-03-26T06:17:03.554184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:54:39.278678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557980+0000","last_change":"2024-03-26T06:16:57.498142+0000","last_active":"2024-03-26T06:17:03.557980+0000","last_peered":"2024-03-26T06:17:03.557980+0000","last_clean":"2024-03-26T06:17:03.557980+0000","last_became_active":"2024-03-26T06:16:57.497676+0000","last_became_peered":"2024-03-26T06:16:57.497676+0000","last_unstale":"2024-03-26T06:17:03.557980+0000","last_undegraded":"2024-03-26T06:17:03.557980+0000","last_fullsized":"2024-03-26T06:17:03.557980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594151+0000","last_change":"2024-03-26T06:16:58.533520+0000","last_active":"2024-03-26T06:17:03.594151+0000","last_peered":"2024-03-26T06:17:03.594151+0000","last_clean":"2024-03-26T06:17:03.594151+0000","last_became_active":"2024-03-26T06:16:58.532799+0000","last_became_peered":"2024-03-26T06:16:58.532799+0000","last_unstale":"2024-03-26T06:17:03.594151+0000","last_undegraded":"2024-03-26T06:17:03.594151+0000","last_fullsized":"2024-03-26T06:17:03.594151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597128+0000","last_change":"2024-03-26T06:17:02.581513+0000","last_active":"2024-03-26T06:17:03.597128+0000","last_peered":"2024-03-26T06:17:03.597128+0000","last_clean":"2024-03-26T06:17:03.597128+0000","last_became_active":"2024-03-26T06:17:02.580429+0000","last_became_peered":"2024-03-26T06:17:02.580429+0000","last_unstale":"2024-03-26T06:17:03.597128+0000","last_undegraded":"2024-03-26T06:17:03.597128+0000","last_fullsized":"2024-03-26T06:17:03.597128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:21.836096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601161+0000","last_change":"2024-03-26T06:16:57.517050+0000","last_active":"2024-03-26T06:17:03.601161+0000","last_peered":"2024-03-26T06:17:03.601161+0000","last_clean":"2024-03-26T06:17:03.601161+0000","last_became_active":"2024-03-26T06:16:57.516624+0000","last_became_peered":"2024-03-26T06:16:57.516624+0000","last_unstale":"2024-03-26T06:17:03.601161+0000","last_undegraded":"2024-03-26T06:17:03.601161+0000","last_fullsized":"2024-03-26T06:17:03.601161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:27.040366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554266+0000","last_change":"2024-03-26T06:16:58.528249+0000","last_active":"2024-03-26T06:17:03.554266+0000","last_peered":"2024-03-26T06:17:03.554266+0000","last_clean":"2024-03-26T06:17:03.554266+0000","last_became_active":"2024-03-26T06:16:58.527930+0000","last_became_peered":"2024-03-26T06:16:58.527930+0000","last_unstale":"2024-03-26T06:17:03.554266+0000","last_undegraded":"2024-03-26T06:17:03.554266+0000","last_fullsized":"2024-03-26T06:17:03.554266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:12:57.541865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599529+0000","last_change":"2024-03-26T06:17:02.582621+0000","last_active":"2024-03-26T06:17:03.599529+0000","last_peered":"2024-03-26T06:17:03.599529+0000","last_clean":"2024-03-26T06:17:03.599529+0000","last_became_active":"2024-03-26T06:17:02.581967+0000","last_became_peered":"2024-03-26T06:17:02.581967+0000","last_unstale":"2024-03-26T06:17:03.599529+0000","last_undegraded":"2024-03-26T06:17:03.599529+0000","last_fullsized":"2024-03-26T06:17:03.599529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599843+0000","last_change":"2024-03-26T06:16:57.514049+0000","last_active":"2024-03-26T06:17:03.599843+0000","last_peered":"2024-03-26T06:17:03.599843+0000","last_clean":"2024-03-26T06:17:03.599843+0000","last_became_active":"2024-03-26T06:16:57.513744+0000","last_became_peered":"2024-03-26T06:16:57.513744+0000","last_unstale":"2024-03-26T06:17:03.599843+0000","last_undegraded":"2024-03-26T06:17:03.599843+0000","last_fullsized":"2024-03-26T06:17:03.599843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:30.683728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554334+0000","last_change":"2024-03-26T06:16:58.530727+0000","last_active":"2024-03-26T06:17:03.554334+0000","last_peered":"2024-03-26T06:17:03.554334+0000","last_clean":"2024-03-26T06:17:03.554334+0000","last_became_active":"2024-03-26T06:16:58.530387+0000","last_became_peered":"2024-03-26T06:16:58.530387+0000","last_unstale":"2024-03-26T06:17:03.554334+0000","last_undegraded":"2024-03-26T06:17:03.554334+0000","last_fullsized":"2024-03-26T06:17:03.554334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596867+0000","last_change":"2024-03-26T06:17:02.589397+0000","last_active":"2024-03-26T06:17:03.596867+0000","last_peered":"2024-03-26T06:17:03.596867+0000","last_clean":"2024-03-26T06:17:03.596867+0000","last_became_active":"2024-03-26T06:17:02.588887+0000","last_became_peered":"2024-03-26T06:17:02.588887+0000","last_unstale":"2024-03-26T06:17:03.596867+0000","last_undegraded":"2024-03-26T06:17:03.596867+0000","last_fullsized":"2024-03-26T06:17:03.596867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:07.303274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595731+0000","last_change":"2024-03-26T06:16:58.526427+0000","last_active":"2024-03-26T06:17:03.595731+0000","last_peered":"2024-03-26T06:17:03.595731+0000","last_clean":"2024-03-26T06:17:03.595731+0000","last_became_active":"2024-03-26T06:16:58.526080+0000","last_became_peered":"2024-03-26T06:16:58.526080+0000","last_unstale":"2024-03-26T06:17:03.595731+0000","last_undegraded":"2024-03-26T06:17:03.595731+0000","last_fullsized":"2024-03-26T06:17:03.595731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600384+0000","last_change":"2024-03-26T06:16:57.513120+0000","last_active":"2024-03-26T06:17:03.600384+0000","last_peered":"2024-03-26T06:17:03.600384+0000","last_clean":"2024-03-26T06:17:03.600384+0000","last_became_active":"2024-03-26T06:16:57.512654+0000","last_became_peered":"2024-03-26T06:16:57.512654+0000","last_unstale":"2024-03-26T06:17:03.600384+0000","last_undegraded":"2024-03-26T06:17:03.600384+0000","last_fullsized":"2024-03-26T06:17:03.600384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597983+0000","last_change":"2024-03-26T06:17:02.584892+0000","last_active":"2024-03-26T06:17:03.597983+0000","last_peered":"2024-03-26T06:17:03.597983+0000","last_clean":"2024-03-26T06:17:03.597983+0000","last_became_active":"2024-03-26T06:17:02.584379+0000","last_became_peered":"2024-03-26T06:17:02.584379+0000","last_unstale":"2024-03-26T06:17:03.597983+0000","last_undegraded":"2024-03-26T06:17:03.597983+0000","last_fullsized":"2024-03-26T06:17:03.597983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:46.388330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555728+0000","last_change":"2024-03-26T06:16:58.517155+0000","last_active":"2024-03-26T06:17:03.555728+0000","last_peered":"2024-03-26T06:17:03.555728+0000","last_clean":"2024-03-26T06:17:03.555728+0000","last_became_active":"2024-03-26T06:16:58.516377+0000","last_became_peered":"2024-03-26T06:16:58.516377+0000","last_unstale":"2024-03-26T06:17:03.555728+0000","last_undegraded":"2024-03-26T06:17:03.555728+0000","last_fullsized":"2024-03-26T06:17:03.555728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597289+0000","last_change":"2024-03-26T06:16:57.500506+0000","last_active":"2024-03-26T06:17:03.597289+0000","last_peered":"2024-03-26T06:17:03.597289+0000","last_clean":"2024-03-26T06:17:03.597289+0000","last_became_active":"2024-03-26T06:16:57.499432+0000","last_became_peered":"2024-03-26T06:16:57.499432+0000","last_unstale":"2024-03-26T06:17:03.597289+0000","last_undegraded":"2024-03-26T06:17:03.597289+0000","last_fullsized":"2024-03-26T06:17:03.597289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599068+0000","last_change":"2024-03-26T06:17:02.586266+0000","last_active":"2024-03-26T06:17:03.599068+0000","last_peered":"2024-03-26T06:17:03.599068+0000","last_clean":"2024-03-26T06:17:03.599068+0000","last_became_active":"2024-03-26T06:17:02.585755+0000","last_became_peered":"2024-03-26T06:17:02.585755+0000","last_unstale":"2024-03-26T06:17:03.599068+0000","last_undegraded":"2024-03-26T06:17:03.599068+0000","last_fullsized":"2024-03-26T06:17:03.599068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:36.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554831+0000","last_change":"2024-03-26T06:16:58.516177+0000","last_active":"2024-03-26T06:17:03.554831+0000","last_peered":"2024-03-26T06:17:03.554831+0000","last_clean":"2024-03-26T06:17:03.554831+0000","last_became_active":"2024-03-26T06:16:58.515861+0000","last_became_peered":"2024-03-26T06:16:58.515861+0000","last_unstale":"2024-03-26T06:17:03.554831+0000","last_undegraded":"2024-03-26T06:17:03.554831+0000","last_fullsized":"2024-03-26T06:17:03.554831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595139+0000","last_change":"2024-03-26T06:16:57.506199+0000","last_active":"2024-03-26T06:17:03.595139+0000","last_peered":"2024-03-26T06:17:03.595139+0000","last_clean":"2024-03-26T06:17:03.595139+0000","last_became_active":"2024-03-26T06:16:57.505635+0000","last_became_peered":"2024-03-26T06:16:57.505635+0000","last_unstale":"2024-03-26T06:17:03.595139+0000","last_undegraded":"2024-03-26T06:17:03.595139+0000","last_fullsized":"2024-03-26T06:17:03.595139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596127+0000","last_change":"2024-03-26T06:17:02.877672+0000","last_active":"2024-03-26T06:17:03.596127+0000","last_peered":"2024-03-26T06:17:03.596127+0000","last_clean":"2024-03-26T06:17:03.596127+0000","last_became_active":"2024-03-26T06:17:02.877192+0000","last_became_peered":"2024-03-26T06:17:02.877192+0000","last_unstale":"2024-03-26T06:17:03.596127+0000","last_undegraded":"2024-03-26T06:17:03.596127+0000","last_fullsized":"2024-03-26T06:17:03.596127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598768+0000","last_change":"2024-03-26T06:16:58.521953+0000","last_active":"2024-03-26T06:17:03.598768+0000","last_peered":"2024-03-26T06:17:03.598768+0000","last_clean":"2024-03-26T06:17:03.598768+0000","last_became_active":"2024-03-26T06:16:58.521656+0000","last_became_peered":"2024-03-26T06:16:58.521656+0000","last_unstale":"2024-03-26T06:17:03.598768+0000","last_undegraded":"2024-03-26T06:17:03.598768+0000","last_fullsized":"2024-03-26T06:17:03.598768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:03.428999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597855+0000","last_change":"2024-03-26T06:16:57.508917+0000","last_active":"2024-03-26T06:17:03.597855+0000","last_peered":"2024-03-26T06:17:03.597855+0000","last_clean":"2024-03-26T06:17:03.597855+0000","last_became_active":"2024-03-26T06:16:57.508659+0000","last_became_peered":"2024-03-26T06:16:57.508659+0000","last_unstale":"2024-03-26T06:17:03.597855+0000","last_undegraded":"2024-03-26T06:17:03.597855+0000","last_fullsized":"2024-03-26T06:17:03.597855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600692+0000","last_change":"2024-03-26T06:17:02.583351+0000","last_active":"2024-03-26T06:17:03.600692+0000","last_peered":"2024-03-26T06:17:03.600692+0000","last_clean":"2024-03-26T06:17:03.600692+0000","last_became_active":"2024-03-26T06:17:02.582876+0000","last_became_peered":"2024-03-26T06:17:02.582876+0000","last_unstale":"2024-03-26T06:17:03.600692+0000","last_undegraded":"2024-03-26T06:17:03.600692+0000","last_fullsized":"2024-03-26T06:17:03.600692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595429+0000","last_change":"2024-03-26T06:16:58.508413+0000","last_active":"2024-03-26T06:17:03.595429+0000","last_peered":"2024-03-26T06:17:03.595429+0000","last_clean":"2024-03-26T06:17:03.595429+0000","last_became_active":"2024-03-26T06:16:58.508024+0000","last_became_peered":"2024-03-26T06:16:58.508024+0000","last_unstale":"2024-03-26T06:17:03.595429+0000","last_undegraded":"2024-03-26T06:17:03.595429+0000","last_fullsized":"2024-03-26T06:17:03.595429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596617+0000","last_change":"2024-03-26T06:16:57.509822+0000","last_active":"2024-03-26T06:17:03.596617+0000","last_peered":"2024-03-26T06:17:03.596617+0000","last_clean":"2024-03-26T06:17:03.596617+0000","last_became_active":"2024-03-26T06:16:57.509535+0000","last_became_peered":"2024-03-26T06:16:57.509535+0000","last_unstale":"2024-03-26T06:17:03.596617+0000","last_undegraded":"2024-03-26T06:17:03.596617+0000","last_fullsized":"2024-03-26T06:17:03.596617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597981+0000","last_change":"2024-03-26T06:17:02.877373+0000","last_active":"2024-03-26T06:17:03.597981+0000","last_peered":"2024-03-26T06:17:03.597981+0000","last_clean":"2024-03-26T06:17:03.597981+0000","last_became_active":"2024-03-26T06:17:02.876252+0000","last_became_peered":"2024-03-26T06:17:02.876252+0000","last_unstale":"2024-03-26T06:17:03.597981+0000","last_undegraded":"2024-03-26T06:17:03.597981+0000","last_fullsized":"2024-03-26T06:17:03.597981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:19.395341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556495+0000","last_change":"2024-03-26T06:16:58.536114+0000","last_active":"2024-03-26T06:17:03.556495+0000","last_peered":"2024-03-26T06:17:03.556495+0000","last_clean":"2024-03-26T06:17:03.556495+0000","last_became_active":"2024-03-26T06:16:58.534372+0000","last_became_peered":"2024-03-26T06:16:58.534372+0000","last_unstale":"2024-03-26T06:17:03.556495+0000","last_undegraded":"2024-03-26T06:17:03.556495+0000","last_fullsized":"2024-03-26T06:17:03.556495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596054+0000","last_change":"2024-03-26T06:16:57.503958+0000","last_active":"2024-03-26T06:17:03.596054+0000","last_peered":"2024-03-26T06:17:03.596054+0000","last_clean":"2024-03-26T06:17:03.596054+0000","last_became_active":"2024-03-26T06:16:57.503652+0000","last_became_peered":"2024-03-26T06:16:57.503652+0000","last_unstale":"2024-03-26T06:17:03.596054+0000","last_undegraded":"2024-03-26T06:17:03.596054+0000","last_fullsized":"2024-03-26T06:17:03.596054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:27.040366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553997+0000","last_change":"2024-03-26T06:17:02.878945+0000","last_active":"2024-03-26T06:17:03.553997+0000","last_peered":"2024-03-26T06:17:03.553997+0000","last_clean":"2024-03-26T06:17:03.553997+0000","last_became_active":"2024-03-26T06:17:02.876348+0000","last_became_peered":"2024-03-26T06:17:02.876348+0000","last_unstale":"2024-03-26T06:17:03.553997+0000","last_undegraded":"2024-03-26T06:17:03.553997+0000","last_fullsized":"2024-03-26T06:17:03.553997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:56:38.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595956+0000","last_change":"2024-03-26T06:16:58.515417+0000","last_active":"2024-03-26T06:17:03.595956+0000","last_peered":"2024-03-26T06:17:03.595956+0000","last_clean":"2024-03-26T06:17:03.595956+0000","last_became_active":"2024-03-26T06:16:58.515099+0000","last_became_peered":"2024-03-26T06:16:58.515099+0000","last_unstale":"2024-03-26T06:17:03.595956+0000","last_undegraded":"2024-03-26T06:17:03.595956+0000","last_fullsized":"2024-03-26T06:17:03.595956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601464+0000","last_change":"2024-03-26T06:16:57.512114+0000","last_active":"2024-03-26T06:17:03.601464+0000","last_peered":"2024-03-26T06:17:03.601464+0000","last_clean":"2024-03-26T06:17:03.601464+0000","last_became_active":"2024-03-26T06:16:57.511667+0000","last_became_peered":"2024-03-26T06:16:57.511667+0000","last_unstale":"2024-03-26T06:17:03.601464+0000","last_undegraded":"2024-03-26T06:17:03.601464+0000","last_fullsized":"2024-03-26T06:17:03.601464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:02:14.322537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593526+0000","last_change":"2024-03-26T06:17:02.871332+0000","last_active":"2024-03-26T06:17:03.593526+0000","last_peered":"2024-03-26T06:17:03.593526+0000","last_clean":"2024-03-26T06:17:03.593526+0000","last_became_active":"2024-03-26T06:17:02.869955+0000","last_became_peered":"2024-03-26T06:17:02.869955+0000","last_unstale":"2024-03-26T06:17:03.593526+0000","last_undegraded":"2024-03-26T06:17:03.593526+0000","last_fullsized":"2024-03-26T06:17:03.593526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554596+0000","last_change":"2024-03-26T06:16:58.523299+0000","last_active":"2024-03-26T06:17:03.554596+0000","last_peered":"2024-03-26T06:17:03.554596+0000","last_clean":"2024-03-26T06:17:03.554596+0000","last_became_active":"2024-03-26T06:16:58.522533+0000","last_became_peered":"2024-03-26T06:16:58.522533+0000","last_unstale":"2024-03-26T06:17:03.554596+0000","last_undegraded":"2024-03-26T06:17:03.554596+0000","last_fullsized":"2024-03-26T06:17:03.554596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:30.208261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596078+0000","last_change":"2024-03-26T06:16:57.500603+0000","last_active":"2024-03-26T06:17:03.596078+0000","last_peered":"2024-03-26T06:17:03.596078+0000","last_clean":"2024-03-26T06:17:03.596078+0000","last_became_active":"2024-03-26T06:16:57.500234+0000","last_became_peered":"2024-03-26T06:16:57.500234+0000","last_unstale":"2024-03-26T06:17:03.596078+0000","last_undegraded":"2024-03-26T06:17:03.596078+0000","last_fullsized":"2024-03-26T06:17:03.596078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:30.683728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595428+0000","last_change":"2024-03-26T06:17:02.583042+0000","last_active":"2024-03-26T06:17:03.595428+0000","last_peered":"2024-03-26T06:17:03.595428+0000","last_clean":"2024-03-26T06:17:03.595428+0000","last_became_active":"2024-03-26T06:17:02.581196+0000","last_became_peered":"2024-03-26T06:17:02.581196+0000","last_unstale":"2024-03-26T06:17:03.595428+0000","last_undegraded":"2024-03-26T06:17:03.595428+0000","last_fullsized":"2024-03-26T06:17:03.595428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600154+0000","last_change":"2024-03-26T06:16:58.531514+0000","last_active":"2024-03-26T06:17:03.600154+0000","last_peered":"2024-03-26T06:17:03.600154+0000","last_clean":"2024-03-26T06:17:03.600154+0000","last_became_active":"2024-03-26T06:16:58.531162+0000","last_became_peered":"2024-03-26T06:16:58.531162+0000","last_unstale":"2024-03-26T06:17:03.600154+0000","last_undegraded":"2024-03-26T06:17:03.600154+0000","last_fullsized":"2024-03-26T06:17:03.600154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:30.860729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554746+0000","last_change":"2024-03-26T06:16:57.495688+0000","last_active":"2024-03-26T06:17:03.554746+0000","last_peered":"2024-03-26T06:17:03.554746+0000","last_clean":"2024-03-26T06:17:03.554746+0000","last_became_active":"2024-03-26T06:16:57.495052+0000","last_became_peered":"2024-03-26T06:16:57.495052+0000","last_unstale":"2024-03-26T06:17:03.554746+0000","last_undegraded":"2024-03-26T06:17:03.554746+0000","last_fullsized":"2024-03-26T06:17:03.554746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596497+0000","last_change":"2024-03-26T06:17:02.573496+0000","last_active":"2024-03-26T06:17:03.596497+0000","last_peered":"2024-03-26T06:17:03.596497+0000","last_clean":"2024-03-26T06:17:03.596497+0000","last_became_active":"2024-03-26T06:17:02.573045+0000","last_became_peered":"2024-03-26T06:17:02.573045+0000","last_unstale":"2024-03-26T06:17:03.596497+0000","last_undegraded":"2024-03-26T06:17:03.596497+0000","last_fullsized":"2024-03-26T06:17:03.596497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:13:01.612258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594153+0000","last_change":"2024-03-26T06:16:58.517202+0000","last_active":"2024-03-26T06:17:03.594153+0000","last_peered":"2024-03-26T06:17:03.594153+0000","last_clean":"2024-03-26T06:17:03.594153+0000","last_became_active":"2024-03-26T06:16:58.516835+0000","last_became_peered":"2024-03-26T06:16:58.516835+0000","last_unstale":"2024-03-26T06:17:03.594153+0000","last_undegraded":"2024-03-26T06:17:03.594153+0000","last_fullsized":"2024-03-26T06:17:03.594153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550169+0000","last_change":"2024-03-26T06:16:57.497056+0000","last_active":"2024-03-26T06:17:03.550169+0000","last_peered":"2024-03-26T06:17:03.550169+0000","last_clean":"2024-03-26T06:17:03.550169+0000","last_became_active":"2024-03-26T06:16:57.496709+0000","last_became_peered":"2024-03-26T06:16:57.496709+0000","last_unstale":"2024-03-26T06:17:03.550169+0000","last_undegraded":"2024-03-26T06:17:03.550169+0000","last_fullsized":"2024-03-26T06:17:03.550169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596338+0000","last_change":"2024-03-26T06:17:02.584311+0000","last_active":"2024-03-26T06:17:03.596338+0000","last_peered":"2024-03-26T06:17:03.596338+0000","last_clean":"2024-03-26T06:17:03.596338+0000","last_became_active":"2024-03-26T06:17:02.583886+0000","last_became_peered":"2024-03-26T06:17:02.583886+0000","last_unstale":"2024-03-26T06:17:03.596338+0000","last_undegraded":"2024-03-26T06:17:03.596338+0000","last_fullsized":"2024-03-26T06:17:03.596338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:21.194082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.592952+0000","last_change":"2024-03-26T06:16:58.530594+0000","last_active":"2024-03-26T06:17:03.592952+0000","last_peered":"2024-03-26T06:17:03.592952+0000","last_clean":"2024-03-26T06:17:03.592952+0000","last_became_active":"2024-03-26T06:16:58.529866+0000","last_became_peered":"2024-03-26T06:16:58.529866+0000","last_unstale":"2024-03-26T06:17:03.592952+0000","last_undegraded":"2024-03-26T06:17:03.592952+0000","last_fullsized":"2024-03-26T06:17:03.592952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:41:39.644933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598124+0000","last_change":"2024-03-26T06:16:57.515221+0000","last_active":"2024-03-26T06:17:03.598124+0000","last_peered":"2024-03-26T06:17:03.598124+0000","last_clean":"2024-03-26T06:17:03.598124+0000","last_became_active":"2024-03-26T06:16:57.514898+0000","last_became_peered":"2024-03-26T06:16:57.514898+0000","last_unstale":"2024-03-26T06:17:03.598124+0000","last_undegraded":"2024-03-26T06:17:03.598124+0000","last_fullsized":"2024-03-26T06:17:03.598124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595076+0000","last_change":"2024-03-26T06:17:02.882785+0000","last_active":"2024-03-26T06:17:03.595076+0000","last_peered":"2024-03-26T06:17:03.595076+0000","last_clean":"2024-03-26T06:17:03.595076+0000","last_became_active":"2024-03-26T06:17:02.880282+0000","last_became_peered":"2024-03-26T06:17:02.880282+0000","last_unstale":"2024-03-26T06:17:03.595076+0000","last_undegraded":"2024-03-26T06:17:03.595076+0000","last_fullsized":"2024-03-26T06:17:03.595076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:13:01.612258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554233+0000","last_change":"2024-03-26T06:16:58.534461+0000","last_active":"2024-03-26T06:17:03.554233+0000","last_peered":"2024-03-26T06:17:03.554233+0000","last_clean":"2024-03-26T06:17:03.554233+0000","last_became_active":"2024-03-26T06:16:58.533987+0000","last_became_peered":"2024-03-26T06:16:58.533987+0000","last_unstale":"2024-03-26T06:17:03.554233+0000","last_undegraded":"2024-03-26T06:17:03.554233+0000","last_fullsized":"2024-03-26T06:17:03.554233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553855+0000","last_change":"2024-03-26T06:16:57.493211+0000","last_active":"2024-03-26T06:17:03.553855+0000","last_peered":"2024-03-26T06:17:03.553855+0000","last_clean":"2024-03-26T06:17:03.553855+0000","last_became_active":"2024-03-26T06:16:57.492914+0000","last_became_peered":"2024-03-26T06:16:57.492914+0000","last_unstale":"2024-03-26T06:17:03.553855+0000","last_undegraded":"2024-03-26T06:17:03.553855+0000","last_fullsized":"2024-03-26T06:17:03.553855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598396+0000","last_change":"2024-03-26T06:16:49.590440+0000","last_active":"2024-03-26T06:17:03.598396+0000","last_peered":"2024-03-26T06:17:03.598396+0000","last_clean":"2024-03-26T06:17:03.598396+0000","last_became_active":"2024-03-26T06:16:49.589017+0000","last_became_peered":"2024-03-26T06:16:49.589017+0000","last_unstale":"2024-03-26T06:17:03.598396+0000","last_undegraded":"2024-03-26T06:17:03.598396+0000","last_fullsized":"2024-03-26T06:17:03.598396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_clean_scrub_stamp":"2024-03-26T06:16:48.290068+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:00:05.158039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596458+0000","last_change":"2024-03-26T06:17:02.878872+0000","last_active":"2024-03-26T06:17:03.596458+0000","last_peered":"2024-03-26T06:17:03.596458+0000","last_clean":"2024-03-26T06:17:03.596458+0000","last_became_active":"2024-03-26T06:17:02.877700+0000","last_became_peered":"2024-03-26T06:17:02.877700+0000","last_unstale":"2024-03-26T06:17:03.596458+0000","last_undegraded":"2024-03-26T06:17:03.596458+0000","last_fullsized":"2024-03-26T06:17:03.596458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600698+0000","last_change":"2024-03-26T06:16:58.533470+0000","last_active":"2024-03-26T06:17:03.600698+0000","last_peered":"2024-03-26T06:17:03.600698+0000","last_clean":"2024-03-26T06:17:03.600698+0000","last_became_active":"2024-03-26T06:16:58.533157+0000","last_became_peered":"2024-03-26T06:16:58.533157+0000","last_unstale":"2024-03-26T06:17:03.600698+0000","last_undegraded":"2024-03-26T06:17:03.600698+0000","last_fullsized":"2024-03-26T06:17:03.600698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.551305+0000","last_change":"2024-03-26T06:16:57.504891+0000","last_active":"2024-03-26T06:17:03.551305+0000","last_peered":"2024-03-26T06:17:03.551305+0000","last_clean":"2024-03-26T06:17:03.551305+0000","last_became_active":"2024-03-26T06:16:57.504556+0000","last_became_peered":"2024-03-26T06:16:57.504556+0000","last_unstale":"2024-03-26T06:17:03.551305+0000","last_undegraded":"2024-03-26T06:17:03.551305+0000","last_fullsized":"2024-03-26T06:17:03.551305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601044+0000","last_change":"2024-03-26T06:17:02.879854+0000","last_active":"2024-03-26T06:17:03.601044+0000","last_peered":"2024-03-26T06:17:03.601044+0000","last_clean":"2024-03-26T06:17:03.601044+0000","last_became_active":"2024-03-26T06:17:02.873465+0000","last_became_peered":"2024-03-26T06:17:02.873465+0000","last_unstale":"2024-03-26T06:17:03.601044+0000","last_undegraded":"2024-03-26T06:17:03.601044+0000","last_fullsized":"2024-03-26T06:17:03.601044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554519+0000","last_change":"2024-03-26T06:16:58.524155+0000","last_active":"2024-03-26T06:17:03.554519+0000","last_peered":"2024-03-26T06:17:03.554519+0000","last_clean":"2024-03-26T06:17:03.554519+0000","last_became_active":"2024-03-26T06:16:58.523112+0000","last_became_peered":"2024-03-26T06:16:58.523112+0000","last_unstale":"2024-03-26T06:17:03.554519+0000","last_undegraded":"2024-03-26T06:17:03.554519+0000","last_fullsized":"2024-03-26T06:17:03.554519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:35.992415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596126+0000","last_change":"2024-03-26T06:16:57.499837+0000","last_active":"2024-03-26T06:17:03.596126+0000","last_peered":"2024-03-26T06:17:03.596126+0000","last_clean":"2024-03-26T06:17:03.596126+0000","last_became_active":"2024-03-26T06:16:57.499493+0000","last_became_peered":"2024-03-26T06:16:57.499493+0000","last_unstale":"2024-03-26T06:17:03.596126+0000","last_undegraded":"2024-03-26T06:17:03.596126+0000","last_fullsized":"2024-03-26T06:17:03.596126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594334+0000","last_change":"2024-03-26T06:17:02.577832+0000","last_active":"2024-03-26T06:17:03.594334+0000","last_peered":"2024-03-26T06:17:03.594334+0000","last_clean":"2024-03-26T06:17:03.594334+0000","last_became_active":"2024-03-26T06:17:02.576442+0000","last_became_peered":"2024-03-26T06:17:02.576442+0000","last_unstale":"2024-03-26T06:17:03.594334+0000","last_undegraded":"2024-03-26T06:17:03.594334+0000","last_fullsized":"2024-03-26T06:17:03.594334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.602136+0000","last_change":"2024-03-26T06:16:58.552213+0000","last_active":"2024-03-26T06:17:03.602136+0000","last_peered":"2024-03-26T06:17:03.602136+0000","last_clean":"2024-03-26T06:17:03.602136+0000","last_became_active":"2024-03-26T06:16:58.551830+0000","last_became_peered":"2024-03-26T06:16:58.551830+0000","last_unstale":"2024-03-26T06:17:03.602136+0000","last_undegraded":"2024-03-26T06:17:03.602136+0000","last_fullsized":"2024-03-26T06:17:03.602136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:31:28.495785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550919+0000","last_change":"2024-03-26T06:16:57.501329+0000","last_active":"2024-03-26T06:17:03.550919+0000","last_peered":"2024-03-26T06:17:03.550919+0000","last_clean":"2024-03-26T06:17:03.550919+0000","last_became_active":"2024-03-26T06:16:57.500987+0000","last_became_peered":"2024-03-26T06:16:57.500987+0000","last_unstale":"2024-03-26T06:17:03.550919+0000","last_undegraded":"2024-03-26T06:17:03.550919+0000","last_fullsized":"2024-03-26T06:17:03.550919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.552806+0000","last_change":"2024-03-26T06:17:02.872960+0000","last_active":"2024-03-26T06:17:03.552806+0000","last_peered":"2024-03-26T06:17:03.552806+0000","last_clean":"2024-03-26T06:17:03.552806+0000","last_became_active":"2024-03-26T06:17:02.871460+0000","last_became_peered":"2024-03-26T06:17:02.871460+0000","last_unstale":"2024-03-26T06:17:03.552806+0000","last_undegraded":"2024-03-26T06:17:03.552806+0000","last_fullsized":"2024-03-26T06:17:03.552806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:44:47.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601012+0000","last_change":"2024-03-26T06:16:58.534645+0000","last_active":"2024-03-26T06:17:03.601012+0000","last_peered":"2024-03-26T06:17:03.601012+0000","last_clean":"2024-03-26T06:17:03.601012+0000","last_became_active":"2024-03-26T06:16:58.532263+0000","last_became_peered":"2024-03-26T06:16:58.532263+0000","last_unstale":"2024-03-26T06:17:03.601012+0000","last_undegraded":"2024-03-26T06:17:03.601012+0000","last_fullsized":"2024-03-26T06:17:03.601012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:35.992415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601161+0000","last_change":"2024-03-26T06:16:57.495853+0000","last_active":"2024-03-26T06:17:03.601161+0000","last_peered":"2024-03-26T06:17:03.601161+0000","last_clean":"2024-03-26T06:17:03.601161+0000","last_became_active":"2024-03-26T06:16:57.495248+0000","last_became_peered":"2024-03-26T06:16:57.495248+0000","last_unstale":"2024-03-26T06:17:03.601161+0000","last_undegraded":"2024-03-26T06:17:03.601161+0000","last_fullsized":"2024-03-26T06:17:03.601161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:20:43.357850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597470+0000","last_change":"2024-03-26T06:17:02.582195+0000","last_active":"2024-03-26T06:17:03.597470+0000","last_peered":"2024-03-26T06:17:03.597470+0000","last_clean":"2024-03-26T06:17:03.597470+0000","last_became_active":"2024-03-26T06:17:02.581717+0000","last_became_peered":"2024-03-26T06:17:02.581717+0000","last_unstale":"2024-03-26T06:17:03.597470+0000","last_undegraded":"2024-03-26T06:17:03.597470+0000","last_fullsized":"2024-03-26T06:17:03.597470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:19.811246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598827+0000","last_change":"2024-03-26T06:16:58.531961+0000","last_active":"2024-03-26T06:17:03.598827+0000","last_peered":"2024-03-26T06:17:03.598827+0000","last_clean":"2024-03-26T06:17:03.598827+0000","last_became_active":"2024-03-26T06:16:58.531656+0000","last_became_peered":"2024-03-26T06:16:58.531656+0000","last_unstale":"2024-03-26T06:17:03.598827+0000","last_undegraded":"2024-03-26T06:17:03.598827+0000","last_fullsized":"2024-03-26T06:17:03.598827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.549428+0000","last_change":"2024-03-26T06:16:57.488815+0000","last_active":"2024-03-26T06:17:03.549428+0000","last_peered":"2024-03-26T06:17:03.549428+0000","last_clean":"2024-03-26T06:17:03.549428+0000","last_became_active":"2024-03-26T06:16:57.487181+0000","last_became_peered":"2024-03-26T06:16:57.487181+0000","last_unstale":"2024-03-26T06:17:03.549428+0000","last_undegraded":"2024-03-26T06:17:03.549428+0000","last_fullsized":"2024-03-26T06:17:03.549428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:02:07.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594842+0000","last_change":"2024-03-26T06:17:02.580214+0000","last_active":"2024-03-26T06:17:03.594842+0000","last_peered":"2024-03-26T06:17:03.594842+0000","last_clean":"2024-03-26T06:17:03.594842+0000","last_became_active":"2024-03-26T06:17:02.579846+0000","last_became_peered":"2024-03-26T06:17:02.579846+0000","last_unstale":"2024-03-26T06:17:03.594842+0000","last_undegraded":"2024-03-26T06:17:03.594842+0000","last_fullsized":"2024-03-26T06:17:03.594842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:21.194082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595884+0000","last_change":"2024-03-26T06:16:58.514900+0000","last_active":"2024-03-26T06:17:03.595884+0000","last_peered":"2024-03-26T06:17:03.595884+0000","last_clean":"2024-03-26T06:17:03.595884+0000","last_became_active":"2024-03-26T06:16:58.514631+0000","last_became_peered":"2024-03-26T06:16:58.514631+0000","last_unstale":"2024-03-26T06:17:03.595884+0000","last_undegraded":"2024-03-26T06:17:03.595884+0000","last_fullsized":"2024-03-26T06:17:03.595884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595846+0000","last_change":"2024-03-26T06:16:57.507399+0000","last_active":"2024-03-26T06:17:03.595846+0000","last_peered":"2024-03-26T06:17:03.595846+0000","last_clean":"2024-03-26T06:17:03.595846+0000","last_became_active":"2024-03-26T06:16:57.506456+0000","last_became_peered":"2024-03-26T06:16:57.506456+0000","last_unstale":"2024-03-26T06:17:03.595846+0000","last_undegraded":"2024-03-26T06:17:03.595846+0000","last_fullsized":"2024-03-26T06:17:03.595846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556221+0000","last_change":"2024-03-26T06:17:02.887270+0000","last_active":"2024-03-26T06:17:03.556221+0000","last_peered":"2024-03-26T06:17:03.556221+0000","last_clean":"2024-03-26T06:17:03.556221+0000","last_became_active":"2024-03-26T06:17:02.877110+0000","last_became_peered":"2024-03-26T06:17:02.877110+0000","last_unstale":"2024-03-26T06:17:03.556221+0000","last_undegraded":"2024-03-26T06:17:03.556221+0000","last_fullsized":"2024-03-26T06:17:03.556221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:53:39.247476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600081+0000","last_change":"2024-03-26T06:16:58.537036+0000","last_active":"2024-03-26T06:17:03.600081+0000","last_peered":"2024-03-26T06:17:03.600081+0000","last_clean":"2024-03-26T06:17:03.600081+0000","last_became_active":"2024-03-26T06:16:58.536769+0000","last_became_peered":"2024-03-26T06:16:58.536769+0000","last_unstale":"2024-03-26T06:17:03.600081+0000","last_undegraded":"2024-03-26T06:17:03.600081+0000","last_fullsized":"2024-03-26T06:17:03.600081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:35.743222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554459+0000","last_change":"2024-03-26T06:16:57.503002+0000","last_active":"2024-03-26T06:17:03.554459+0000","last_peered":"2024-03-26T06:17:03.554459+0000","last_clean":"2024-03-26T06:17:03.554459+0000","last_became_active":"2024-03-26T06:16:57.502634+0000","last_became_peered":"2024-03-26T06:16:57.502634+0000","last_unstale":"2024-03-26T06:17:03.554459+0000","last_undegraded":"2024-03-26T06:17:03.554459+0000","last_fullsized":"2024-03-26T06:17:03.554459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557086+0000","last_change":"2024-03-26T06:17:02.881309+0000","last_active":"2024-03-26T06:17:03.557086+0000","last_peered":"2024-03-26T06:17:03.557086+0000","last_clean":"2024-03-26T06:17:03.557086+0000","last_became_active":"2024-03-26T06:17:02.875761+0000","last_became_peered":"2024-03-26T06:17:02.875761+0000","last_unstale":"2024-03-26T06:17:03.557086+0000","last_undegraded":"2024-03-26T06:17:03.557086+0000","last_fullsized":"2024-03-26T06:17:03.557086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:12:15.149201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594732+0000","last_change":"2024-03-26T06:16:58.525054+0000","last_active":"2024-03-26T06:17:03.594732+0000","last_peered":"2024-03-26T06:17:03.594732+0000","last_clean":"2024-03-26T06:17:03.594732+0000","last_became_active":"2024-03-26T06:16:58.524608+0000","last_became_peered":"2024-03-26T06:16:58.524608+0000","last_unstale":"2024-03-26T06:17:03.594732+0000","last_undegraded":"2024-03-26T06:17:03.594732+0000","last_fullsized":"2024-03-26T06:17:03.594732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:20:28.424836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595048+0000","last_change":"2024-03-26T06:16:57.496736+0000","last_active":"2024-03-26T06:17:03.595048+0000","last_peered":"2024-03-26T06:17:03.595048+0000","last_clean":"2024-03-26T06:17:03.595048+0000","last_became_active":"2024-03-26T06:16:57.496382+0000","last_became_peered":"2024-03-26T06:16:57.496382+0000","last_unstale":"2024-03-26T06:17:03.595048+0000","last_undegraded":"2024-03-26T06:17:03.595048+0000","last_fullsized":"2024-03-26T06:17:03.595048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:20:43.357850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554993+0000","last_change":"2024-03-26T06:17:02.878453+0000","last_active":"2024-03-26T06:17:03.554993+0000","last_peered":"2024-03-26T06:17:03.554993+0000","last_clean":"2024-03-26T06:17:03.554993+0000","last_became_active":"2024-03-26T06:17:02.871508+0000","last_became_peered":"2024-03-26T06:17:02.871508+0000","last_unstale":"2024-03-26T06:17:03.554993+0000","last_undegraded":"2024-03-26T06:17:03.554993+0000","last_fullsized":"2024-03-26T06:17:03.554993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:56:38.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600456+0000","last_change":"2024-03-26T06:16:58.529916+0000","last_active":"2024-03-26T06:17:03.600456+0000","last_peered":"2024-03-26T06:17:03.600456+0000","last_clean":"2024-03-26T06:17:03.600456+0000","last_became_active":"2024-03-26T06:16:58.529278+0000","last_became_peered":"2024-03-26T06:16:58.529278+0000","last_unstale":"2024-03-26T06:17:03.600456+0000","last_undegraded":"2024-03-26T06:17:03.600456+0000","last_fullsized":"2024-03-26T06:17:03.600456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:17.340335+0000","last_change":"2024-03-26T06:16:57.504243+0000","last_active":"2024-03-26T06:17:17.340335+0000","last_peered":"2024-03-26T06:17:17.340335+0000","last_clean":"2024-03-26T06:17:17.340335+0000","last_became_active":"2024-03-26T06:16:57.503731+0000","last_became_peered":"2024-03-26T06:16:57.503731+0000","last_unstale":"2024-03-26T06:17:17.340335+0000","last_undegraded":"2024-03-26T06:17:17.340335+0000","last_fullsized":"2024-03-26T06:17:17.340335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597671+0000","last_change":"2024-03-26T06:17:02.578804+0000","last_active":"2024-03-26T06:17:03.597671+0000","last_peered":"2024-03-26T06:17:03.597671+0000","last_clean":"2024-03-26T06:17:03.597671+0000","last_became_active":"2024-03-26T06:17:02.577517+0000","last_became_peered":"2024-03-26T06:17:02.577517+0000","last_unstale":"2024-03-26T06:17:03.597671+0000","last_undegraded":"2024-03-26T06:17:03.597671+0000","last_fullsized":"2024-03-26T06:17:03.597671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:40.062808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599668+0000","last_change":"2024-03-26T06:16:58.542622+0000","last_active":"2024-03-26T06:17:03.599668+0000","last_peered":"2024-03-26T06:17:03.599668+0000","last_clean":"2024-03-26T06:17:03.599668+0000","last_became_active":"2024-03-26T06:16:58.542271+0000","last_became_peered":"2024-03-26T06:16:58.542271+0000","last_unstale":"2024-03-26T06:17:03.599668+0000","last_undegraded":"2024-03-26T06:17:03.599668+0000","last_fullsized":"2024-03-26T06:17:03.599668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:31.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596026+0000","last_change":"2024-03-26T06:16:57.503753+0000","last_active":"2024-03-26T06:17:03.596026+0000","last_peered":"2024-03-26T06:17:03.596026+0000","last_clean":"2024-03-26T06:17:03.596026+0000","last_became_active":"2024-03-26T06:16:57.503459+0000","last_became_peered":"2024-03-26T06:16:57.503459+0000","last_unstale":"2024-03-26T06:17:03.596026+0000","last_undegraded":"2024-03-26T06:17:03.596026+0000","last_fullsized":"2024-03-26T06:17:03.596026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600050+0000","last_change":"2024-03-26T06:17:02.581612+0000","last_active":"2024-03-26T06:17:03.600050+0000","last_peered":"2024-03-26T06:17:03.600050+0000","last_clean":"2024-03-26T06:17:03.600050+0000","last_became_active":"2024-03-26T06:17:02.580790+0000","last_became_peered":"2024-03-26T06:17:02.580790+0000","last_unstale":"2024-03-26T06:17:03.600050+0000","last_undegraded":"2024-03-26T06:17:03.600050+0000","last_fullsized":"2024-03-26T06:17:03.600050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594361+0000","last_change":"2024-03-26T06:16:58.533339+0000","last_active":"2024-03-26T06:17:03.594361+0000","last_peered":"2024-03-26T06:17:03.594361+0000","last_clean":"2024-03-26T06:17:03.594361+0000","last_became_active":"2024-03-26T06:16:58.533023+0000","last_became_peered":"2024-03-26T06:16:58.533023+0000","last_unstale":"2024-03-26T06:17:03.594361+0000","last_undegraded":"2024-03-26T06:17:03.594361+0000","last_fullsized":"2024-03-26T06:17:03.594361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554096+0000","last_change":"2024-03-26T06:16:57.505342+0000","last_active":"2024-03-26T06:17:03.554096+0000","last_peered":"2024-03-26T06:17:03.554096+0000","last_clean":"2024-03-26T06:17:03.554096+0000","last_became_active":"2024-03-26T06:16:57.505086+0000","last_became_peered":"2024-03-26T06:16:57.505086+0000","last_unstale":"2024-03-26T06:17:03.554096+0000","last_undegraded":"2024-03-26T06:17:03.554096+0000","last_fullsized":"2024-03-26T06:17:03.554096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554475+0000","last_change":"2024-03-26T06:17:02.580018+0000","last_active":"2024-03-26T06:17:03.554475+0000","last_peered":"2024-03-26T06:17:03.554475+0000","last_clean":"2024-03-26T06:17:03.554475+0000","last_became_active":"2024-03-26T06:17:02.579638+0000","last_became_peered":"2024-03-26T06:17:02.579638+0000","last_unstale":"2024-03-26T06:17:03.554475+0000","last_undegraded":"2024-03-26T06:17:03.554475+0000","last_fullsized":"2024-03-26T06:17:03.554475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:11:12.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553848+0000","last_change":"2024-03-26T06:16:58.533277+0000","last_active":"2024-03-26T06:17:03.553848+0000","last_peered":"2024-03-26T06:17:03.553848+0000","last_clean":"2024-03-26T06:17:03.553848+0000","last_became_active":"2024-03-26T06:16:58.529159+0000","last_became_peered":"2024-03-26T06:16:58.529159+0000","last_unstale":"2024-03-26T06:17:03.553848+0000","last_undegraded":"2024-03-26T06:17:03.553848+0000","last_fullsized":"2024-03-26T06:17:03.553848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:40.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596366+0000","last_change":"2024-03-26T06:16:57.510798+0000","last_active":"2024-03-26T06:17:03.596366+0000","last_peered":"2024-03-26T06:17:03.596366+0000","last_clean":"2024-03-26T06:17:03.596366+0000","last_became_active":"2024-03-26T06:16:57.510512+0000","last_became_peered":"2024-03-26T06:16:57.510512+0000","last_unstale":"2024-03-26T06:17:03.596366+0000","last_undegraded":"2024-03-26T06:17:03.596366+0000","last_fullsized":"2024-03-26T06:17:03.596366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554417+0000","last_change":"2024-03-26T06:17:02.886655+0000","last_active":"2024-03-26T06:17:03.554417+0000","last_peered":"2024-03-26T06:17:03.554417+0000","last_clean":"2024-03-26T06:17:03.554417+0000","last_became_active":"2024-03-26T06:17:02.883226+0000","last_became_peered":"2024-03-26T06:17:02.883226+0000","last_unstale":"2024-03-26T06:17:03.554417+0000","last_undegraded":"2024-03-26T06:17:03.554417+0000","last_fullsized":"2024-03-26T06:17:03.554417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:08:21.367362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594521+0000","last_change":"2024-03-26T06:17:02.884097+0000","last_active":"2024-03-26T06:17:03.594521+0000","last_peered":"2024-03-26T06:17:03.594521+0000","last_clean":"2024-03-26T06:17:03.594521+0000","last_became_active":"2024-03-26T06:17:02.876466+0000","last_became_peered":"2024-03-26T06:17:02.876466+0000","last_unstale":"2024-03-26T06:17:03.594521+0000","last_undegraded":"2024-03-26T06:17:03.594521+0000","last_fullsized":"2024-03-26T06:17:03.594521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593783+0000","last_change":"2024-03-26T06:16:58.519241+0000","last_active":"2024-03-26T06:17:03.593783+0000","last_peered":"2024-03-26T06:17:03.593783+0000","last_clean":"2024-03-26T06:17:03.593783+0000","last_became_active":"2024-03-26T06:16:58.518964+0000","last_became_peered":"2024-03-26T06:16:58.518964+0000","last_unstale":"2024-03-26T06:17:03.593783+0000","last_undegraded":"2024-03-26T06:17:03.593783+0000","last_fullsized":"2024-03-26T06:17:03.593783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553403+0000","last_change":"2024-03-26T06:16:57.501927+0000","last_active":"2024-03-26T06:17:03.553403+0000","last_peered":"2024-03-26T06:17:03.553403+0000","last_clean":"2024-03-26T06:17:03.553403+0000","last_became_active":"2024-03-26T06:16:57.501575+0000","last_became_peered":"2024-03-26T06:16:57.501575+0000","last_unstale":"2024-03-26T06:17:03.553403+0000","last_undegraded":"2024-03-26T06:17:03.553403+0000","last_fullsized":"2024-03-26T06:17:03.553403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596166+0000","last_change":"2024-03-26T06:17:02.573739+0000","last_active":"2024-03-26T06:17:03.596166+0000","last_peered":"2024-03-26T06:17:03.596166+0000","last_clean":"2024-03-26T06:17:03.596166+0000","last_became_active":"2024-03-26T06:17:02.573280+0000","last_became_peered":"2024-03-26T06:17:02.573280+0000","last_unstale":"2024-03-26T06:17:03.596166+0000","last_undegraded":"2024-03-26T06:17:03.596166+0000","last_fullsized":"2024-03-26T06:17:03.596166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554477+0000","last_change":"2024-03-26T06:16:58.516850+0000","last_active":"2024-03-26T06:17:03.554477+0000","last_peered":"2024-03-26T06:17:03.554477+0000","last_clean":"2024-03-26T06:17:03.554477+0000","last_became_active":"2024-03-26T06:16:58.516487+0000","last_became_peered":"2024-03-26T06:16:58.516487+0000","last_unstale":"2024-03-26T06:17:03.554477+0000","last_undegraded":"2024-03-26T06:17:03.554477+0000","last_fullsized":"2024-03-26T06:17:03.554477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554926+0000","last_change":"2024-03-26T06:16:57.505539+0000","last_active":"2024-03-26T06:17:03.554926+0000","last_peered":"2024-03-26T06:17:03.554926+0000","last_clean":"2024-03-26T06:17:03.554926+0000","last_became_active":"2024-03-26T06:16:57.504681+0000","last_became_peered":"2024-03-26T06:16:57.504681+0000","last_unstale":"2024-03-26T06:17:03.554926+0000","last_undegraded":"2024-03-26T06:17:03.554926+0000","last_fullsized":"2024-03-26T06:17:03.554926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:02:07.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596247+0000","last_change":"2024-03-26T06:16:57.508895+0000","last_active":"2024-03-26T06:17:03.596247+0000","last_peered":"2024-03-26T06:17:03.596247+0000","last_clean":"2024-03-26T06:17:03.596247+0000","last_became_active":"2024-03-26T06:16:57.508519+0000","last_became_peered":"2024-03-26T06:16:57.508519+0000","last_unstale":"2024-03-26T06:17:03.596247+0000","last_undegraded":"2024-03-26T06:17:03.596247+0000","last_fullsized":"2024-03-26T06:17:03.596247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594814+0000","last_change":"2024-03-26T06:16:58.529802+0000","last_active":"2024-03-26T06:17:03.594814+0000","last_peered":"2024-03-26T06:17:03.594814+0000","last_clean":"2024-03-26T06:17:03.594814+0000","last_became_active":"2024-03-26T06:16:58.529237+0000","last_became_peered":"2024-03-26T06:16:58.529237+0000","last_unstale":"2024-03-26T06:17:03.594814+0000","last_undegraded":"2024-03-26T06:17:03.594814+0000","last_fullsized":"2024-03-26T06:17:03.594814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.551059+0000","last_change":"2024-03-26T06:17:02.579718+0000","last_active":"2024-03-26T06:17:03.551059+0000","last_peered":"2024-03-26T06:17:03.551059+0000","last_clean":"2024-03-26T06:17:03.551059+0000","last_became_active":"2024-03-26T06:17:02.579292+0000","last_became_peered":"2024-03-26T06:17:02.579292+0000","last_unstale":"2024-03-26T06:17:03.551059+0000","last_undegraded":"2024-03-26T06:17:03.551059+0000","last_fullsized":"2024-03-26T06:17:03.551059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:20:32.495229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555975+0000","last_change":"2024-03-26T06:16:57.505594+0000","last_active":"2024-03-26T06:17:03.555975+0000","last_peered":"2024-03-26T06:17:03.555975+0000","last_clean":"2024-03-26T06:17:03.555975+0000","last_became_active":"2024-03-26T06:16:57.504217+0000","last_became_peered":"2024-03-26T06:16:57.504217+0000","last_unstale":"2024-03-26T06:17:03.555975+0000","last_undegraded":"2024-03-26T06:17:03.555975+0000","last_fullsized":"2024-03-26T06:17:03.555975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:56.691656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597497+0000","last_change":"2024-03-26T06:16:58.525527+0000","last_active":"2024-03-26T06:17:03.597497+0000","last_peered":"2024-03-26T06:17:03.597497+0000","last_clean":"2024-03-26T06:17:03.597497+0000","last_became_active":"2024-03-26T06:16:58.525120+0000","last_became_peered":"2024-03-26T06:16:58.525120+0000","last_unstale":"2024-03-26T06:17:03.597497+0000","last_undegraded":"2024-03-26T06:17:03.597497+0000","last_fullsized":"2024-03-26T06:17:03.597497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:16.071262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555281+0000","last_change":"2024-03-26T06:17:02.579294+0000","last_active":"2024-03-26T06:17:03.555281+0000","last_peered":"2024-03-26T06:17:03.555281+0000","last_clean":"2024-03-26T06:17:03.555281+0000","last_became_active":"2024-03-26T06:17:02.578906+0000","last_became_peered":"2024-03-26T06:17:02.578906+0000","last_unstale":"2024-03-26T06:17:03.555281+0000","last_undegraded":"2024-03-26T06:17:03.555281+0000","last_fullsized":"2024-03-26T06:17:03.555281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:53:09.876582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595338+0000","last_change":"2024-03-26T06:16:58.516379+0000","last_active":"2024-03-26T06:17:03.595338+0000","last_peered":"2024-03-26T06:17:03.595338+0000","last_clean":"2024-03-26T06:17:03.595338+0000","last_became_active":"2024-03-26T06:16:58.516077+0000","last_became_peered":"2024-03-26T06:16:58.516077+0000","last_unstale":"2024-03-26T06:17:03.595338+0000","last_undegraded":"2024-03-26T06:17:03.595338+0000","last_fullsized":"2024-03-26T06:17:03.595338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.549738+0000","last_change":"2024-03-26T06:16:58.532505+0000","last_active":"2024-03-26T06:17:03.549738+0000","last_peered":"2024-03-26T06:17:03.549738+0000","last_clean":"2024-03-26T06:17:03.549738+0000","last_became_active":"2024-03-26T06:16:58.529934+0000","last_became_peered":"2024-03-26T06:16:58.529934+0000","last_unstale":"2024-03-26T06:17:03.549738+0000","last_undegraded":"2024-03-26T06:17:03.549738+0000","last_fullsized":"2024-03-26T06:17:03.549738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:31.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554160+0000","last_change":"2024-03-26T06:16:58.522722+0000","last_active":"2024-03-26T06:17:03.554160+0000","last_peered":"2024-03-26T06:17:03.554160+0000","last_clean":"2024-03-26T06:17:03.554160+0000","last_became_active":"2024-03-26T06:16:58.522370+0000","last_became_peered":"2024-03-26T06:16:58.522370+0000","last_unstale":"2024-03-26T06:17:03.554160+0000","last_undegraded":"2024-03-26T06:17:03.554160+0000","last_fullsized":"2024-03-26T06:17:03.554160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594678+0000","last_change":"2024-03-26T06:16:58.520281+0000","last_active":"2024-03-26T06:17:03.594678+0000","last_peered":"2024-03-26T06:17:03.594678+0000","last_clean":"2024-03-26T06:17:03.594678+0000","last_became_active":"2024-03-26T06:16:58.519985+0000","last_became_peered":"2024-03-26T06:16:58.519985+0000","last_unstale":"2024-03-26T06:17:03.594678+0000","last_undegraded":"2024-03-26T06:17:03.594678+0000","last_fullsized":"2024-03-26T06:17:03.594678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557423+0000","last_change":"2024-03-26T06:16:58.529109+0000","last_active":"2024-03-26T06:17:03.557423+0000","last_peered":"2024-03-26T06:17:03.557423+0000","last_clean":"2024-03-26T06:17:03.557423+0000","last_became_active":"2024-03-26T06:16:58.528801+0000","last_became_peered":"2024-03-26T06:16:58.528801+0000","last_unstale":"2024-03-26T06:17:03.557423+0000","last_undegraded":"2024-03-26T06:17:03.557423+0000","last_fullsized":"2024-03-26T06:17:03.557423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595616+0000","last_change":"2024-03-26T06:16:58.520275+0000","last_active":"2024-03-26T06:17:03.595616+0000","last_peered":"2024-03-26T06:17:03.595616+0000","last_clean":"2024-03-26T06:17:03.595616+0000","last_became_active":"2024-03-26T06:16:58.519968+0000","last_became_peered":"2024-03-26T06:16:58.519968+0000","last_unstale":"2024-03-26T06:17:03.595616+0000","last_undegraded":"2024-03-26T06:17:03.595616+0000","last_fullsized":"2024-03-26T06:17:03.595616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600878+0000","last_change":"2024-03-26T06:16:58.529307+0000","last_active":"2024-03-26T06:17:03.600878+0000","last_peered":"2024-03-26T06:17:03.600878+0000","last_clean":"2024-03-26T06:17:03.600878+0000","last_became_active":"2024-03-26T06:16:58.528918+0000","last_became_peered":"2024-03-26T06:16:58.528918+0000","last_unstale":"2024-03-26T06:17:03.600878+0000","last_undegraded":"2024-03-26T06:17:03.600878+0000","last_fullsized":"2024-03-26T06:17:03.600878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556360+0000","last_change":"2024-03-26T06:16:58.529346+0000","last_active":"2024-03-26T06:17:03.556360+0000","last_peered":"2024-03-26T06:17:03.556360+0000","last_clean":"2024-03-26T06:17:03.556360+0000","last_became_active":"2024-03-26T06:16:58.528998+0000","last_became_peered":"2024-03-26T06:16:58.528998+0000","last_unstale":"2024-03-26T06:17:03.556360+0000","last_undegraded":"2024-03-26T06:17:03.556360+0000","last_fullsized":"2024-03-26T06:17:03.556360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553105+0000","last_change":"2024-03-26T06:16:58.524089+0000","last_active":"2024-03-26T06:17:03.553105+0000","last_peered":"2024-03-26T06:17:03.553105+0000","last_clean":"2024-03-26T06:17:03.553105+0000","last_became_active":"2024-03-26T06:16:58.522756+0000","last_became_peered":"2024-03-26T06:16:58.522756+0000","last_unstale":"2024-03-26T06:17:03.553105+0000","last_undegraded":"2024-03-26T06:17:03.553105+0000","last_fullsized":"2024-03-26T06:17:03.553105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554786+0000","last_change":"2024-03-26T06:16:58.530175+0000","last_active":"2024-03-26T06:17:03.554786+0000","last_peered":"2024-03-26T06:17:03.554786+0000","last_clean":"2024-03-26T06:17:03.554786+0000","last_became_active":"2024-03-26T06:16:58.529900+0000","last_became_peered":"2024-03-26T06:16:58.529900+0000","last_unstale":"2024-03-26T06:17:03.554786+0000","last_undegraded":"2024-03-26T06:17:03.554786+0000","last_fullsized":"2024-03-26T06:17:03.554786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553982+0000","last_change":"2024-03-26T06:16:58.529902+0000","last_active":"2024-03-26T06:17:03.553982+0000","last_peered":"2024-03-26T06:17:03.553982+0000","last_clean":"2024-03-26T06:17:03.553982+0000","last_became_active":"2024-03-26T06:16:58.525109+0000","last_became_peered":"2024-03-26T06:16:58.525109+0000","last_unstale":"2024-03-26T06:17:03.553982+0000","last_undegraded":"2024-03-26T06:17:03.553982+0000","last_fullsized":"2024-03-26T06:17:03.553982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593384+0000","last_change":"2024-03-26T06:16:58.529175+0000","last_active":"2024-03-26T06:17:03.593384+0000","last_peered":"2024-03-26T06:17:03.593384+0000","last_clean":"2024-03-26T06:17:03.593384+0000","last_became_active":"2024-03-26T06:16:58.525707+0000","last_became_peered":"2024-03-26T06:16:58.525707+0000","last_unstale":"2024-03-26T06:17:03.593384+0000","last_undegraded":"2024-03-26T06:17:03.593384+0000","last_fullsized":"2024-03-26T06:17:03.593384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:22:40.139697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595961+0000","last_change":"2024-03-26T06:16:58.526724+0000","last_active":"2024-03-26T06:17:03.595961+0000","last_peered":"2024-03-26T06:17:03.595961+0000","last_clean":"2024-03-26T06:17:03.595961+0000","last_became_active":"2024-03-26T06:16:58.526193+0000","last_became_peered":"2024-03-26T06:16:58.526193+0000","last_unstale":"2024-03-26T06:17:03.595961+0000","last_undegraded":"2024-03-26T06:17:03.595961+0000","last_fullsized":"2024-03-26T06:17:03.595961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601351+0000","last_change":"2024-03-26T06:16:58.527308+0000","last_active":"2024-03-26T06:17:03.601351+0000","last_peered":"2024-03-26T06:17:03.601351+0000","last_clean":"2024-03-26T06:17:03.601351+0000","last_became_active":"2024-03-26T06:16:58.526990+0000","last_became_peered":"2024-03-26T06:16:58.526990+0000","last_unstale":"2024-03-26T06:17:03.601351+0000","last_undegraded":"2024-03-26T06:17:03.601351+0000","last_fullsized":"2024-03-26T06:17:03.601351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:40.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550779+0000","last_change":"2024-03-26T06:16:58.522409+0000","last_active":"2024-03-26T06:17:03.550779+0000","last_peered":"2024-03-26T06:17:03.550779+0000","last_clean":"2024-03-26T06:17:03.550779+0000","last_became_active":"2024-03-26T06:16:58.521947+0000","last_became_peered":"2024-03-26T06:16:58.521947+0000","last_unstale":"2024-03-26T06:17:03.550779+0000","last_undegraded":"2024-03-26T06:17:03.550779+0000","last_fullsized":"2024-03-26T06:17:03.550779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:28.052525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554877+0000","last_change":"2024-03-26T06:16:58.541494+0000","last_active":"2024-03-26T06:17:03.554877+0000","last_peered":"2024-03-26T06:17:03.554877+0000","last_clean":"2024-03-26T06:17:03.554877+0000","last_became_active":"2024-03-26T06:16:58.541225+0000","last_became_peered":"2024-03-26T06:16:58.541225+0000","last_unstale":"2024-03-26T06:17:03.554877+0000","last_undegraded":"2024-03-26T06:17:03.554877+0000","last_fullsized":"2024-03-26T06:17:03.554877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:35.743222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.552810+0000","last_change":"2024-03-26T06:16:58.533315+0000","last_active":"2024-03-26T06:17:03.552810+0000","last_peered":"2024-03-26T06:17:03.552810+0000","last_clean":"2024-03-26T06:17:03.552810+0000","last_became_active":"2024-03-26T06:16:58.528051+0000","last_became_peered":"2024-03-26T06:16:58.528051+0000","last_unstale":"2024-03-26T06:17:03.552810+0000","last_undegraded":"2024-03-26T06:17:03.552810+0000","last_fullsized":"2024-03-26T06:17:03.552810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594978+0000","last_change":"2024-03-26T06:16:58.527009+0000","last_active":"2024-03-26T06:17:03.594978+0000","last_peered":"2024-03-26T06:17:03.594978+0000","last_clean":"2024-03-26T06:17:03.594978+0000","last_became_active":"2024-03-26T06:16:58.526743+0000","last_became_peered":"2024-03-26T06:16:58.526743+0000","last_unstale":"2024-03-26T06:17:03.594978+0000","last_undegraded":"2024-03-26T06:17:03.594978+0000","last_fullsized":"2024-03-26T06:17:03.594978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594651+0000","last_change":"2024-03-26T06:16:58.507099+0000","last_active":"2024-03-26T06:17:03.594651+0000","last_peered":"2024-03-26T06:17:03.594651+0000","last_clean":"2024-03-26T06:17:03.594651+0000","last_became_active":"2024-03-26T06:16:58.506705+0000","last_became_peered":"2024-03-26T06:16:58.506705+0000","last_unstale":"2024-03-26T06:17:03.594651+0000","last_undegraded":"2024-03-26T06:17:03.594651+0000","last_fullsized":"2024-03-26T06:17:03.594651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:17:59.821941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555438+0000","last_change":"2024-03-26T06:16:58.516376+0000","last_active":"2024-03-26T06:17:03.555438+0000","last_peered":"2024-03-26T06:17:03.555438+0000","last_clean":"2024-03-26T06:17:03.555438+0000","last_became_active":"2024-03-26T06:16:58.515999+0000","last_became_peered":"2024-03-26T06:16:58.515999+0000","last_unstale":"2024-03-26T06:17:03.555438+0000","last_undegraded":"2024-03-26T06:17:03.555438+0000","last_fullsized":"2024-03-26T06:17:03.555438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599454+0000","last_change":"2024-03-26T06:16:58.544901+0000","last_active":"2024-03-26T06:17:03.599454+0000","last_peered":"2024-03-26T06:17:03.599454+0000","last_clean":"2024-03-26T06:17:03.599454+0000","last_became_active":"2024-03-26T06:16:58.544637+0000","last_became_peered":"2024-03-26T06:16:58.544637+0000","last_unstale":"2024-03-26T06:17:03.599454+0000","last_undegraded":"2024-03-26T06:17:03.599454+0000","last_fullsized":"2024-03-26T06:17:03.599454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:28.052525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596829+0000","last_change":"2024-03-26T06:16:58.536619+0000","last_active":"2024-03-26T06:17:03.596829+0000","last_peered":"2024-03-26T06:17:03.596829+0000","last_clean":"2024-03-26T06:17:03.596829+0000","last_became_active":"2024-03-26T06:16:58.536267+0000","last_became_peered":"2024-03-26T06:16:58.536267+0000","last_unstale":"2024-03-26T06:17:03.596829+0000","last_undegraded":"2024-03-26T06:17:03.596829+0000","last_fullsized":"2024-03-26T06:17:03.596829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600622+0000","last_change":"2024-03-26T06:16:58.538210+0000","last_active":"2024-03-26T06:17:03.600622+0000","last_peered":"2024-03-26T06:17:03.600622+0000","last_clean":"2024-03-26T06:17:03.600622+0000","last_became_active":"2024-03-26T06:16:58.537967+0000","last_became_peered":"2024-03-26T06:16:58.537967+0000","last_unstale":"2024-03-26T06:17:03.600622+0000","last_undegraded":"2024-03-26T06:17:03.600622+0000","last_fullsized":"2024-03-26T06:17:03.600622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.602020+0000","last_change":"2024-03-26T06:16:58.540273+0000","last_active":"2024-03-26T06:17:03.602020+0000","last_peered":"2024-03-26T06:17:03.602020+0000","last_clean":"2024-03-26T06:17:03.602020+0000","last_became_active":"2024-03-26T06:16:58.539908+0000","last_became_peered":"2024-03-26T06:16:58.539908+0000","last_unstale":"2024-03-26T06:17:03.602020+0000","last_undegraded":"2024-03-26T06:17:03.602020+0000","last_fullsized":"2024-03-26T06:17:03.602020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:12:57.541865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554144+0000","last_change":"2024-03-26T06:16:58.535528+0000","last_active":"2024-03-26T06:17:03.554144+0000","last_peered":"2024-03-26T06:17:03.554144+0000","last_clean":"2024-03-26T06:17:03.554144+0000","last_became_active":"2024-03-26T06:16:58.535213+0000","last_became_peered":"2024-03-26T06:16:58.535213+0000","last_unstale":"2024-03-26T06:17:03.554144+0000","last_undegraded":"2024-03-26T06:17:03.554144+0000","last_fullsized":"2024-03-26T06:17:03.554144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598687+0000","last_change":"2024-03-26T06:16:58.525785+0000","last_active":"2024-03-26T06:17:03.598687+0000","last_peered":"2024-03-26T06:17:03.598687+0000","last_clean":"2024-03-26T06:17:03.598687+0000","last_became_active":"2024-03-26T06:16:58.525444+0000","last_became_peered":"2024-03-26T06:16:58.525444+0000","last_unstale":"2024-03-26T06:17:03.598687+0000","last_undegraded":"2024-03-26T06:17:03.598687+0000","last_fullsized":"2024-03-26T06:17:03.598687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553717+0000","last_change":"2024-03-26T06:16:58.532698+0000","last_active":"2024-03-26T06:17:03.553717+0000","last_peered":"2024-03-26T06:17:03.553717+0000","last_clean":"2024-03-26T06:17:03.553717+0000","last_became_active":"2024-03-26T06:16:58.532381+0000","last_became_peered":"2024-03-26T06:16:58.532381+0000","last_unstale":"2024-03-26T06:17:03.553717+0000","last_undegraded":"2024-03-26T06:17:03.553717+0000","last_fullsized":"2024-03-26T06:17:03.553717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599589+0000","last_change":"2024-03-26T06:16:58.524657+0000","last_active":"2024-03-26T06:17:03.599589+0000","last_peered":"2024-03-26T06:17:03.599589+0000","last_clean":"2024-03-26T06:17:03.599589+0000","last_became_active":"2024-03-26T06:16:58.524265+0000","last_became_peered":"2024-03-26T06:16:58.524265+0000","last_unstale":"2024-03-26T06:17:03.599589+0000","last_undegraded":"2024-03-26T06:17:03.599589+0000","last_fullsized":"2024-03-26T06:17:03.599589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:30.208261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553997+0000","last_change":"2024-03-26T06:16:58.523272+0000","last_active":"2024-03-26T06:17:03.553997+0000","last_peered":"2024-03-26T06:17:03.553997+0000","last_clean":"2024-03-26T06:17:03.553997+0000","last_became_active":"2024-03-26T06:16:58.522614+0000","last_became_peered":"2024-03-26T06:16:58.522614+0000","last_unstale":"2024-03-26T06:17:03.553997+0000","last_undegraded":"2024-03-26T06:17:03.553997+0000","last_fullsized":"2024-03-26T06:17:03.553997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:17.123689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594564+0000","last_change":"2024-03-26T06:16:58.519796+0000","last_active":"2024-03-26T06:17:03.594564+0000","last_peered":"2024-03-26T06:17:03.594564+0000","last_clean":"2024-03-26T06:17:03.594564+0000","last_became_active":"2024-03-26T06:16:58.516658+0000","last_became_peered":"2024-03-26T06:16:58.516658+0000","last_unstale":"2024-03-26T06:17:03.594564+0000","last_undegraded":"2024-03-26T06:17:03.594564+0000","last_fullsized":"2024-03-26T06:17:03.594564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:19:35.554524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595916+0000","last_change":"2024-03-26T06:16:58.505664+0000","last_active":"2024-03-26T06:17:03.595916+0000","last_peered":"2024-03-26T06:17:03.595916+0000","last_clean":"2024-03-26T06:17:03.595916+0000","last_became_active":"2024-03-26T06:16:58.505309+0000","last_became_peered":"2024-03-26T06:16:58.505309+0000","last_unstale":"2024-03-26T06:17:03.595916+0000","last_undegraded":"2024-03-26T06:17:03.595916+0000","last_fullsized":"2024-03-26T06:17:03.595916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601776+0000","last_change":"2024-03-26T06:16:58.539992+0000","last_active":"2024-03-26T06:17:03.601776+0000","last_peered":"2024-03-26T06:17:03.601776+0000","last_clean":"2024-03-26T06:17:03.601776+0000","last_became_active":"2024-03-26T06:16:58.539588+0000","last_became_peered":"2024-03-26T06:16:58.539588+0000","last_unstale":"2024-03-26T06:17:03.601776+0000","last_undegraded":"2024-03-26T06:17:03.601776+0000","last_fullsized":"2024-03-26T06:17:03.601776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:17.123689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-26T06:17:27.892 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-26T06:17:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.121+0000 7f7ec3200640 1 Processor -- start 2024-03-26T06:17:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.121+0000 7f7ec3200640 1 -- start start 2024-03-26T06:17:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.122+0000 7f7ec3200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ec415d9a0 0x7f7ec40b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.122+0000 7f7ec3200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 0x7f7ec40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec3200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec40b97c0 con 0x7f7ec40d3250 2024-03-26T06:17:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec3200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec40d21b0 con 0x7f7ec415d9a0 2024-03-26T06:17:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec3200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40d2490 con 0x7f7ec40d1c10 2024-03-26T06:17:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec1e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ec415d9a0 0x7f7ec40b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec1e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ec415d9a0 0x7f7ec40b9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50100/0 (socket says 172.21.15.63:50100) 2024-03-26T06:17:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec1e00640 1 -- 172.21.15.63:0/207795035 learned_addr learned my addr 172.21.15.63:0/207795035 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:28.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec1400640 1 --2- 172.21.15.63:0/207795035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 0x7f7ec40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec1e00640 1 -- 172.21.15.63:0/207795035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 msgr2=0x7f7ec40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:28.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec1e00640 1 --2- 172.21.15.63:0/207795035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 0x7f7ec40ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec1e00640 1 -- 172.21.15.63:0/207795035 >> v1:172.21.15.204:6789/0 conn(0x7f7ec40d3250 legacy=0x7f7ec40b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.123+0000 7f7ec1e00640 1 -- 172.21.15.63:0/207795035 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40d2770 con 0x7f7ec415d9a0 2024-03-26T06:17:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.124+0000 7f7ec1e00640 1 --2- 172.21.15.63:0/207795035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec415d9a0 0x7f7ec40b9280 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009870 tx=0x7f7eb402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678701f8030cfe5 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec0a00640 1 -- 172.21.15.63:0/207795035 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40317c0 con 0x7f7ec415d9a0 2024-03-26T06:17:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec0a00640 1 -- 172.21.15.63:0/207795035 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4037070 con 0x7f7ec415d9a0 2024-03-26T06:17:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec0a00640 1 -- 172.21.15.63:0/207795035 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4031b80 con 0x7f7ec415d9a0 2024-03-26T06:17:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec3200640 1 -- 172.21.15.63:0/207795035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec415d9a0 msgr2=0x7f7ec40b9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec3200640 1 --2- 172.21.15.63:0/207795035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec415d9a0 0x7f7ec40b9280 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009870 tx=0x7f7eb402b860 comp rx=0 tx=0).stop 2024-03-26T06:17:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec3200640 1 -- 172.21.15.63:0/207795035 shutdown_connections 2024-03-26T06:17:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec3200640 1 --2- 172.21.15.63:0/207795035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 0x7f7ec40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec3200640 1 --2- 172.21.15.63:0/207795035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec415d9a0 0x7f7ec40b9280 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec3200640 1 -- 172.21.15.63:0/207795035 >> 172.21.15.63:0/207795035 conn(0x7f7ec406bfa0 msgr2=0x7f7ec406c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec3200640 1 -- 172.21.15.63:0/207795035 shutdown_connections 2024-03-26T06:17:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.125+0000 7f7ec3200640 1 -- 172.21.15.63:0/207795035 wait complete. 2024-03-26T06:17:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.128+0000 7f7ec3200640 1 Processor -- start 2024-03-26T06:17:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.128+0000 7f7ec3200640 1 -- start start 2024-03-26T06:17:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec3200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 0x7f7ec40b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec40d3250 0x7f7ec40c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec3200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ec415d9a0 0x7f7ec41f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec415dd80 con 0x7f7ec40d3250 2024-03-26T06:17:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec3200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40d2d30 con 0x7f7ec415d9a0 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec3200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40cea50 con 0x7f7ec40d1c10 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec40d3250 0x7f7ec40c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec40d3250 0x7f7ec40c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50108/0 (socket says 172.21.15.63:50108) 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec1400640 1 -- 172.21.15.63:0/1323060138 learned_addr learned my addr 172.21.15.63:0/1323060138 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec1e00640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 0x7f7ec40b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec1400640 1 -- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 msgr2=0x7f7ec40b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec2800640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ec415d9a0 0x7f7ec41f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec1400640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 0x7f7ec40b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec1400640 1 -- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ec415d9a0 msgr2=0x7f7ec41f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.130+0000 7f7ec1400640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ec415d9a0 0x7f7ec41f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.131+0000 7f7ec1400640 1 -- 172.21.15.63:0/1323060138 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40cc320 con 0x7f7ec40d3250 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.131+0000 7f7ec1e00640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 0x7f7ec40b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.131+0000 7f7ec2800640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ec415d9a0 0x7f7ec41f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.131+0000 7f7ec1400640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec40d3250 0x7f7ec40c95f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000c7f0 tx=0x7f7eb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.131+0000 7f7eba000640 1 -- 172.21.15.63:0/1323060138 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0015070 con 0x7f7ec40d3250 2024-03-26T06:17:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.131+0000 7f7eba000640 1 -- 172.21.15.63:0/1323060138 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0004240 con 0x7f7ec40d3250 2024-03-26T06:17:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.131+0000 7f7eba000640 1 -- 172.21.15.63:0/1323060138 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0007620 con 0x7f7ec40d3250 2024-03-26T06:17:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.131+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec40cc600 con 0x7f7ec40d3250 2024-03-26T06:17:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.131+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec40ccbc0 con 0x7f7ec40d3250 2024-03-26T06:17:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.133+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec404f050 con 0x7f7ec40d3250 2024-03-26T06:17:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.133+0000 7f7eba000640 1 -- 172.21.15.63:0/1323060138 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7eb00079d0 con 0x7f7ec40d3250 2024-03-26T06:17:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.134+0000 7f7eba000640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7ea406bbd0 0x7f7ea406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.134+0000 7f7eba000640 1 -- 172.21.15.63:0/1323060138 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7eb008b250 con 0x7f7ec40d3250 2024-03-26T06:17:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.134+0000 7f7ec1e00640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7ea406bbd0 0x7f7ea406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.135+0000 7f7ec1e00640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7ea406bbd0 0x7f7ea406e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4036000 tx=0x7f7eb4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.139+0000 7f7eba000640 1 -- 172.21.15.63:0/1323060138 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7eb00599f0 con 0x7f7ec40d3250 2024-03-26T06:17:28.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.351+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 --> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ec4160fc0 con 0x7f7ea406bbd0 2024-03-26T06:17:28.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.365+0000 7f7eba000640 1 -- 172.21.15.63:0/1323060138 <== mgr.4104 v2:172.21.15.63:6832/3591189670 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332537 (secure 0 0 0) 0x7f7ec4160fc0 con 0x7f7ea406bbd0 2024-03-26T06:17:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:28.372 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-03-26T06:17:28.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7ea406bbd0 msgr2=0x7f7ea406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7ea406bbd0 0x7f7ea406e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4036000 tx=0x7f7eb4008030 comp rx=0 tx=0).stop 2024-03-26T06:17:28.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec40d3250 msgr2=0x7f7ec40c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec40d3250 0x7f7ec40c95f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000c7f0 tx=0x7f7eb000ccb0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 shutdown_connections 2024-03-26T06:17:28.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7ea406bbd0 0x7f7ea406e090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ec415d9a0 0x7f7ec41f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ec40d3250 0x7f7ec40c95f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 --2- 172.21.15.63:0/1323060138 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ec40d1c10 0x7f7ec40b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 >> 172.21.15.63:0/1323060138 conn(0x7f7ec406bfa0 msgr2=0x7f7ec40c7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:28.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 shutdown_connections 2024-03-26T06:17:28.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.370+0000 7f7ec3200640 1 -- 172.21.15.63:0/1323060138 wait complete. 2024-03-26T06:17:28.387 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-03-26T06:17:27.887166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004540"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595035+0000","last_change":"2024-03-26T06:16:57.506890+0000","last_active":"2024-03-26T06:17:03.595035+0000","last_peered":"2024-03-26T06:17:03.595035+0000","last_clean":"2024-03-26T06:17:03.595035+0000","last_became_active":"2024-03-26T06:16:57.506602+0000","last_became_peered":"2024-03-26T06:16:57.506602+0000","last_unstale":"2024-03-26T06:17:03.595035+0000","last_undegraded":"2024-03-26T06:17:03.595035+0000","last_fullsized":"2024-03-26T06:17:03.595035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:14:13.027200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557577+0000","last_change":"2024-03-26T06:16:58.527848+0000","last_active":"2024-03-26T06:17:03.557577+0000","last_peered":"2024-03-26T06:17:03.557577+0000","last_clean":"2024-03-26T06:17:03.557577+0000","last_became_active":"2024-03-26T06:16:58.527552+0000","last_became_peered":"2024-03-26T06:16:58.527552+0000","last_unstale":"2024-03-26T06:17:03.557577+0000","last_undegraded":"2024-03-26T06:17:03.557577+0000","last_fullsized":"2024-03-26T06:17:03.557577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554184+0000","last_change":"2024-03-26T06:17:02.883862+0000","last_active":"2024-03-26T06:17:03.554184+0000","last_peered":"2024-03-26T06:17:03.554184+0000","last_clean":"2024-03-26T06:17:03.554184+0000","last_became_active":"2024-03-26T06:17:02.883030+0000","last_became_peered":"2024-03-26T06:17:02.883030+0000","last_unstale":"2024-03-26T06:17:03.554184+0000","last_undegraded":"2024-03-26T06:17:03.554184+0000","last_fullsized":"2024-03-26T06:17:03.554184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:54:39.278678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557980+0000","last_change":"2024-03-26T06:16:57.498142+0000","last_active":"2024-03-26T06:17:03.557980+0000","last_peered":"2024-03-26T06:17:03.557980+0000","last_clean":"2024-03-26T06:17:03.557980+0000","last_became_active":"2024-03-26T06:16:57.497676+0000","last_became_peered":"2024-03-26T06:16:57.497676+0000","last_unstale":"2024-03-26T06:17:03.557980+0000","last_undegraded":"2024-03-26T06:17:03.557980+0000","last_fullsized":"2024-03-26T06:17:03.557980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594151+0000","last_change":"2024-03-26T06:16:58.533520+0000","last_active":"2024-03-26T06:17:03.594151+0000","last_peered":"2024-03-26T06:17:03.594151+0000","last_clean":"2024-03-26T06:17:03.594151+0000","last_became_active":"2024-03-26T06:16:58.532799+0000","last_became_peered":"2024-03-26T06:16:58.532799+0000","last_unstale":"2024-03-26T06:17:03.594151+0000","last_undegraded":"2024-03-26T06:17:03.594151+0000","last_fullsized":"2024-03-26T06:17:03.594151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597128+0000","last_change":"2024-03-26T06:17:02.581513+0000","last_active":"2024-03-26T06:17:03.597128+0000","last_peered":"2024-03-26T06:17:03.597128+0000","last_clean":"2024-03-26T06:17:03.597128+0000","last_became_active":"2024-03-26T06:17:02.580429+0000","last_became_peered":"2024-03-26T06:17:02.580429+0000","last_unstale":"2024-03-26T06:17:03.597128+0000","last_undegraded":"2024-03-26T06:17:03.597128+0000","last_fullsized":"2024-03-26T06:17:03.597128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:21.836096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601161+0000","last_change":"2024-03-26T06:16:57.517050+0000","last_active":"2024-03-26T06:17:03.601161+0000","last_peered":"2024-03-26T06:17:03.601161+0000","last_clean":"2024-03-26T06:17:03.601161+0000","last_became_active":"2024-03-26T06:16:57.516624+0000","last_became_peered":"2024-03-26T06:16:57.516624+0000","last_unstale":"2024-03-26T06:17:03.601161+0000","last_undegraded":"2024-03-26T06:17:03.601161+0000","last_fullsized":"2024-03-26T06:17:03.601161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:27.040366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554266+0000","last_change":"2024-03-26T06:16:58.528249+0000","last_active":"2024-03-26T06:17:03.554266+0000","last_peered":"2024-03-26T06:17:03.554266+0000","last_clean":"2024-03-26T06:17:03.554266+0000","last_became_active":"2024-03-26T06:16:58.527930+0000","last_became_peered":"2024-03-26T06:16:58.527930+0000","last_unstale":"2024-03-26T06:17:03.554266+0000","last_undegraded":"2024-03-26T06:17:03.554266+0000","last_fullsized":"2024-03-26T06:17:03.554266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:12:57.541865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599529+0000","last_change":"2024-03-26T06:17:02.582621+0000","last_active":"2024-03-26T06:17:03.599529+0000","last_peered":"2024-03-26T06:17:03.599529+0000","last_clean":"2024-03-26T06:17:03.599529+0000","last_became_active":"2024-03-26T06:17:02.581967+0000","last_became_peered":"2024-03-26T06:17:02.581967+0000","last_unstale":"2024-03-26T06:17:03.599529+0000","last_undegraded":"2024-03-26T06:17:03.599529+0000","last_fullsized":"2024-03-26T06:17:03.599529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599843+0000","last_change":"2024-03-26T06:16:57.514049+0000","last_active":"2024-03-26T06:17:03.599843+0000","last_peered":"2024-03-26T06:17:03.599843+0000","last_clean":"2024-03-26T06:17:03.599843+0000","last_became_active":"2024-03-26T06:16:57.513744+0000","last_became_peered":"2024-03-26T06:16:57.513744+0000","last_unstale":"2024-03-26T06:17:03.599843+0000","last_undegraded":"2024-03-26T06:17:03.599843+0000","last_fullsized":"2024-03-26T06:17:03.599843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:30.683728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554334+0000","last_change":"2024-03-26T06:16:58.530727+0000","last_active":"2024-03-26T06:17:03.554334+0000","last_peered":"2024-03-26T06:17:03.554334+0000","last_clean":"2024-03-26T06:17:03.554334+0000","last_became_active":"2024-03-26T06:16:58.530387+0000","last_became_peered":"2024-03-26T06:16:58.530387+0000","last_unstale":"2024-03-26T06:17:03.554334+0000","last_undegraded":"2024-03-26T06:17:03.554334+0000","last_fullsized":"2024-03-26T06:17:03.554334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596867+0000","last_change":"2024-03-26T06:17:02.589397+0000","last_active":"2024-03-26T06:17:03.596867+0000","last_peered":"2024-03-26T06:17:03.596867+0000","last_clean":"2024-03-26T06:17:03.596867+0000","last_became_active":"2024-03-26T06:17:02.588887+0000","last_became_peered":"2024-03-26T06:17:02.588887+0000","last_unstale":"2024-03-26T06:17:03.596867+0000","last_undegraded":"2024-03-26T06:17:03.596867+0000","last_fullsized":"2024-03-26T06:17:03.596867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:07.303274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595731+0000","last_change":"2024-03-26T06:16:58.526427+0000","last_active":"2024-03-26T06:17:03.595731+0000","last_peered":"2024-03-26T06:17:03.595731+0000","last_clean":"2024-03-26T06:17:03.595731+0000","last_became_active":"2024-03-26T06:16:58.526080+0000","last_became_peered":"2024-03-26T06:16:58.526080+0000","last_unstale":"2024-03-26T06:17:03.595731+0000","last_undegraded":"2024-03-26T06:17:03.595731+0000","last_fullsized":"2024-03-26T06:17:03.595731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600384+0000","last_change":"2024-03-26T06:16:57.513120+0000","last_active":"2024-03-26T06:17:03.600384+0000","last_peered":"2024-03-26T06:17:03.600384+0000","last_clean":"2024-03-26T06:17:03.600384+0000","last_became_active":"2024-03-26T06:16:57.512654+0000","last_became_peered":"2024-03-26T06:16:57.512654+0000","last_unstale":"2024-03-26T06:17:03.600384+0000","last_undegraded":"2024-03-26T06:17:03.600384+0000","last_fullsized":"2024-03-26T06:17:03.600384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597983+0000","last_change":"2024-03-26T06:17:02.584892+0000","last_active":"2024-03-26T06:17:03.597983+0000","last_peered":"2024-03-26T06:17:03.597983+0000","last_clean":"2024-03-26T06:17:03.597983+0000","last_became_active":"2024-03-26T06:17:02.584379+0000","last_became_peered":"2024-03-26T06:17:02.584379+0000","last_unstale":"2024-03-26T06:17:03.597983+0000","last_undegraded":"2024-03-26T06:17:03.597983+0000","last_fullsized":"2024-03-26T06:17:03.597983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:46.388330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555728+0000","last_change":"2024-03-26T06:16:58.517155+0000","last_active":"2024-03-26T06:17:03.555728+0000","last_peered":"2024-03-26T06:17:03.555728+0000","last_clean":"2024-03-26T06:17:03.555728+0000","last_became_active":"2024-03-26T06:16:58.516377+0000","last_became_peered":"2024-03-26T06:16:58.516377+0000","last_unstale":"2024-03-26T06:17:03.555728+0000","last_undegraded":"2024-03-26T06:17:03.555728+0000","last_fullsized":"2024-03-26T06:17:03.555728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597289+0000","last_change":"2024-03-26T06:16:57.500506+0000","last_active":"2024-03-26T06:17:03.597289+0000","last_peered":"2024-03-26T06:17:03.597289+0000","last_clean":"2024-03-26T06:17:03.597289+0000","last_became_active":"2024-03-26T06:16:57.499432+0000","last_became_peered":"2024-03-26T06:16:57.499432+0000","last_unstale":"2024-03-26T06:17:03.597289+0000","last_undegraded":"2024-03-26T06:17:03.597289+0000","last_fullsized":"2024-03-26T06:17:03.597289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599068+0000","last_change":"2024-03-26T06:17:02.586266+0000","last_active":"2024-03-26T06:17:03.599068+0000","last_peered":"2024-03-26T06:17:03.599068+0000","last_clean":"2024-03-26T06:17:03.599068+0000","last_became_active":"2024-03-26T06:17:02.585755+0000","last_became_peered":"2024-03-26T06:17:02.585755+0000","last_unstale":"2024-03-26T06:17:03.599068+0000","last_undegraded":"2024-03-26T06:17:03.599068+0000","last_fullsized":"2024-03-26T06:17:03.599068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:36.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554831+0000","last_change":"2024-03-26T06:16:58.516177+0000","last_active":"2024-03-26T06:17:03.554831+0000","last_peered":"2024-03-26T06:17:03.554831+0000","last_clean":"2024-03-26T06:17:03.554831+0000","last_became_active":"2024-03-26T06:16:58.515861+0000","last_became_peered":"2024-03-26T06:16:58.515861+0000","last_unstale":"2024-03-26T06:17:03.554831+0000","last_undegraded":"2024-03-26T06:17:03.554831+0000","last_fullsized":"2024-03-26T06:17:03.554831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595139+0000","last_change":"2024-03-26T06:16:57.506199+0000","last_active":"2024-03-26T06:17:03.595139+0000","last_peered":"2024-03-26T06:17:03.595139+0000","last_clean":"2024-03-26T06:17:03.595139+0000","last_became_active":"2024-03-26T06:16:57.505635+0000","last_became_peered":"2024-03-26T06:16:57.505635+0000","last_unstale":"2024-03-26T06:17:03.595139+0000","last_undegraded":"2024-03-26T06:17:03.595139+0000","last_fullsized":"2024-03-26T06:17:03.595139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596127+0000","last_change":"2024-03-26T06:17:02.877672+0000","last_active":"2024-03-26T06:17:03.596127+0000","last_peered":"2024-03-26T06:17:03.596127+0000","last_clean":"2024-03-26T06:17:03.596127+0000","last_became_active":"2024-03-26T06:17:02.877192+0000","last_became_peered":"2024-03-26T06:17:02.877192+0000","last_unstale":"2024-03-26T06:17:03.596127+0000","last_undegraded":"2024-03-26T06:17:03.596127+0000","last_fullsized":"2024-03-26T06:17:03.596127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598768+0000","last_change":"2024-03-26T06:16:58.521953+0000","last_active":"2024-03-26T06:17:03.598768+0000","last_peered":"2024-03-26T06:17:03.598768+0000","last_clean":"2024-03-26T06:17:03.598768+0000","last_became_active":"2024-03-26T06:16:58.521656+0000","last_became_peered":"2024-03-26T06:16:58.521656+0000","last_unstale":"2024-03-26T06:17:03.598768+0000","last_undegraded":"2024-03-26T06:17:03.598768+0000","last_fullsized":"2024-03-26T06:17:03.598768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:03.428999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597855+0000","last_change":"2024-03-26T06:16:57.508917+0000","last_active":"2024-03-26T06:17:03.597855+0000","last_peered":"2024-03-26T06:17:03.597855+0000","last_clean":"2024-03-26T06:17:03.597855+0000","last_became_active":"2024-03-26T06:16:57.508659+0000","last_became_peered":"2024-03-26T06:16:57.508659+0000","last_unstale":"2024-03-26T06:17:03.597855+0000","last_undegraded":"2024-03-26T06:17:03.597855+0000","last_fullsized":"2024-03-26T06:17:03.597855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600692+0000","last_change":"2024-03-26T06:17:02.583351+0000","last_active":"2024-03-26T06:17:03.600692+0000","last_peered":"2024-03-26T06:17:03.600692+0000","last_clean":"2024-03-26T06:17:03.600692+0000","last_became_active":"2024-03-26T06:17:02.582876+0000","last_became_peered":"2024-03-26T06:17:02.582876+0000","last_unstale":"2024-03-26T06:17:03.600692+0000","last_undegraded":"2024-03-26T06:17:03.600692+0000","last_fullsized":"2024-03-26T06:17:03.600692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595429+0000","last_change":"2024-03-26T06:16:58.508413+0000","last_active":"2024-03-26T06:17:03.595429+0000","last_peered":"2024-03-26T06:17:03.595429+0000","last_clean":"2024-03-26T06:17:03.595429+0000","last_became_active":"2024-03-26T06:16:58.508024+0000","last_became_peered":"2024-03-26T06:16:58.508024+0000","last_unstale":"2024-03-26T06:17:03.595429+0000","last_undegraded":"2024-03-26T06:17:03.595429+0000","last_fullsized":"2024-03-26T06:17:03.595429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596617+0000","last_change":"2024-03-26T06:16:57.509822+0000","last_active":"2024-03-26T06:17:03.596617+0000","last_peered":"2024-03-26T06:17:03.596617+0000","last_clean":"2024-03-26T06:17:03.596617+0000","last_became_active":"2024-03-26T06:16:57.509535+0000","last_became_peered":"2024-03-26T06:16:57.509535+0000","last_unstale":"2024-03-26T06:17:03.596617+0000","last_undegraded":"2024-03-26T06:17:03.596617+0000","last_fullsized":"2024-03-26T06:17:03.596617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597981+0000","last_change":"2024-03-26T06:17:02.877373+0000","last_active":"2024-03-26T06:17:03.597981+0000","last_peered":"2024-03-26T06:17:03.597981+0000","last_clean":"2024-03-26T06:17:03.597981+0000","last_became_active":"2024-03-26T06:17:02.876252+0000","last_became_peered":"2024-03-26T06:17:02.876252+0000","last_unstale":"2024-03-26T06:17:03.597981+0000","last_undegraded":"2024-03-26T06:17:03.597981+0000","last_fullsized":"2024-03-26T06:17:03.597981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:19.395341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556495+0000","last_change":"2024-03-26T06:16:58.536114+0000","last_active":"2024-03-26T06:17:03.556495+0000","last_peered":"2024-03-26T06:17:03.556495+0000","last_clean":"2024-03-26T06:17:03.556495+0000","last_became_active":"2024-03-26T06:16:58.534372+0000","last_became_peered":"2024-03-26T06:16:58.534372+0000","last_unstale":"2024-03-26T06:17:03.556495+0000","last_undegraded":"2024-03-26T06:17:03.556495+0000","last_fullsized":"2024-03-26T06:17:03.556495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596054+0000","last_change":"2024-03-26T06:16:57.503958+0000","last_active":"2024-03-26T06:17:03.596054+0000","last_peered":"2024-03-26T06:17:03.596054+0000","last_clean":"2024-03-26T06:17:03.596054+0000","last_became_active":"2024-03-26T06:16:57.503652+0000","last_became_peered":"2024-03-26T06:16:57.503652+0000","last_unstale":"2024-03-26T06:17:03.596054+0000","last_undegraded":"2024-03-26T06:17:03.596054+0000","last_fullsized":"2024-03-26T06:17:03.596054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:27.040366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553997+0000","last_change":"2024-03-26T06:17:02.878945+0000","last_active":"2024-03-26T06:17:03.553997+0000","last_peered":"2024-03-26T06:17:03.553997+0000","last_clean":"2024-03-26T06:17:03.553997+0000","last_became_active":"2024-03-26T06:17:02.876348+0000","last_became_peered":"2024-03-26T06:17:02.876348+0000","last_unstale":"2024-03-26T06:17:03.553997+0000","last_undegraded":"2024-03-26T06:17:03.553997+0000","last_fullsized":"2024-03-26T06:17:03.553997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:56:38.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595956+0000","last_change":"2024-03-26T06:16:58.515417+0000","last_active":"2024-03-26T06:17:03.595956+0000","last_peered":"2024-03-26T06:17:03.595956+0000","last_clean":"2024-03-26T06:17:03.595956+0000","last_became_active":"2024-03-26T06:16:58.515099+0000","last_became_peered":"2024-03-26T06:16:58.515099+0000","last_unstale":"2024-03-26T06:17:03.595956+0000","last_undegraded":"2024-03-26T06:17:03.595956+0000","last_fullsized":"2024-03-26T06:17:03.595956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601464+0000","last_change":"2024-03-26T06:16:57.512114+0000","last_active":"2024-03-26T06:17:03.601464+0000","last_peered":"2024-03-26T06:17:03.601464+0000","last_clean":"2024-03-26T06:17:03.601464+0000","last_became_active":"2024-03-26T06:16:57.511667+0000","last_became_peered":"2024-03-26T06:16:57.511667+0000","last_unstale":"2024-03-26T06:17:03.601464+0000","last_undegraded":"2024-03-26T06:17:03.601464+0000","last_fullsized":"2024-03-26T06:17:03.601464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:02:14.322537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593526+0000","last_change":"2024-03-26T06:17:02.871332+0000","last_active":"2024-03-26T06:17:03.593526+0000","last_peered":"2024-03-26T06:17:03.593526+0000","last_clean":"2024-03-26T06:17:03.593526+0000","last_became_active":"2024-03-26T06:17:02.869955+0000","last_became_peered":"2024-03-26T06:17:02.869955+0000","last_unstale":"2024-03-26T06:17:03.593526+0000","last_undegraded":"2024-03-26T06:17:03.593526+0000","last_fullsized":"2024-03-26T06:17:03.593526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554596+0000","last_change":"2024-03-26T06:16:58.523299+0000","last_active":"2024-03-26T06:17:03.554596+0000","last_peered":"2024-03-26T06:17:03.554596+0000","last_clean":"2024-03-26T06:17:03.554596+0000","last_became_active":"2024-03-26T06:16:58.522533+0000","last_became_peered":"2024-03-26T06:16:58.522533+0000","last_unstale":"2024-03-26T06:17:03.554596+0000","last_undegraded":"2024-03-26T06:17:03.554596+0000","last_fullsized":"2024-03-26T06:17:03.554596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:30.208261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596078+0000","last_change":"2024-03-26T06:16:57.500603+0000","last_active":"2024-03-26T06:17:03.596078+0000","last_peered":"2024-03-26T06:17:03.596078+0000","last_clean":"2024-03-26T06:17:03.596078+0000","last_became_active":"2024-03-26T06:16:57.500234+0000","last_became_peered":"2024-03-26T06:16:57.500234+0000","last_unstale":"2024-03-26T06:17:03.596078+0000","last_undegraded":"2024-03-26T06:17:03.596078+0000","last_fullsized":"2024-03-26T06:17:03.596078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:30.683728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595428+0000","last_change":"2024-03-26T06:17:02.583042+0000","last_active":"2024-03-26T06:17:03.595428+0000","last_peered":"2024-03-26T06:17:03.595428+0000","last_clean":"2024-03-26T06:17:03.595428+0000","last_became_active":"2024-03-26T06:17:02.581196+0000","last_became_peered":"2024-03-26T06:17:02.581196+0000","last_unstale":"2024-03-26T06:17:03.595428+0000","last_undegraded":"2024-03-26T06:17:03.595428+0000","last_fullsized":"2024-03-26T06:17:03.595428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600154+0000","last_change":"2024-03-26T06:16:58.531514+0000","last_active":"2024-03-26T06:17:03.600154+0000","last_peered":"2024-03-26T06:17:03.600154+0000","last_clean":"2024-03-26T06:17:03.600154+0000","last_became_active":"2024-03-26T06:16:58.531162+0000","last_became_peered":"2024-03-26T06:16:58.531162+0000","last_unstale":"2024-03-26T06:17:03.600154+0000","last_undegraded":"2024-03-26T06:17:03.600154+0000","last_fullsized":"2024-03-26T06:17:03.600154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:30.860729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554746+0000","last_change":"2024-03-26T06:16:57.495688+0000","last_active":"2024-03-26T06:17:03.554746+0000","last_peered":"2024-03-26T06:17:03.554746+0000","last_clean":"2024-03-26T06:17:03.554746+0000","last_became_active":"2024-03-26T06:16:57.495052+0000","last_became_peered":"2024-03-26T06:16:57.495052+0000","last_unstale":"2024-03-26T06:17:03.554746+0000","last_undegraded":"2024-03-26T06:17:03.554746+0000","last_fullsized":"2024-03-26T06:17:03.554746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596497+0000","last_change":"2024-03-26T06:17:02.573496+0000","last_active":"2024-03-26T06:17:03.596497+0000","last_peered":"2024-03-26T06:17:03.596497+0000","last_clean":"2024-03-26T06:17:03.596497+0000","last_became_active":"2024-03-26T06:17:02.573045+0000","last_became_peered":"2024-03-26T06:17:02.573045+0000","last_unstale":"2024-03-26T06:17:03.596497+0000","last_undegraded":"2024-03-26T06:17:03.596497+0000","last_fullsized":"2024-03-26T06:17:03.596497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:13:01.612258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594153+0000","last_change":"2024-03-26T06:16:58.517202+0000","last_active":"2024-03-26T06:17:03.594153+0000","last_peered":"2024-03-26T06:17:03.594153+0000","last_clean":"2024-03-26T06:17:03.594153+0000","last_became_active":"2024-03-26T06:16:58.516835+0000","last_became_peered":"2024-03-26T06:16:58.516835+0000","last_unstale":"2024-03-26T06:17:03.594153+0000","last_undegraded":"2024-03-26T06:17:03.594153+0000","last_fullsized":"2024-03-26T06:17:03.594153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550169+0000","last_change":"2024-03-26T06:16:57.497056+0000","last_active":"2024-03-26T06:17:03.550169+0000","last_peered":"2024-03-26T06:17:03.550169+0000","last_clean":"2024-03-26T06:17:03.550169+0000","last_became_active":"2024-03-26T06:16:57.496709+0000","last_became_peered":"2024-03-26T06:16:57.496709+0000","last_unstale":"2024-03-26T06:17:03.550169+0000","last_undegraded":"2024-03-26T06:17:03.550169+0000","last_fullsized":"2024-03-26T06:17:03.550169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596338+0000","last_change":"2024-03-26T06:17:02.584311+0000","last_active":"2024-03-26T06:17:03.596338+0000","last_peered":"2024-03-26T06:17:03.596338+0000","last_clean":"2024-03-26T06:17:03.596338+0000","last_became_active":"2024-03-26T06:17:02.583886+0000","last_became_peered":"2024-03-26T06:17:02.583886+0000","last_unstale":"2024-03-26T06:17:03.596338+0000","last_undegraded":"2024-03-26T06:17:03.596338+0000","last_fullsized":"2024-03-26T06:17:03.596338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:21.194082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.592952+0000","last_change":"2024-03-26T06:16:58.530594+0000","last_active":"2024-03-26T06:17:03.592952+0000","last_peered":"2024-03-26T06:17:03.592952+0000","last_clean":"2024-03-26T06:17:03.592952+0000","last_became_active":"2024-03-26T06:16:58.529866+0000","last_became_peered":"2024-03-26T06:16:58.529866+0000","last_unstale":"2024-03-26T06:17:03.592952+0000","last_undegraded":"2024-03-26T06:17:03.592952+0000","last_fullsized":"2024-03-26T06:17:03.592952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:41:39.644933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598124+0000","last_change":"2024-03-26T06:16:57.515221+0000","last_active":"2024-03-26T06:17:03.598124+0000","last_peered":"2024-03-26T06:17:03.598124+0000","last_clean":"2024-03-26T06:17:03.598124+0000","last_became_active":"2024-03-26T06:16:57.514898+0000","last_became_peered":"2024-03-26T06:16:57.514898+0000","last_unstale":"2024-03-26T06:17:03.598124+0000","last_undegraded":"2024-03-26T06:17:03.598124+0000","last_fullsized":"2024-03-26T06:17:03.598124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595076+0000","last_change":"2024-03-26T06:17:02.882785+0000","last_active":"2024-03-26T06:17:03.595076+0000","last_peered":"2024-03-26T06:17:03.595076+0000","last_clean":"2024-03-26T06:17:03.595076+0000","last_became_active":"2024-03-26T06:17:02.880282+0000","last_became_peered":"2024-03-26T06:17:02.880282+0000","last_unstale":"2024-03-26T06:17:03.595076+0000","last_undegraded":"2024-03-26T06:17:03.595076+0000","last_fullsized":"2024-03-26T06:17:03.595076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:13:01.612258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554233+0000","last_change":"2024-03-26T06:16:58.534461+0000","last_active":"2024-03-26T06:17:03.554233+0000","last_peered":"2024-03-26T06:17:03.554233+0000","last_clean":"2024-03-26T06:17:03.554233+0000","last_became_active":"2024-03-26T06:16:58.533987+0000","last_became_peered":"2024-03-26T06:16:58.533987+0000","last_unstale":"2024-03-26T06:17:03.554233+0000","last_undegraded":"2024-03-26T06:17:03.554233+0000","last_fullsized":"2024-03-26T06:17:03.554233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553855+0000","last_change":"2024-03-26T06:16:57.493211+0000","last_active":"2024-03-26T06:17:03.553855+0000","last_peered":"2024-03-26T06:17:03.553855+0000","last_clean":"2024-03-26T06:17:03.553855+0000","last_became_active":"2024-03-26T06:16:57.492914+0000","last_became_peered":"2024-03-26T06:16:57.492914+0000","last_unstale":"2024-03-26T06:17:03.553855+0000","last_undegraded":"2024-03-26T06:17:03.553855+0000","last_fullsized":"2024-03-26T06:17:03.553855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598396+0000","last_change":"2024-03-26T06:16:49.590440+0000","last_active":"2024-03-26T06:17:03.598396+0000","last_peered":"2024-03-26T06:17:03.598396+0000","last_clean":"2024-03-26T06:17:03.598396+0000","last_became_active":"2024-03-26T06:16:49.589017+0000","last_became_peered":"2024-03-26T06:16:49.589017+0000","last_unstale":"2024-03-26T06:17:03.598396+0000","last_undegraded":"2024-03-26T06:17:03.598396+0000","last_fullsized":"2024-03-26T06:17:03.598396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_clean_scrub_stamp":"2024-03-26T06:16:48.290068+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:00:05.158039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596458+0000","last_change":"2024-03-26T06:17:02.878872+0000","last_active":"2024-03-26T06:17:03.596458+0000","last_peered":"2024-03-26T06:17:03.596458+0000","last_clean":"2024-03-26T06:17:03.596458+0000","last_became_active":"2024-03-26T06:17:02.877700+0000","last_became_peered":"2024-03-26T06:17:02.877700+0000","last_unstale":"2024-03-26T06:17:03.596458+0000","last_undegraded":"2024-03-26T06:17:03.596458+0000","last_fullsized":"2024-03-26T06:17:03.596458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600698+0000","last_change":"2024-03-26T06:16:58.533470+0000","last_active":"2024-03-26T06:17:03.600698+0000","last_peered":"2024-03-26T06:17:03.600698+0000","last_clean":"2024-03-26T06:17:03.600698+0000","last_became_active":"2024-03-26T06:16:58.533157+0000","last_became_peered":"2024-03-26T06:16:58.533157+0000","last_unstale":"2024-03-26T06:17:03.600698+0000","last_undegraded":"2024-03-26T06:17:03.600698+0000","last_fullsized":"2024-03-26T06:17:03.600698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.551305+0000","last_change":"2024-03-26T06:16:57.504891+0000","last_active":"2024-03-26T06:17:03.551305+0000","last_peered":"2024-03-26T06:17:03.551305+0000","last_clean":"2024-03-26T06:17:03.551305+0000","last_became_active":"2024-03-26T06:16:57.504556+0000","last_became_peered":"2024-03-26T06:16:57.504556+0000","last_unstale":"2024-03-26T06:17:03.551305+0000","last_undegraded":"2024-03-26T06:17:03.551305+0000","last_fullsized":"2024-03-26T06:17:03.551305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601044+0000","last_change":"2024-03-26T06:17:02.879854+0000","last_active":"2024-03-26T06:17:03.601044+0000","last_peered":"2024-03-26T06:17:03.601044+0000","last_clean":"2024-03-26T06:17:03.601044+0000","last_became_active":"2024-03-26T06:17:02.873465+0000","last_became_peered":"2024-03-26T06:17:02.873465+0000","last_unstale":"2024-03-26T06:17:03.601044+0000","last_undegraded":"2024-03-26T06:17:03.601044+0000","last_fullsized":"2024-03-26T06:17:03.601044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554519+0000","last_change":"2024-03-26T06:16:58.524155+0000","last_active":"2024-03-26T06:17:03.554519+0000","last_peered":"2024-03-26T06:17:03.554519+0000","last_clean":"2024-03-26T06:17:03.554519+0000","last_became_active":"2024-03-26T06:16:58.523112+0000","last_became_peered":"2024-03-26T06:16:58.523112+0000","last_unstale":"2024-03-26T06:17:03.554519+0000","last_undegraded":"2024-03-26T06:17:03.554519+0000","last_fullsized":"2024-03-26T06:17:03.554519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:35.992415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596126+0000","last_change":"2024-03-26T06:16:57.499837+0000","last_active":"2024-03-26T06:17:03.596126+0000","last_peered":"2024-03-26T06:17:03.596126+0000","last_clean":"2024-03-26T06:17:03.596126+0000","last_became_active":"2024-03-26T06:16:57.499493+0000","last_became_peered":"2024-03-26T06:16:57.499493+0000","last_unstale":"2024-03-26T06:17:03.596126+0000","last_undegraded":"2024-03-26T06:17:03.596126+0000","last_fullsized":"2024-03-26T06:17:03.596126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594334+0000","last_change":"2024-03-26T06:17:02.577832+0000","last_active":"2024-03-26T06:17:03.594334+0000","last_peered":"2024-03-26T06:17:03.594334+0000","last_clean":"2024-03-26T06:17:03.594334+0000","last_became_active":"2024-03-26T06:17:02.576442+0000","last_became_peered":"2024-03-26T06:17:02.576442+0000","last_unstale":"2024-03-26T06:17:03.594334+0000","last_undegraded":"2024-03-26T06:17:03.594334+0000","last_fullsized":"2024-03-26T06:17:03.594334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.602136+0000","last_change":"2024-03-26T06:16:58.552213+0000","last_active":"2024-03-26T06:17:03.602136+0000","last_peered":"2024-03-26T06:17:03.602136+0000","last_clean":"2024-03-26T06:17:03.602136+0000","last_became_active":"2024-03-26T06:16:58.551830+0000","last_became_peered":"2024-03-26T06:16:58.551830+0000","last_unstale":"2024-03-26T06:17:03.602136+0000","last_undegraded":"2024-03-26T06:17:03.602136+0000","last_fullsized":"2024-03-26T06:17:03.602136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:31:28.495785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550919+0000","last_change":"2024-03-26T06:16:57.501329+0000","last_active":"2024-03-26T06:17:03.550919+0000","last_peered":"2024-03-26T06:17:03.550919+0000","last_clean":"2024-03-26T06:17:03.550919+0000","last_became_active":"2024-03-26T06:16:57.500987+0000","last_became_peered":"2024-03-26T06:16:57.500987+0000","last_unstale":"2024-03-26T06:17:03.550919+0000","last_undegraded":"2024-03-26T06:17:03.550919+0000","last_fullsized":"2024-03-26T06:17:03.550919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.552806+0000","last_change":"2024-03-26T06:17:02.872960+0000","last_active":"2024-03-26T06:17:03.552806+0000","last_peered":"2024-03-26T06:17:03.552806+0000","last_clean":"2024-03-26T06:17:03.552806+0000","last_became_active":"2024-03-26T06:17:02.871460+0000","last_became_peered":"2024-03-26T06:17:02.871460+0000","last_unstale":"2024-03-26T06:17:03.552806+0000","last_undegraded":"2024-03-26T06:17:03.552806+0000","last_fullsized":"2024-03-26T06:17:03.552806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:44:47.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601012+0000","last_change":"2024-03-26T06:16:58.534645+0000","last_active":"2024-03-26T06:17:03.601012+0000","last_peered":"2024-03-26T06:17:03.601012+0000","last_clean":"2024-03-26T06:17:03.601012+0000","last_became_active":"2024-03-26T06:16:58.532263+0000","last_became_peered":"2024-03-26T06:16:58.532263+0000","last_unstale":"2024-03-26T06:17:03.601012+0000","last_undegraded":"2024-03-26T06:17:03.601012+0000","last_fullsized":"2024-03-26T06:17:03.601012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:35.992415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601161+0000","last_change":"2024-03-26T06:16:57.495853+0000","last_active":"2024-03-26T06:17:03.601161+0000","last_peered":"2024-03-26T06:17:03.601161+0000","last_clean":"2024-03-26T06:17:03.601161+0000","last_became_active":"2024-03-26T06:16:57.495248+0000","last_became_peered":"2024-03-26T06:16:57.495248+0000","last_unstale":"2024-03-26T06:17:03.601161+0000","last_undegraded":"2024-03-26T06:17:03.601161+0000","last_fullsized":"2024-03-26T06:17:03.601161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:20:43.357850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597470+0000","last_change":"2024-03-26T06:17:02.582195+0000","last_active":"2024-03-26T06:17:03.597470+0000","last_peered":"2024-03-26T06:17:03.597470+0000","last_clean":"2024-03-26T06:17:03.597470+0000","last_became_active":"2024-03-26T06:17:02.581717+0000","last_became_peered":"2024-03-26T06:17:02.581717+0000","last_unstale":"2024-03-26T06:17:03.597470+0000","last_undegraded":"2024-03-26T06:17:03.597470+0000","last_fullsized":"2024-03-26T06:17:03.597470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:19.811246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598827+0000","last_change":"2024-03-26T06:16:58.531961+0000","last_active":"2024-03-26T06:17:03.598827+0000","last_peered":"2024-03-26T06:17:03.598827+0000","last_clean":"2024-03-26T06:17:03.598827+0000","last_became_active":"2024-03-26T06:16:58.531656+0000","last_became_peered":"2024-03-26T06:16:58.531656+0000","last_unstale":"2024-03-26T06:17:03.598827+0000","last_undegraded":"2024-03-26T06:17:03.598827+0000","last_fullsized":"2024-03-26T06:17:03.598827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.549428+0000","last_change":"2024-03-26T06:16:57.488815+0000","last_active":"2024-03-26T06:17:03.549428+0000","last_peered":"2024-03-26T06:17:03.549428+0000","last_clean":"2024-03-26T06:17:03.549428+0000","last_became_active":"2024-03-26T06:16:57.487181+0000","last_became_peered":"2024-03-26T06:16:57.487181+0000","last_unstale":"2024-03-26T06:17:03.549428+0000","last_undegraded":"2024-03-26T06:17:03.549428+0000","last_fullsized":"2024-03-26T06:17:03.549428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:02:07.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594842+0000","last_change":"2024-03-26T06:17:02.580214+0000","last_active":"2024-03-26T06:17:03.594842+0000","last_peered":"2024-03-26T06:17:03.594842+0000","last_clean":"2024-03-26T06:17:03.594842+0000","last_became_active":"2024-03-26T06:17:02.579846+0000","last_became_peered":"2024-03-26T06:17:02.579846+0000","last_unstale":"2024-03-26T06:17:03.594842+0000","last_undegraded":"2024-03-26T06:17:03.594842+0000","last_fullsized":"2024-03-26T06:17:03.594842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:21.194082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595884+0000","last_change":"2024-03-26T06:16:58.514900+0000","last_active":"2024-03-26T06:17:03.595884+0000","last_peered":"2024-03-26T06:17:03.595884+0000","last_clean":"2024-03-26T06:17:03.595884+0000","last_became_active":"2024-03-26T06:16:58.514631+0000","last_became_peered":"2024-03-26T06:16:58.514631+0000","last_unstale":"2024-03-26T06:17:03.595884+0000","last_undegraded":"2024-03-26T06:17:03.595884+0000","last_fullsized":"2024-03-26T06:17:03.595884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595846+0000","last_change":"2024-03-26T06:16:57.507399+0000","last_active":"2024-03-26T06:17:03.595846+0000","last_peered":"2024-03-26T06:17:03.595846+0000","last_clean":"2024-03-26T06:17:03.595846+0000","last_became_active":"2024-03-26T06:16:57.506456+0000","last_became_peered":"2024-03-26T06:16:57.506456+0000","last_unstale":"2024-03-26T06:17:03.595846+0000","last_undegraded":"2024-03-26T06:17:03.595846+0000","last_fullsized":"2024-03-26T06:17:03.595846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556221+0000","last_change":"2024-03-26T06:17:02.887270+0000","last_active":"2024-03-26T06:17:03.556221+0000","last_peered":"2024-03-26T06:17:03.556221+0000","last_clean":"2024-03-26T06:17:03.556221+0000","last_became_active":"2024-03-26T06:17:02.877110+0000","last_became_peered":"2024-03-26T06:17:02.877110+0000","last_unstale":"2024-03-26T06:17:03.556221+0000","last_undegraded":"2024-03-26T06:17:03.556221+0000","last_fullsized":"2024-03-26T06:17:03.556221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:53:39.247476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600081+0000","last_change":"2024-03-26T06:16:58.537036+0000","last_active":"2024-03-26T06:17:03.600081+0000","last_peered":"2024-03-26T06:17:03.600081+0000","last_clean":"2024-03-26T06:17:03.600081+0000","last_became_active":"2024-03-26T06:16:58.536769+0000","last_became_peered":"2024-03-26T06:16:58.536769+0000","last_unstale":"2024-03-26T06:17:03.600081+0000","last_undegraded":"2024-03-26T06:17:03.600081+0000","last_fullsized":"2024-03-26T06:17:03.600081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:35.743222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554459+0000","last_change":"2024-03-26T06:16:57.503002+0000","last_active":"2024-03-26T06:17:03.554459+0000","last_peered":"2024-03-26T06:17:03.554459+0000","last_clean":"2024-03-26T06:17:03.554459+0000","last_became_active":"2024-03-26T06:16:57.502634+0000","last_became_peered":"2024-03-26T06:16:57.502634+0000","last_unstale":"2024-03-26T06:17:03.554459+0000","last_undegraded":"2024-03-26T06:17:03.554459+0000","last_fullsized":"2024-03-26T06:17:03.554459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:27:15.492203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557086+0000","last_change":"2024-03-26T06:17:02.881309+0000","last_active":"2024-03-26T06:17:03.557086+0000","last_peered":"2024-03-26T06:17:03.557086+0000","last_clean":"2024-03-26T06:17:03.557086+0000","last_became_active":"2024-03-26T06:17:02.875761+0000","last_became_peered":"2024-03-26T06:17:02.875761+0000","last_unstale":"2024-03-26T06:17:03.557086+0000","last_undegraded":"2024-03-26T06:17:03.557086+0000","last_fullsized":"2024-03-26T06:17:03.557086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:12:15.149201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594732+0000","last_change":"2024-03-26T06:16:58.525054+0000","last_active":"2024-03-26T06:17:03.594732+0000","last_peered":"2024-03-26T06:17:03.594732+0000","last_clean":"2024-03-26T06:17:03.594732+0000","last_became_active":"2024-03-26T06:16:58.524608+0000","last_became_peered":"2024-03-26T06:16:58.524608+0000","last_unstale":"2024-03-26T06:17:03.594732+0000","last_undegraded":"2024-03-26T06:17:03.594732+0000","last_fullsized":"2024-03-26T06:17:03.594732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:20:28.424836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595048+0000","last_change":"2024-03-26T06:16:57.496736+0000","last_active":"2024-03-26T06:17:03.595048+0000","last_peered":"2024-03-26T06:17:03.595048+0000","last_clean":"2024-03-26T06:17:03.595048+0000","last_became_active":"2024-03-26T06:16:57.496382+0000","last_became_peered":"2024-03-26T06:16:57.496382+0000","last_unstale":"2024-03-26T06:17:03.595048+0000","last_undegraded":"2024-03-26T06:17:03.595048+0000","last_fullsized":"2024-03-26T06:17:03.595048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:20:43.357850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554993+0000","last_change":"2024-03-26T06:17:02.878453+0000","last_active":"2024-03-26T06:17:03.554993+0000","last_peered":"2024-03-26T06:17:03.554993+0000","last_clean":"2024-03-26T06:17:03.554993+0000","last_became_active":"2024-03-26T06:17:02.871508+0000","last_became_peered":"2024-03-26T06:17:02.871508+0000","last_unstale":"2024-03-26T06:17:03.554993+0000","last_undegraded":"2024-03-26T06:17:03.554993+0000","last_fullsized":"2024-03-26T06:17:03.554993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:56:38.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600456+0000","last_change":"2024-03-26T06:16:58.529916+0000","last_active":"2024-03-26T06:17:03.600456+0000","last_peered":"2024-03-26T06:17:03.600456+0000","last_clean":"2024-03-26T06:17:03.600456+0000","last_became_active":"2024-03-26T06:16:58.529278+0000","last_became_peered":"2024-03-26T06:16:58.529278+0000","last_unstale":"2024-03-26T06:17:03.600456+0000","last_undegraded":"2024-03-26T06:17:03.600456+0000","last_fullsized":"2024-03-26T06:17:03.600456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:17.340335+0000","last_change":"2024-03-26T06:16:57.504243+0000","last_active":"2024-03-26T06:17:17.340335+0000","last_peered":"2024-03-26T06:17:17.340335+0000","last_clean":"2024-03-26T06:17:17.340335+0000","last_became_active":"2024-03-26T06:16:57.503731+0000","last_became_peered":"2024-03-26T06:16:57.503731+0000","last_unstale":"2024-03-26T06:17:17.340335+0000","last_undegraded":"2024-03-26T06:17:17.340335+0000","last_fullsized":"2024-03-26T06:17:17.340335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:42:02.416840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597671+0000","last_change":"2024-03-26T06:17:02.578804+0000","last_active":"2024-03-26T06:17:03.597671+0000","last_peered":"2024-03-26T06:17:03.597671+0000","last_clean":"2024-03-26T06:17:03.597671+0000","last_became_active":"2024-03-26T06:17:02.577517+0000","last_became_peered":"2024-03-26T06:17:02.577517+0000","last_unstale":"2024-03-26T06:17:03.597671+0000","last_undegraded":"2024-03-26T06:17:03.597671+0000","last_fullsized":"2024-03-26T06:17:03.597671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:34:40.062808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599668+0000","last_change":"2024-03-26T06:16:58.542622+0000","last_active":"2024-03-26T06:17:03.599668+0000","last_peered":"2024-03-26T06:17:03.599668+0000","last_clean":"2024-03-26T06:17:03.599668+0000","last_became_active":"2024-03-26T06:16:58.542271+0000","last_became_peered":"2024-03-26T06:16:58.542271+0000","last_unstale":"2024-03-26T06:17:03.599668+0000","last_undegraded":"2024-03-26T06:17:03.599668+0000","last_fullsized":"2024-03-26T06:17:03.599668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:31.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596026+0000","last_change":"2024-03-26T06:16:57.503753+0000","last_active":"2024-03-26T06:17:03.596026+0000","last_peered":"2024-03-26T06:17:03.596026+0000","last_clean":"2024-03-26T06:17:03.596026+0000","last_became_active":"2024-03-26T06:16:57.503459+0000","last_became_peered":"2024-03-26T06:16:57.503459+0000","last_unstale":"2024-03-26T06:17:03.596026+0000","last_undegraded":"2024-03-26T06:17:03.596026+0000","last_fullsized":"2024-03-26T06:17:03.596026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600050+0000","last_change":"2024-03-26T06:17:02.581612+0000","last_active":"2024-03-26T06:17:03.600050+0000","last_peered":"2024-03-26T06:17:03.600050+0000","last_clean":"2024-03-26T06:17:03.600050+0000","last_became_active":"2024-03-26T06:17:02.580790+0000","last_became_peered":"2024-03-26T06:17:02.580790+0000","last_unstale":"2024-03-26T06:17:03.600050+0000","last_undegraded":"2024-03-26T06:17:03.600050+0000","last_fullsized":"2024-03-26T06:17:03.600050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:45.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594361+0000","last_change":"2024-03-26T06:16:58.533339+0000","last_active":"2024-03-26T06:17:03.594361+0000","last_peered":"2024-03-26T06:17:03.594361+0000","last_clean":"2024-03-26T06:17:03.594361+0000","last_became_active":"2024-03-26T06:16:58.533023+0000","last_became_peered":"2024-03-26T06:16:58.533023+0000","last_unstale":"2024-03-26T06:17:03.594361+0000","last_undegraded":"2024-03-26T06:17:03.594361+0000","last_fullsized":"2024-03-26T06:17:03.594361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554096+0000","last_change":"2024-03-26T06:16:57.505342+0000","last_active":"2024-03-26T06:17:03.554096+0000","last_peered":"2024-03-26T06:17:03.554096+0000","last_clean":"2024-03-26T06:17:03.554096+0000","last_became_active":"2024-03-26T06:16:57.505086+0000","last_became_peered":"2024-03-26T06:16:57.505086+0000","last_unstale":"2024-03-26T06:17:03.554096+0000","last_undegraded":"2024-03-26T06:17:03.554096+0000","last_fullsized":"2024-03-26T06:17:03.554096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:15.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554475+0000","last_change":"2024-03-26T06:17:02.580018+0000","last_active":"2024-03-26T06:17:03.554475+0000","last_peered":"2024-03-26T06:17:03.554475+0000","last_clean":"2024-03-26T06:17:03.554475+0000","last_became_active":"2024-03-26T06:17:02.579638+0000","last_became_peered":"2024-03-26T06:17:02.579638+0000","last_unstale":"2024-03-26T06:17:03.554475+0000","last_undegraded":"2024-03-26T06:17:03.554475+0000","last_fullsized":"2024-03-26T06:17:03.554475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:11:12.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553848+0000","last_change":"2024-03-26T06:16:58.533277+0000","last_active":"2024-03-26T06:17:03.553848+0000","last_peered":"2024-03-26T06:17:03.553848+0000","last_clean":"2024-03-26T06:17:03.553848+0000","last_became_active":"2024-03-26T06:16:58.529159+0000","last_became_peered":"2024-03-26T06:16:58.529159+0000","last_unstale":"2024-03-26T06:17:03.553848+0000","last_undegraded":"2024-03-26T06:17:03.553848+0000","last_fullsized":"2024-03-26T06:17:03.553848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:40.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596366+0000","last_change":"2024-03-26T06:16:57.510798+0000","last_active":"2024-03-26T06:17:03.596366+0000","last_peered":"2024-03-26T06:17:03.596366+0000","last_clean":"2024-03-26T06:17:03.596366+0000","last_became_active":"2024-03-26T06:16:57.510512+0000","last_became_peered":"2024-03-26T06:16:57.510512+0000","last_unstale":"2024-03-26T06:17:03.596366+0000","last_undegraded":"2024-03-26T06:17:03.596366+0000","last_fullsized":"2024-03-26T06:17:03.596366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:27:04.340869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554417+0000","last_change":"2024-03-26T06:17:02.886655+0000","last_active":"2024-03-26T06:17:03.554417+0000","last_peered":"2024-03-26T06:17:03.554417+0000","last_clean":"2024-03-26T06:17:03.554417+0000","last_became_active":"2024-03-26T06:17:02.883226+0000","last_became_peered":"2024-03-26T06:17:02.883226+0000","last_unstale":"2024-03-26T06:17:03.554417+0000","last_undegraded":"2024-03-26T06:17:03.554417+0000","last_fullsized":"2024-03-26T06:17:03.554417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:08:21.367362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594521+0000","last_change":"2024-03-26T06:17:02.884097+0000","last_active":"2024-03-26T06:17:03.594521+0000","last_peered":"2024-03-26T06:17:03.594521+0000","last_clean":"2024-03-26T06:17:03.594521+0000","last_became_active":"2024-03-26T06:17:02.876466+0000","last_became_peered":"2024-03-26T06:17:02.876466+0000","last_unstale":"2024-03-26T06:17:03.594521+0000","last_undegraded":"2024-03-26T06:17:03.594521+0000","last_fullsized":"2024-03-26T06:17:03.594521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:39.813615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593783+0000","last_change":"2024-03-26T06:16:58.519241+0000","last_active":"2024-03-26T06:17:03.593783+0000","last_peered":"2024-03-26T06:17:03.593783+0000","last_clean":"2024-03-26T06:17:03.593783+0000","last_became_active":"2024-03-26T06:16:58.518964+0000","last_became_peered":"2024-03-26T06:16:58.518964+0000","last_unstale":"2024-03-26T06:17:03.593783+0000","last_undegraded":"2024-03-26T06:17:03.593783+0000","last_fullsized":"2024-03-26T06:17:03.593783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553403+0000","last_change":"2024-03-26T06:16:57.501927+0000","last_active":"2024-03-26T06:17:03.553403+0000","last_peered":"2024-03-26T06:17:03.553403+0000","last_clean":"2024-03-26T06:17:03.553403+0000","last_became_active":"2024-03-26T06:16:57.501575+0000","last_became_peered":"2024-03-26T06:16:57.501575+0000","last_unstale":"2024-03-26T06:17:03.553403+0000","last_undegraded":"2024-03-26T06:17:03.553403+0000","last_fullsized":"2024-03-26T06:17:03.553403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596166+0000","last_change":"2024-03-26T06:17:02.573739+0000","last_active":"2024-03-26T06:17:03.596166+0000","last_peered":"2024-03-26T06:17:03.596166+0000","last_clean":"2024-03-26T06:17:03.596166+0000","last_became_active":"2024-03-26T06:17:02.573280+0000","last_became_peered":"2024-03-26T06:17:02.573280+0000","last_unstale":"2024-03-26T06:17:03.596166+0000","last_undegraded":"2024-03-26T06:17:03.596166+0000","last_fullsized":"2024-03-26T06:17:03.596166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:34.278654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554477+0000","last_change":"2024-03-26T06:16:58.516850+0000","last_active":"2024-03-26T06:17:03.554477+0000","last_peered":"2024-03-26T06:17:03.554477+0000","last_clean":"2024-03-26T06:17:03.554477+0000","last_became_active":"2024-03-26T06:16:58.516487+0000","last_became_peered":"2024-03-26T06:16:58.516487+0000","last_unstale":"2024-03-26T06:17:03.554477+0000","last_undegraded":"2024-03-26T06:17:03.554477+0000","last_fullsized":"2024-03-26T06:17:03.554477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:55:23.773569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554926+0000","last_change":"2024-03-26T06:16:57.505539+0000","last_active":"2024-03-26T06:17:03.554926+0000","last_peered":"2024-03-26T06:17:03.554926+0000","last_clean":"2024-03-26T06:17:03.554926+0000","last_became_active":"2024-03-26T06:16:57.504681+0000","last_became_peered":"2024-03-26T06:16:57.504681+0000","last_unstale":"2024-03-26T06:17:03.554926+0000","last_undegraded":"2024-03-26T06:17:03.554926+0000","last_fullsized":"2024-03-26T06:17:03.554926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:02:07.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596247+0000","last_change":"2024-03-26T06:16:57.508895+0000","last_active":"2024-03-26T06:17:03.596247+0000","last_peered":"2024-03-26T06:17:03.596247+0000","last_clean":"2024-03-26T06:17:03.596247+0000","last_became_active":"2024-03-26T06:16:57.508519+0000","last_became_peered":"2024-03-26T06:16:57.508519+0000","last_unstale":"2024-03-26T06:17:03.596247+0000","last_undegraded":"2024-03-26T06:17:03.596247+0000","last_fullsized":"2024-03-26T06:17:03.596247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:40:29.848570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594814+0000","last_change":"2024-03-26T06:16:58.529802+0000","last_active":"2024-03-26T06:17:03.594814+0000","last_peered":"2024-03-26T06:17:03.594814+0000","last_clean":"2024-03-26T06:17:03.594814+0000","last_became_active":"2024-03-26T06:16:58.529237+0000","last_became_peered":"2024-03-26T06:16:58.529237+0000","last_unstale":"2024-03-26T06:17:03.594814+0000","last_undegraded":"2024-03-26T06:17:03.594814+0000","last_fullsized":"2024-03-26T06:17:03.594814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.551059+0000","last_change":"2024-03-26T06:17:02.579718+0000","last_active":"2024-03-26T06:17:03.551059+0000","last_peered":"2024-03-26T06:17:03.551059+0000","last_clean":"2024-03-26T06:17:03.551059+0000","last_became_active":"2024-03-26T06:17:02.579292+0000","last_became_peered":"2024-03-26T06:17:02.579292+0000","last_unstale":"2024-03-26T06:17:03.551059+0000","last_undegraded":"2024-03-26T06:17:03.551059+0000","last_fullsized":"2024-03-26T06:17:03.551059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:20:32.495229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555975+0000","last_change":"2024-03-26T06:16:57.505594+0000","last_active":"2024-03-26T06:17:03.555975+0000","last_peered":"2024-03-26T06:17:03.555975+0000","last_clean":"2024-03-26T06:17:03.555975+0000","last_became_active":"2024-03-26T06:16:57.504217+0000","last_became_peered":"2024-03-26T06:16:57.504217+0000","last_unstale":"2024-03-26T06:17:03.555975+0000","last_undegraded":"2024-03-26T06:17:03.555975+0000","last_fullsized":"2024-03-26T06:17:03.555975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:56.442443+0000","last_clean_scrub_stamp":"2024-03-26T06:16:56.442443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:56.691656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.597497+0000","last_change":"2024-03-26T06:16:58.525527+0000","last_active":"2024-03-26T06:17:03.597497+0000","last_peered":"2024-03-26T06:17:03.597497+0000","last_clean":"2024-03-26T06:17:03.597497+0000","last_became_active":"2024-03-26T06:16:58.525120+0000","last_became_peered":"2024-03-26T06:16:58.525120+0000","last_unstale":"2024-03-26T06:17:03.597497+0000","last_undegraded":"2024-03-26T06:17:03.597497+0000","last_fullsized":"2024-03-26T06:17:03.597497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:48:16.071262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555281+0000","last_change":"2024-03-26T06:17:02.579294+0000","last_active":"2024-03-26T06:17:03.555281+0000","last_peered":"2024-03-26T06:17:03.555281+0000","last_clean":"2024-03-26T06:17:03.555281+0000","last_became_active":"2024-03-26T06:17:02.578906+0000","last_became_peered":"2024-03-26T06:17:02.578906+0000","last_unstale":"2024-03-26T06:17:03.555281+0000","last_undegraded":"2024-03-26T06:17:03.555281+0000","last_fullsized":"2024-03-26T06:17:03.555281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:17:01.524994+0000","last_clean_scrub_stamp":"2024-03-26T06:17:01.524994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:53:09.876582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595338+0000","last_change":"2024-03-26T06:16:58.516379+0000","last_active":"2024-03-26T06:17:03.595338+0000","last_peered":"2024-03-26T06:17:03.595338+0000","last_clean":"2024-03-26T06:17:03.595338+0000","last_became_active":"2024-03-26T06:16:58.516077+0000","last_became_peered":"2024-03-26T06:16:58.516077+0000","last_unstale":"2024-03-26T06:17:03.595338+0000","last_undegraded":"2024-03-26T06:17:03.595338+0000","last_fullsized":"2024-03-26T06:17:03.595338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.549738+0000","last_change":"2024-03-26T06:16:58.532505+0000","last_active":"2024-03-26T06:17:03.549738+0000","last_peered":"2024-03-26T06:17:03.549738+0000","last_clean":"2024-03-26T06:17:03.549738+0000","last_became_active":"2024-03-26T06:16:58.529934+0000","last_became_peered":"2024-03-26T06:16:58.529934+0000","last_unstale":"2024-03-26T06:17:03.549738+0000","last_undegraded":"2024-03-26T06:17:03.549738+0000","last_fullsized":"2024-03-26T06:17:03.549738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:31:31.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554160+0000","last_change":"2024-03-26T06:16:58.522722+0000","last_active":"2024-03-26T06:17:03.554160+0000","last_peered":"2024-03-26T06:17:03.554160+0000","last_clean":"2024-03-26T06:17:03.554160+0000","last_became_active":"2024-03-26T06:16:58.522370+0000","last_became_peered":"2024-03-26T06:16:58.522370+0000","last_unstale":"2024-03-26T06:17:03.554160+0000","last_undegraded":"2024-03-26T06:17:03.554160+0000","last_fullsized":"2024-03-26T06:17:03.554160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:07:15.324948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594678+0000","last_change":"2024-03-26T06:16:58.520281+0000","last_active":"2024-03-26T06:17:03.594678+0000","last_peered":"2024-03-26T06:17:03.594678+0000","last_clean":"2024-03-26T06:17:03.594678+0000","last_became_active":"2024-03-26T06:16:58.519985+0000","last_became_peered":"2024-03-26T06:16:58.519985+0000","last_unstale":"2024-03-26T06:17:03.594678+0000","last_undegraded":"2024-03-26T06:17:03.594678+0000","last_fullsized":"2024-03-26T06:17:03.594678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.557423+0000","last_change":"2024-03-26T06:16:58.529109+0000","last_active":"2024-03-26T06:17:03.557423+0000","last_peered":"2024-03-26T06:17:03.557423+0000","last_clean":"2024-03-26T06:17:03.557423+0000","last_became_active":"2024-03-26T06:16:58.528801+0000","last_became_peered":"2024-03-26T06:16:58.528801+0000","last_unstale":"2024-03-26T06:17:03.557423+0000","last_undegraded":"2024-03-26T06:17:03.557423+0000","last_fullsized":"2024-03-26T06:17:03.557423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595616+0000","last_change":"2024-03-26T06:16:58.520275+0000","last_active":"2024-03-26T06:17:03.595616+0000","last_peered":"2024-03-26T06:17:03.595616+0000","last_clean":"2024-03-26T06:17:03.595616+0000","last_became_active":"2024-03-26T06:16:58.519968+0000","last_became_peered":"2024-03-26T06:16:58.519968+0000","last_unstale":"2024-03-26T06:17:03.595616+0000","last_undegraded":"2024-03-26T06:17:03.595616+0000","last_fullsized":"2024-03-26T06:17:03.595616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600878+0000","last_change":"2024-03-26T06:16:58.529307+0000","last_active":"2024-03-26T06:17:03.600878+0000","last_peered":"2024-03-26T06:17:03.600878+0000","last_clean":"2024-03-26T06:17:03.600878+0000","last_became_active":"2024-03-26T06:16:58.528918+0000","last_became_peered":"2024-03-26T06:16:58.528918+0000","last_unstale":"2024-03-26T06:17:03.600878+0000","last_undegraded":"2024-03-26T06:17:03.600878+0000","last_fullsized":"2024-03-26T06:17:03.600878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.556360+0000","last_change":"2024-03-26T06:16:58.529346+0000","last_active":"2024-03-26T06:17:03.556360+0000","last_peered":"2024-03-26T06:17:03.556360+0000","last_clean":"2024-03-26T06:17:03.556360+0000","last_became_active":"2024-03-26T06:16:58.528998+0000","last_became_peered":"2024-03-26T06:16:58.528998+0000","last_unstale":"2024-03-26T06:17:03.556360+0000","last_undegraded":"2024-03-26T06:17:03.556360+0000","last_fullsized":"2024-03-26T06:17:03.556360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:16:42.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553105+0000","last_change":"2024-03-26T06:16:58.524089+0000","last_active":"2024-03-26T06:17:03.553105+0000","last_peered":"2024-03-26T06:17:03.553105+0000","last_clean":"2024-03-26T06:17:03.553105+0000","last_became_active":"2024-03-26T06:16:58.522756+0000","last_became_peered":"2024-03-26T06:16:58.522756+0000","last_unstale":"2024-03-26T06:17:03.553105+0000","last_undegraded":"2024-03-26T06:17:03.553105+0000","last_fullsized":"2024-03-26T06:17:03.553105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:53:17.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554786+0000","last_change":"2024-03-26T06:16:58.530175+0000","last_active":"2024-03-26T06:17:03.554786+0000","last_peered":"2024-03-26T06:17:03.554786+0000","last_clean":"2024-03-26T06:17:03.554786+0000","last_became_active":"2024-03-26T06:16:58.529900+0000","last_became_peered":"2024-03-26T06:16:58.529900+0000","last_unstale":"2024-03-26T06:17:03.554786+0000","last_undegraded":"2024-03-26T06:17:03.554786+0000","last_fullsized":"2024-03-26T06:17:03.554786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553982+0000","last_change":"2024-03-26T06:16:58.529902+0000","last_active":"2024-03-26T06:17:03.553982+0000","last_peered":"2024-03-26T06:17:03.553982+0000","last_clean":"2024-03-26T06:17:03.553982+0000","last_became_active":"2024-03-26T06:16:58.525109+0000","last_became_peered":"2024-03-26T06:16:58.525109+0000","last_unstale":"2024-03-26T06:17:03.553982+0000","last_undegraded":"2024-03-26T06:17:03.553982+0000","last_fullsized":"2024-03-26T06:17:03.553982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:02:32.608845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.593384+0000","last_change":"2024-03-26T06:16:58.529175+0000","last_active":"2024-03-26T06:17:03.593384+0000","last_peered":"2024-03-26T06:17:03.593384+0000","last_clean":"2024-03-26T06:17:03.593384+0000","last_became_active":"2024-03-26T06:16:58.525707+0000","last_became_peered":"2024-03-26T06:16:58.525707+0000","last_unstale":"2024-03-26T06:17:03.593384+0000","last_undegraded":"2024-03-26T06:17:03.593384+0000","last_fullsized":"2024-03-26T06:17:03.593384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:22:40.139697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595961+0000","last_change":"2024-03-26T06:16:58.526724+0000","last_active":"2024-03-26T06:17:03.595961+0000","last_peered":"2024-03-26T06:17:03.595961+0000","last_clean":"2024-03-26T06:17:03.595961+0000","last_became_active":"2024-03-26T06:16:58.526193+0000","last_became_peered":"2024-03-26T06:16:58.526193+0000","last_unstale":"2024-03-26T06:17:03.595961+0000","last_undegraded":"2024-03-26T06:17:03.595961+0000","last_fullsized":"2024-03-26T06:17:03.595961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:16.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601351+0000","last_change":"2024-03-26T06:16:58.527308+0000","last_active":"2024-03-26T06:17:03.601351+0000","last_peered":"2024-03-26T06:17:03.601351+0000","last_clean":"2024-03-26T06:17:03.601351+0000","last_became_active":"2024-03-26T06:16:58.526990+0000","last_became_peered":"2024-03-26T06:16:58.526990+0000","last_unstale":"2024-03-26T06:17:03.601351+0000","last_undegraded":"2024-03-26T06:17:03.601351+0000","last_fullsized":"2024-03-26T06:17:03.601351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:15:40.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.550779+0000","last_change":"2024-03-26T06:16:58.522409+0000","last_active":"2024-03-26T06:17:03.550779+0000","last_peered":"2024-03-26T06:17:03.550779+0000","last_clean":"2024-03-26T06:17:03.550779+0000","last_became_active":"2024-03-26T06:16:58.521947+0000","last_became_peered":"2024-03-26T06:16:58.521947+0000","last_unstale":"2024-03-26T06:17:03.550779+0000","last_undegraded":"2024-03-26T06:17:03.550779+0000","last_fullsized":"2024-03-26T06:17:03.550779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:28.052525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554877+0000","last_change":"2024-03-26T06:16:58.541494+0000","last_active":"2024-03-26T06:17:03.554877+0000","last_peered":"2024-03-26T06:17:03.554877+0000","last_clean":"2024-03-26T06:17:03.554877+0000","last_became_active":"2024-03-26T06:16:58.541225+0000","last_became_peered":"2024-03-26T06:16:58.541225+0000","last_unstale":"2024-03-26T06:17:03.554877+0000","last_undegraded":"2024-03-26T06:17:03.554877+0000","last_fullsized":"2024-03-26T06:17:03.554877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:12:35.743222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.552810+0000","last_change":"2024-03-26T06:16:58.533315+0000","last_active":"2024-03-26T06:17:03.552810+0000","last_peered":"2024-03-26T06:17:03.552810+0000","last_clean":"2024-03-26T06:17:03.552810+0000","last_became_active":"2024-03-26T06:16:58.528051+0000","last_became_peered":"2024-03-26T06:16:58.528051+0000","last_unstale":"2024-03-26T06:17:03.552810+0000","last_undegraded":"2024-03-26T06:17:03.552810+0000","last_fullsized":"2024-03-26T06:17:03.552810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594978+0000","last_change":"2024-03-26T06:16:58.527009+0000","last_active":"2024-03-26T06:17:03.594978+0000","last_peered":"2024-03-26T06:17:03.594978+0000","last_clean":"2024-03-26T06:17:03.594978+0000","last_became_active":"2024-03-26T06:16:58.526743+0000","last_became_peered":"2024-03-26T06:16:58.526743+0000","last_unstale":"2024-03-26T06:17:03.594978+0000","last_undegraded":"2024-03-26T06:17:03.594978+0000","last_fullsized":"2024-03-26T06:17:03.594978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:28:00.900532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594651+0000","last_change":"2024-03-26T06:16:58.507099+0000","last_active":"2024-03-26T06:17:03.594651+0000","last_peered":"2024-03-26T06:17:03.594651+0000","last_clean":"2024-03-26T06:17:03.594651+0000","last_became_active":"2024-03-26T06:16:58.506705+0000","last_became_peered":"2024-03-26T06:16:58.506705+0000","last_unstale":"2024-03-26T06:17:03.594651+0000","last_undegraded":"2024-03-26T06:17:03.594651+0000","last_fullsized":"2024-03-26T06:17:03.594651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:17:59.821941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.555438+0000","last_change":"2024-03-26T06:16:58.516376+0000","last_active":"2024-03-26T06:17:03.555438+0000","last_peered":"2024-03-26T06:17:03.555438+0000","last_clean":"2024-03-26T06:17:03.555438+0000","last_became_active":"2024-03-26T06:16:58.515999+0000","last_became_peered":"2024-03-26T06:16:58.515999+0000","last_unstale":"2024-03-26T06:17:03.555438+0000","last_undegraded":"2024-03-26T06:17:03.555438+0000","last_fullsized":"2024-03-26T06:17:03.555438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599454+0000","last_change":"2024-03-26T06:16:58.544901+0000","last_active":"2024-03-26T06:17:03.599454+0000","last_peered":"2024-03-26T06:17:03.599454+0000","last_clean":"2024-03-26T06:17:03.599454+0000","last_became_active":"2024-03-26T06:16:58.544637+0000","last_became_peered":"2024-03-26T06:16:58.544637+0000","last_unstale":"2024-03-26T06:17:03.599454+0000","last_undegraded":"2024-03-26T06:17:03.599454+0000","last_fullsized":"2024-03-26T06:17:03.599454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:15:28.052525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.596829+0000","last_change":"2024-03-26T06:16:58.536619+0000","last_active":"2024-03-26T06:17:03.596829+0000","last_peered":"2024-03-26T06:17:03.596829+0000","last_clean":"2024-03-26T06:17:03.596829+0000","last_became_active":"2024-03-26T06:16:58.536267+0000","last_became_peered":"2024-03-26T06:16:58.536267+0000","last_unstale":"2024-03-26T06:17:03.596829+0000","last_undegraded":"2024-03-26T06:17:03.596829+0000","last_fullsized":"2024-03-26T06:17:03.596829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:31:21.594830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.600622+0000","last_change":"2024-03-26T06:16:58.538210+0000","last_active":"2024-03-26T06:17:03.600622+0000","last_peered":"2024-03-26T06:17:03.600622+0000","last_clean":"2024-03-26T06:17:03.600622+0000","last_became_active":"2024-03-26T06:16:58.537967+0000","last_became_peered":"2024-03-26T06:16:58.537967+0000","last_unstale":"2024-03-26T06:17:03.600622+0000","last_undegraded":"2024-03-26T06:17:03.600622+0000","last_fullsized":"2024-03-26T06:17:03.600622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.602020+0000","last_change":"2024-03-26T06:16:58.540273+0000","last_active":"2024-03-26T06:17:03.602020+0000","last_peered":"2024-03-26T06:17:03.602020+0000","last_clean":"2024-03-26T06:17:03.602020+0000","last_became_active":"2024-03-26T06:16:58.539908+0000","last_became_peered":"2024-03-26T06:16:58.539908+0000","last_unstale":"2024-03-26T06:17:03.602020+0000","last_undegraded":"2024-03-26T06:17:03.602020+0000","last_fullsized":"2024-03-26T06:17:03.602020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:12:57.541865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.554144+0000","last_change":"2024-03-26T06:16:58.535528+0000","last_active":"2024-03-26T06:17:03.554144+0000","last_peered":"2024-03-26T06:17:03.554144+0000","last_clean":"2024-03-26T06:17:03.554144+0000","last_became_active":"2024-03-26T06:16:58.535213+0000","last_became_peered":"2024-03-26T06:16:58.535213+0000","last_unstale":"2024-03-26T06:17:03.554144+0000","last_undegraded":"2024-03-26T06:17:03.554144+0000","last_fullsized":"2024-03-26T06:17:03.554144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:43:51.096559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.598687+0000","last_change":"2024-03-26T06:16:58.525785+0000","last_active":"2024-03-26T06:17:03.598687+0000","last_peered":"2024-03-26T06:17:03.598687+0000","last_clean":"2024-03-26T06:17:03.598687+0000","last_became_active":"2024-03-26T06:16:58.525444+0000","last_became_peered":"2024-03-26T06:16:58.525444+0000","last_unstale":"2024-03-26T06:17:03.598687+0000","last_undegraded":"2024-03-26T06:17:03.598687+0000","last_fullsized":"2024-03-26T06:17:03.598687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553717+0000","last_change":"2024-03-26T06:16:58.532698+0000","last_active":"2024-03-26T06:17:03.553717+0000","last_peered":"2024-03-26T06:17:03.553717+0000","last_clean":"2024-03-26T06:17:03.553717+0000","last_became_active":"2024-03-26T06:16:58.532381+0000","last_became_peered":"2024-03-26T06:16:58.532381+0000","last_unstale":"2024-03-26T06:17:03.553717+0000","last_undegraded":"2024-03-26T06:17:03.553717+0000","last_fullsized":"2024-03-26T06:17:03.553717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:19:15.740853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.599589+0000","last_change":"2024-03-26T06:16:58.524657+0000","last_active":"2024-03-26T06:17:03.599589+0000","last_peered":"2024-03-26T06:17:03.599589+0000","last_clean":"2024-03-26T06:17:03.599589+0000","last_became_active":"2024-03-26T06:16:58.524265+0000","last_became_peered":"2024-03-26T06:16:58.524265+0000","last_unstale":"2024-03-26T06:17:03.599589+0000","last_undegraded":"2024-03-26T06:17:03.599589+0000","last_fullsized":"2024-03-26T06:17:03.599589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:42:30.208261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.553997+0000","last_change":"2024-03-26T06:16:58.523272+0000","last_active":"2024-03-26T06:17:03.553997+0000","last_peered":"2024-03-26T06:17:03.553997+0000","last_clean":"2024-03-26T06:17:03.553997+0000","last_became_active":"2024-03-26T06:16:58.522614+0000","last_became_peered":"2024-03-26T06:16:58.522614+0000","last_unstale":"2024-03-26T06:17:03.553997+0000","last_undegraded":"2024-03-26T06:17:03.553997+0000","last_fullsized":"2024-03-26T06:17:03.553997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:17.123689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.594564+0000","last_change":"2024-03-26T06:16:58.519796+0000","last_active":"2024-03-26T06:17:03.594564+0000","last_peered":"2024-03-26T06:17:03.594564+0000","last_clean":"2024-03-26T06:17:03.594564+0000","last_became_active":"2024-03-26T06:16:58.516658+0000","last_became_peered":"2024-03-26T06:16:58.516658+0000","last_unstale":"2024-03-26T06:17:03.594564+0000","last_undegraded":"2024-03-26T06:17:03.594564+0000","last_fullsized":"2024-03-26T06:17:03.594564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:19:35.554524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.595916+0000","last_change":"2024-03-26T06:16:58.505664+0000","last_active":"2024-03-26T06:17:03.595916+0000","last_peered":"2024-03-26T06:17:03.595916+0000","last_clean":"2024-03-26T06:17:03.595916+0000","last_became_active":"2024-03-26T06:16:58.505309+0000","last_became_peered":"2024-03-26T06:16:58.505309+0000","last_unstale":"2024-03-26T06:17:03.595916+0000","last_undegraded":"2024-03-26T06:17:03.595916+0000","last_fullsized":"2024-03-26T06:17:03.595916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:18:03.232881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-26T06:17:03.601776+0000","last_change":"2024-03-26T06:16:58.539992+0000","last_active":"2024-03-26T06:17:03.601776+0000","last_peered":"2024-03-26T06:17:03.601776+0000","last_clean":"2024-03-26T06:17:03.601776+0000","last_became_active":"2024-03-26T06:16:58.539588+0000","last_became_peered":"2024-03-26T06:16:58.539588+0000","last_unstale":"2024-03-26T06:17:03.601776+0000","last_undegraded":"2024-03-26T06:17:03.601776+0000","last_fullsized":"2024-03-26T06:17:03.601776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:57.454602+0000","last_clean_scrub_stamp":"2024-03-26T06:16:57.454602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:46:17.123689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-26T06:17:28.393 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-26T06:17:28.393 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-26T06:17:28.393 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-26T06:17:28.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-26T06:17:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.630+0000 7f1286200640 1 Processor -- start 2024-03-26T06:17:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.630+0000 7f1286200640 1 -- start start 2024-03-26T06:17:28.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.632+0000 7f1286200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1280145100 0x7f128006ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.632+0000 7f1286200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f128006ef70 0x7f1280071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.632+0000 7f1286200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1280071c90 con 0x7f1280071890 2024-03-26T06:17:28.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.632+0000 7f1286200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12800a86e0 con 0x7f128006ef70 2024-03-26T06:17:28.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.632+0000 7f1286200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128015bf80 con 0x7f1280145100 2024-03-26T06:17:28.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.632+0000 7f1277e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f128006ef70 0x7f1280071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.632+0000 7f1277e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f128006ef70 0x7f1280071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50110/0 (socket says 172.21.15.63:50110) 2024-03-26T06:17:28.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.632+0000 7f1277e00640 1 -- 172.21.15.63:0/3003762471 learned_addr learned my addr 172.21.15.63:0/3003762471 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:28.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.633+0000 7f1277e00640 1 -- 172.21.15.63:0/3003762471 >> v2:172.21.15.204:3300/0 conn(0x7f1280145100 msgr2=0x7f128006ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:28.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.633+0000 7f127f400640 1 --2- 172.21.15.63:0/3003762471 >> v2:172.21.15.204:3300/0 conn(0x7f1280145100 0x7f128006ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.633+0000 7f1277e00640 1 --2- 172.21.15.63:0/3003762471 >> v2:172.21.15.204:3300/0 conn(0x7f1280145100 0x7f128006ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.633+0000 7f1277e00640 1 -- 172.21.15.63:0/3003762471 >> v1:172.21.15.204:6789/0 conn(0x7f1280071890 legacy=0x7f128015f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:28.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.633+0000 7f1277e00640 1 -- 172.21.15.63:0/3003762471 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128006e2f0 con 0x7f128006ef70 2024-03-26T06:17:28.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.633+0000 7f127f400640 1 --2- 172.21.15.63:0/3003762471 >> v2:172.21.15.204:3300/0 conn(0x7f1280145100 0x7f128006ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:28.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.634+0000 7f1277e00640 1 --2- 172.21.15.63:0/3003762471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f128006ef70 0x7f1280071350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f12800b4c00 tx=0x7f126802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff415473b71d9d7f server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:28.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.634+0000 7f127ea00640 1 -- 172.21.15.63:0/3003762471 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268035020 con 0x7f128006ef70 2024-03-26T06:17:28.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.634+0000 7f127ea00640 1 -- 172.21.15.63:0/3003762471 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268031870 con 0x7f128006ef70 2024-03-26T06:17:28.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.634+0000 7f127ea00640 1 -- 172.21.15.63:0/3003762471 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268031c40 con 0x7f128006ef70 2024-03-26T06:17:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.635+0000 7f1286200640 1 -- 172.21.15.63:0/3003762471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f128006ef70 msgr2=0x7f1280071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.635+0000 7f1286200640 1 --2- 172.21.15.63:0/3003762471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f128006ef70 0x7f1280071350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f12800b4c00 tx=0x7f126802b910 comp rx=0 tx=0).stop 2024-03-26T06:17:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.635+0000 7f1286200640 1 -- 172.21.15.63:0/3003762471 shutdown_connections 2024-03-26T06:17:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.635+0000 7f1286200640 1 --2- 172.21.15.63:0/3003762471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f128006ef70 0x7f1280071350 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.635+0000 7f1286200640 1 --2- 172.21.15.63:0/3003762471 >> v2:172.21.15.204:3300/0 conn(0x7f1280145100 0x7f128006ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.635+0000 7f1286200640 1 -- 172.21.15.63:0/3003762471 >> 172.21.15.63:0/3003762471 conn(0x7f128006ac90 msgr2=0x7f128006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.635+0000 7f1286200640 1 -- 172.21.15.63:0/3003762471 shutdown_connections 2024-03-26T06:17:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.635+0000 7f1286200640 1 -- 172.21.15.63:0/3003762471 wait complete. 2024-03-26T06:17:28.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.637+0000 7f1286200640 1 Processor -- start 2024-03-26T06:17:28.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.637+0000 7f1286200640 1 -- start start 2024-03-26T06:17:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f1286200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128006ef70 0x7f128013b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f1286200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1280071890 0x7f128015e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f1286200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1280145100 0x7f128015ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f1286200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128006dd30 con 0x7f1280145100 2024-03-26T06:17:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f1286200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128006da50 con 0x7f128006ef70 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f1286200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128006e010 con 0x7f1280071890 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f127fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1280145100 0x7f128015ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f127fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1280145100 0x7f128015ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50124/0 (socket says 172.21.15.63:50124) 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f127fe00640 1 -- 172.21.15.63:0/2547116423 learned_addr learned my addr 172.21.15.63:0/2547116423 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f127f400640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128006ef70 0x7f128013b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f1277e00640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1280071890 0x7f128015e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f127fe00640 1 -- 172.21.15.63:0/2547116423 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1280071890 msgr2=0x7f128015e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f127fe00640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1280071890 0x7f128015e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f127fe00640 1 -- 172.21.15.63:0/2547116423 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128006ef70 msgr2=0x7f128013b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f127fe00640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128006ef70 0x7f128013b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.638+0000 7f127fe00640 1 -- 172.21.15.63:0/2547116423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128015cfc0 con 0x7f1280145100 2024-03-26T06:17:28.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.639+0000 7f127fe00640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1280145100 0x7f128015ec00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f127800c780 tx=0x7f127800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:28.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.639+0000 7f1277400640 1 -- 172.21.15.63:0/2547116423 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278004b60 con 0x7f1280145100 2024-03-26T06:17:28.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.639+0000 7f1277400640 1 -- 172.21.15.63:0/2547116423 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1278004d00 con 0x7f1280145100 2024-03-26T06:17:28.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.639+0000 7f1277400640 1 -- 172.21.15.63:0/2547116423 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127800aa90 con 0x7f1280145100 2024-03-26T06:17:28.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.639+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128015d2a0 con 0x7f1280145100 2024-03-26T06:17:28.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.639+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128015d860 con 0x7f1280145100 2024-03-26T06:17:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.640+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1280074730 con 0x7f1280145100 2024-03-26T06:17:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.641+0000 7f1277400640 1 -- 172.21.15.63:0/2547116423 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f127800ac30 con 0x7f1280145100 2024-03-26T06:17:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.643+0000 7f1277400640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f125c06bbd0 0x7f125c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.643+0000 7f1277400640 1 -- 172.21.15.63:0/2547116423 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f127808b0e0 con 0x7f1280145100 2024-03-26T06:17:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.643+0000 7f127f400640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f125c06bbd0 0x7f125c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.644+0000 7f127f400640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f125c06bbd0 0x7f125c06e090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f127000a950 tx=0x7f1270008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:28.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.647+0000 7f1277400640 1 -- 172.21.15.63:0/2547116423 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1278020070 con 0x7f1280145100 2024-03-26T06:17:28.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.890+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f128006c310 con 0x7f1280145100 2024-03-26T06:17:28.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.890+0000 7f1277400640 1 -- 172.21.15.63:0/2547116423 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1278059880 con 0x7f1280145100 2024-03-26T06:17:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:28.891 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-26T06:17:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f125c06bbd0 msgr2=0x7f125c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f125c06bbd0 0x7f125c06e090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f127000a950 tx=0x7f1270008040 comp rx=0 tx=0).stop 2024-03-26T06:17:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1280145100 msgr2=0x7f128015ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1280145100 0x7f128015ec00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f127800c780 tx=0x7f127800cc40 comp rx=0 tx=0).stop 2024-03-26T06:17:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 shutdown_connections 2024-03-26T06:17:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f125c06bbd0 0x7f125c06e090 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1280145100 0x7f128015ec00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1280071890 0x7f128015e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 --2- 172.21.15.63:0/2547116423 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128006ef70 0x7f128013b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:28.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.893+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 >> 172.21.15.63:0/2547116423 conn(0x7f128006ac90 msgr2=0x7f128015f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:28.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.894+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 shutdown_connections 2024-03-26T06:17:28.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:28.894+0000 7f1286200640 1 -- 172.21.15.63:0/2547116423 wait complete. 2024-03-26T06:17:28.910 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-26T06:17:28.911 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:29.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.120+0000 7f9db6800640 1 Processor -- start 2024-03-26T06:17:29.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.120+0000 7f9db6800640 1 -- start start 2024-03-26T06:17:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.122+0000 7f9db6800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9db0161420 0x7f9db00b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.122+0000 7f9db6800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 0x7f9db00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.122+0000 7f9db6800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db0162390 con 0x7f9db0161800 2024-03-26T06:17:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.122+0000 7f9db6800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db00b5780 con 0x7f9db0161420 2024-03-26T06:17:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.122+0000 7f9db6800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db006d280 con 0x7f9db00ad120 2024-03-26T06:17:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.122+0000 7f9db5400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9db0161420 0x7f9db00b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.122+0000 7f9db5400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9db0161420 0x7f9db00b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50136/0 (socket says 172.21.15.63:50136) 2024-03-26T06:17:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.122+0000 7f9db5400640 1 -- 172.21.15.63:0/3385956916 learned_addr learned my addr 172.21.15.63:0/3385956916 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.122+0000 7f9db5e00640 1 --2- 172.21.15.63:0/3385956916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 0x7f9db00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.123+0000 7f9db5400640 1 -- 172.21.15.63:0/3385956916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 msgr2=0x7f9db00ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.123+0000 7f9db5400640 1 --2- 172.21.15.63:0/3385956916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 0x7f9db00ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.123+0000 7f9db5400640 1 -- 172.21.15.63:0/3385956916 >> v1:172.21.15.204:6789/0 conn(0x7f9db0161800 legacy=0x7f9db0161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.123+0000 7f9db5400640 1 -- 172.21.15.63:0/3385956916 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00b4ee0 con 0x7f9db0161420 2024-03-26T06:17:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.123+0000 7f9db5e00640 1 --2- 172.21.15.63:0/3385956916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 0x7f9db00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.124+0000 7f9db5400640 1 --2- 172.21.15.63:0/3385956916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161420 0x7f9db00b26d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009870 tx=0x7f9da402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf5f15caf9d29e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.124+0000 7f9dafe00640 1 -- 172.21.15.63:0/3385956916 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40317c0 con 0x7f9db0161420 2024-03-26T06:17:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.124+0000 7f9dafe00640 1 -- 172.21.15.63:0/3385956916 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da4037070 con 0x7f9db0161420 2024-03-26T06:17:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.124+0000 7f9dafe00640 1 -- 172.21.15.63:0/3385956916 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4031b80 con 0x7f9db0161420 2024-03-26T06:17:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.124+0000 7f9db6800640 1 -- 172.21.15.63:0/3385956916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161420 msgr2=0x7f9db00b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.124+0000 7f9db6800640 1 --2- 172.21.15.63:0/3385956916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161420 0x7f9db00b26d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009870 tx=0x7f9da402b860 comp rx=0 tx=0).stop 2024-03-26T06:17:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.125+0000 7f9db6800640 1 -- 172.21.15.63:0/3385956916 shutdown_connections 2024-03-26T06:17:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.125+0000 7f9db6800640 1 --2- 172.21.15.63:0/3385956916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 0x7f9db00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.125+0000 7f9db6800640 1 --2- 172.21.15.63:0/3385956916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161420 0x7f9db00b26d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.125+0000 7f9db6800640 1 -- 172.21.15.63:0/3385956916 >> 172.21.15.63:0/3385956916 conn(0x7f9db00b13d0 msgr2=0x7f9db00b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:29.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.125+0000 7f9db6800640 1 -- 172.21.15.63:0/3385956916 shutdown_connections 2024-03-26T06:17:29.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.125+0000 7f9db6800640 1 -- 172.21.15.63:0/3385956916 wait complete. 2024-03-26T06:17:29.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.126+0000 7f9db6800640 1 Processor -- start 2024-03-26T06:17:29.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.126+0000 7f9db6800640 1 -- start start 2024-03-26T06:17:29.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.127+0000 7f9db6800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 0x7f9db0139b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.127+0000 7f9db6800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9db0161420 0x7f9db015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.127+0000 7f9db6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161800 0x7f9db01421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.127+0000 7f9db6800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0147440 con 0x7f9db0161800 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.127+0000 7f9db6800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00b54a0 con 0x7f9db0161420 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.127+0000 7f9db6800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00b2dd0 con 0x7f9db00ad120 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161800 0x7f9db01421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161800 0x7f9db01421c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50144/0 (socket says 172.21.15.63:50144) 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5e00640 1 -- 172.21.15.63:0/4121126614 learned_addr learned my addr 172.21.15.63:0/4121126614 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5400640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 0x7f9db0139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db4a00640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9db0161420 0x7f9db015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5e00640 1 -- 172.21.15.63:0/4121126614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 msgr2=0x7f9db0139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5e00640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 0x7f9db0139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5e00640 1 -- 172.21.15.63:0/4121126614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9db0161420 msgr2=0x7f9db015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5e00640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9db0161420 0x7f9db015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5e00640 1 -- 172.21.15.63:0/4121126614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db015af00 con 0x7f9db0161800 2024-03-26T06:17:29.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.128+0000 7f9db5e00640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161800 0x7f9db01421c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9da800cd50 tx=0x7f9da800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:29.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.129+0000 7f9dad600640 1 -- 172.21.15.63:0/4121126614 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800f680 con 0x7f9db0161800 2024-03-26T06:17:29.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.129+0000 7f9dad600640 1 -- 172.21.15.63:0/4121126614 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da800f840 con 0x7f9db0161800 2024-03-26T06:17:29.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.129+0000 7f9dad600640 1 -- 172.21.15.63:0/4121126614 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800fc30 con 0x7f9db0161800 2024-03-26T06:17:29.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.129+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db01452d0 con 0x7f9db0161800 2024-03-26T06:17:29.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.129+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db0145850 con 0x7f9db0161800 2024-03-26T06:17:29.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.130+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db004f050 con 0x7f9db0161800 2024-03-26T06:17:29.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.131+0000 7f9dad600640 1 -- 172.21.15.63:0/4121126614 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9da80213f0 con 0x7f9db0161800 2024-03-26T06:17:29.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.132+0000 7f9dad600640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9d9406bbd0 0x7f9d9406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.132+0000 7f9dad600640 1 -- 172.21.15.63:0/4121126614 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9da808bb60 con 0x7f9db0161800 2024-03-26T06:17:29.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.132+0000 7f9db5400640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9d9406bbd0 0x7f9d9406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.133+0000 7f9db5400640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9d9406bbd0 0x7f9d9406e090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9da4036000 tx=0x7f9da403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:29.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.136+0000 7f9dad600640 1 -- 172.21.15.63:0/4121126614 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f9db015af00 con 0x7f9db0161800 2024-03-26T06:17:29.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.327+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9db006f380 con 0x7f9db0161800 2024-03-26T06:17:29.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.329+0000 7f9dad600640 1 -- 172.21.15.63:0/4121126614 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f9da8014030 con 0x7f9db0161800 2024-03-26T06:17:29.330 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:29.330 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:29.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9d9406bbd0 msgr2=0x7f9d9406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9d9406bbd0 0x7f9d9406e090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9da4036000 tx=0x7f9da403d040 comp rx=0 tx=0).stop 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161800 msgr2=0x7f9db01421c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161800 0x7f9db01421c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9da800cd50 tx=0x7f9da800a650 comp rx=0 tx=0).stop 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 shutdown_connections 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9d9406bbd0 0x7f9d9406e090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db0161800 0x7f9db01421c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9db0161420 0x7f9db015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 --2- 172.21.15.63:0/4121126614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9db00ad120 0x7f9db0139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 >> 172.21.15.63:0/4121126614 conn(0x7f9db00b13d0 msgr2=0x7f9db0161c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 shutdown_connections 2024-03-26T06:17:29.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.332+0000 7f9db6800640 1 -- 172.21.15.63:0/4121126614 wait complete. 2024-03-26T06:17:29.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:17:29.351 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:17:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.572+0000 7f179e000640 1 Processor -- start 2024-03-26T06:17:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.572+0000 7f179e000640 1 -- start start 2024-03-26T06:17:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179e000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f17980b95b0 0x7f17980b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179e000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17980b8a40 0x7f17980d1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179e000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17980b7460 con 0x7f179815dad0 2024-03-26T06:17:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179e000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17980b8070 con 0x7f17980b8a40 2024-03-26T06:17:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179e000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17980b7740 con 0x7f17980b95b0 2024-03-26T06:17:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179d600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17980b8a40 0x7f17980d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179d600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17980b8a40 0x7f17980d1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50154/0 (socket says 172.21.15.63:50154) 2024-03-26T06:17:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179d600640 1 -- 172.21.15.63:0/1183025587 learned_addr learned my addr 172.21.15.63:0/1183025587 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179d600640 1 -- 172.21.15.63:0/1183025587 >> v2:172.21.15.204:3300/0 conn(0x7f17980b95b0 msgr2=0x7f17980b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179d600640 1 --2- 172.21.15.63:0/1183025587 >> v2:172.21.15.204:3300/0 conn(0x7f17980b95b0 0x7f17980b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.574+0000 7f179d600640 1 -- 172.21.15.63:0/1183025587 >> v1:172.21.15.204:6789/0 conn(0x7f179815dad0 legacy=0x7f17980b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.575+0000 7f179d600640 1 -- 172.21.15.63:0/1183025587 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17980b7a20 con 0x7f17980b8a40 2024-03-26T06:17:29.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.576+0000 7f179d600640 1 --2- 172.21.15.63:0/1183025587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b8a40 0x7f17980d1890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17980c7180 tx=0x7f179002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6303b24d8350e0b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.576+0000 7f1797400640 1 -- 172.21.15.63:0/1183025587 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179002c9f0 con 0x7f17980b8a40 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.576+0000 7f1797400640 1 -- 172.21.15.63:0/1183025587 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179002cb90 con 0x7f17980b8a40 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.576+0000 7f1797400640 1 -- 172.21.15.63:0/1183025587 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17900343f0 con 0x7f17980b8a40 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.576+0000 7f179e000640 1 -- 172.21.15.63:0/1183025587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b8a40 msgr2=0x7f17980d1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.576+0000 7f179e000640 1 --2- 172.21.15.63:0/1183025587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b8a40 0x7f17980d1890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17980c7180 tx=0x7f179002be50 comp rx=0 tx=0).stop 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.576+0000 7f179e000640 1 -- 172.21.15.63:0/1183025587 shutdown_connections 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.576+0000 7f179e000640 1 --2- 172.21.15.63:0/1183025587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b8a40 0x7f17980d1890 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.576+0000 7f179e000640 1 --2- 172.21.15.63:0/1183025587 >> v2:172.21.15.204:3300/0 conn(0x7f17980b95b0 0x7f17980b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.577+0000 7f179e000640 1 -- 172.21.15.63:0/1183025587 >> 172.21.15.63:0/1183025587 conn(0x7f17980727e0 msgr2=0x7f1798072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.577+0000 7f179e000640 1 -- 172.21.15.63:0/1183025587 shutdown_connections 2024-03-26T06:17:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.577+0000 7f179e000640 1 -- 172.21.15.63:0/1183025587 wait complete. 2024-03-26T06:17:29.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.578+0000 7f179e000640 1 Processor -- start 2024-03-26T06:17:29.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.579+0000 7f179e000640 1 -- start start 2024-03-26T06:17:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.579+0000 7f179e000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17980b8a40 0x7f17980c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.579+0000 7f179e000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b95b0 0x7f1798158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f179e000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f179815dad0 0x7f179815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f179e000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17980b7210 con 0x7f17980b95b0 2024-03-26T06:17:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f179e000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17980b7090 con 0x7f17980b8a40 2024-03-26T06:17:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f179e000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17980d1dd0 con 0x7f179815dad0 2024-03-26T06:17:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f1797e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b95b0 0x7f1798158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f1797e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b95b0 0x7f1798158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50162/0 (socket says 172.21.15.63:50162) 2024-03-26T06:17:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f1797e00640 1 -- 172.21.15.63:0/636667445 learned_addr learned my addr 172.21.15.63:0/636667445 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f179d600640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f179815dad0 0x7f179815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f179cc00640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17980b8a40 0x7f17980c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f1797e00640 1 -- 172.21.15.63:0/636667445 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f179815dad0 msgr2=0x7f179815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f1797e00640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f179815dad0 0x7f179815bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f1797e00640 1 -- 172.21.15.63:0/636667445 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17980b8a40 msgr2=0x7f17980c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f1797e00640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17980b8a40 0x7f17980c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.580+0000 7f1797e00640 1 -- 172.21.15.63:0/636667445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179815c9d0 con 0x7f17980b95b0 2024-03-26T06:17:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.581+0000 7f1797e00640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b95b0 0x7f1798158510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f178800b4d0 tx=0x7f178800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.581+0000 7f1794c00640 1 -- 172.21.15.63:0/636667445 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788014070 con 0x7f17980b95b0 2024-03-26T06:17:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.581+0000 7f1794c00640 1 -- 172.21.15.63:0/636667445 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788010870 con 0x7f17980b95b0 2024-03-26T06:17:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.581+0000 7f1794c00640 1 -- 172.21.15.63:0/636667445 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788010c60 con 0x7f17980b95b0 2024-03-26T06:17:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.581+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17980c82a0 con 0x7f17980b95b0 2024-03-26T06:17:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.581+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17980c8860 con 0x7f17980b95b0 2024-03-26T06:17:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.582+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179815edb0 con 0x7f17980b95b0 2024-03-26T06:17:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.583+0000 7f1794c00640 1 -- 172.21.15.63:0/636667445 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1788017070 con 0x7f17980b95b0 2024-03-26T06:17:29.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.584+0000 7f1794c00640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f177c06bbd0 0x7f177c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:29.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.584+0000 7f1794c00640 1 -- 172.21.15.63:0/636667445 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f178808abc0 con 0x7f17980b95b0 2024-03-26T06:17:29.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.585+0000 7f179cc00640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f177c06bbd0 0x7f177c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:29.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.585+0000 7f179cc00640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f177c06bbd0 0x7f177c06e090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f178c006fd0 tx=0x7f178c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:29.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.589+0000 7f1794c00640 1 -- 172.21.15.63:0/636667445 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f179815edb0 con 0x7f17980b95b0 2024-03-26T06:17:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.783+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f179804f0c0 con 0x7f17980b95b0 2024-03-26T06:17:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.784+0000 7f1794c00640 1 -- 172.21.15.63:0/636667445 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1788059360 con 0x7f17980b95b0 2024-03-26T06:17:29.784 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:17:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f177c06bbd0 msgr2=0x7f177c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f177c06bbd0 0x7f177c06e090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f178c006fd0 tx=0x7f178c008040 comp rx=0 tx=0).stop 2024-03-26T06:17:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b95b0 msgr2=0x7f1798158510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b95b0 0x7f1798158510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f178800b4d0 tx=0x7f178800b990 comp rx=0 tx=0).stop 2024-03-26T06:17:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 shutdown_connections 2024-03-26T06:17:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f177c06bbd0 0x7f177c06e090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f179815dad0 0x7f179815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17980b95b0 0x7f1798158510 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 --2- 172.21.15.63:0/636667445 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17980b8a40 0x7f17980c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 >> 172.21.15.63:0/636667445 conn(0x7f17980727e0 msgr2=0x7f179815deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 shutdown_connections 2024-03-26T06:17:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:29.786+0000 7f179e000640 1 -- 172.21.15.63:0/636667445 wait complete. 2024-03-26T06:17:29.805 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:17:30.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.022+0000 7f315b400640 1 Processor -- start 2024-03-26T06:17:30.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.022+0000 7f315b400640 1 -- start start 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.023+0000 7f315b400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f315415dc70 0x7f315406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.023+0000 7f315b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f31540cfe90 0x7f31540cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.023+0000 7f315b400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315406d1f0 con 0x7f31540d1780 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.023+0000 7f315b400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31540cc480 con 0x7f31540cfe90 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.023+0000 7f315b400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31540d02f0 con 0x7f315415dc70 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3153e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f31540cfe90 0x7f31540cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3159400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f31540d1780 0x7f31540ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43982/0 (socket says 172.21.15.63:43982) 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3153e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f31540cfe90 0x7f31540cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50172/0 (socket says 172.21.15.63:50172) 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3159400640 1 -- 172.21.15.63:0/630450915 learned_addr learned my addr 172.21.15.63:0/630450915 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3158a00640 1 --2- 172.21.15.63:0/630450915 >> v2:172.21.15.204:3300/0 conn(0x7f315415dc70 0x7f315406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3153e00640 1 -- 172.21.15.63:0/630450915 >> v2:172.21.15.204:3300/0 conn(0x7f315415dc70 msgr2=0x7f315406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:30.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3153e00640 1 --2- 172.21.15.63:0/630450915 >> v2:172.21.15.204:3300/0 conn(0x7f315415dc70 0x7f315406c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3153e00640 1 -- 172.21.15.63:0/630450915 >> v1:172.21.15.63:6789/0 conn(0x7f31540d1780 legacy=0x7f31540ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3153e00640 1 -- 172.21.15.63:0/630450915 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315406c950 con 0x7f31540cfe90 2024-03-26T06:17:30.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.024+0000 7f3153400640 1 -- 172.21.15.63:0/630450915 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371553757 0 0) 0x7f315406d1f0 con 0x7f31540d1780 2024-03-26T06:17:30.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.025+0000 7f3153e00640 1 --2- 172.21.15.63:0/630450915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 0x7f31540cbf40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f31540b79d0 tx=0x7f313c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e331fff84273a0de server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f3153400640 1 -- 172.21.15.63:0/630450915 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c035020 con 0x7f31540cfe90 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f3153400640 1 -- 172.21.15.63:0/630450915 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c031830 con 0x7f31540cfe90 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f3153400640 1 -- 172.21.15.63:0/630450915 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c031c00 con 0x7f31540cfe90 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f315b400640 1 -- 172.21.15.63:0/630450915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 msgr2=0x7f31540cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f315b400640 1 --2- 172.21.15.63:0/630450915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 0x7f31540cbf40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f31540b79d0 tx=0x7f313c02b8d0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f315b400640 1 -- 172.21.15.63:0/630450915 shutdown_connections 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f315b400640 1 --2- 172.21.15.63:0/630450915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 0x7f31540cbf40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f315b400640 1 --2- 172.21.15.63:0/630450915 >> v2:172.21.15.204:3300/0 conn(0x7f315415dc70 0x7f315406c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f315b400640 1 -- 172.21.15.63:0/630450915 >> 172.21.15.63:0/630450915 conn(0x7f3154071000 msgr2=0x7f31540713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.026+0000 7f315b400640 1 -- 172.21.15.63:0/630450915 shutdown_connections 2024-03-26T06:17:30.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.027+0000 7f315b400640 1 -- 172.21.15.63:0/630450915 wait complete. 2024-03-26T06:17:30.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.029+0000 7f315b400640 1 Processor -- start 2024-03-26T06:17:30.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.029+0000 7f315b400640 1 -- start start 2024-03-26T06:17:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.030+0000 7f315b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 0x7f3154148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.030+0000 7f315b400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31540d1780 0x7f31540c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.030+0000 7f315b400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315415dc70 0x7f31540c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.030+0000 7f315b400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315415e050 con 0x7f31540cfe90 2024-03-26T06:17:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.030+0000 7f315b400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315406cf10 con 0x7f315415dc70 2024-03-26T06:17:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.030+0000 7f315b400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31540d1c30 con 0x7f31540d1780 2024-03-26T06:17:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.030+0000 7f3158a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 0x7f3154148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.030+0000 7f3158a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 0x7f3154148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50180/0 (socket says 172.21.15.63:50180) 2024-03-26T06:17:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.030+0000 7f3158a00640 1 -- 172.21.15.63:0/3055114769 learned_addr learned my addr 172.21.15.63:0/3055114769 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3158a00640 1 -- 172.21.15.63:0/3055114769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31540d1780 msgr2=0x7f31540c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3158a00640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31540d1780 0x7f31540c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3158a00640 1 -- 172.21.15.63:0/3055114769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315415dc70 msgr2=0x7f31540c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3159400640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315415dc70 0x7f31540c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3158a00640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315415dc70 0x7f31540c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3158a00640 1 -- 172.21.15.63:0/3055114769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540c9b30 con 0x7f31540cfe90 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3159400640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315415dc70 0x7f31540c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3158a00640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 0x7f3154148b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3144007e40 tx=0x7f314400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3150c00640 1 -- 172.21.15.63:0/3055114769 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144014620 con 0x7f31540cfe90 2024-03-26T06:17:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3150c00640 1 -- 172.21.15.63:0/3055114769 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144019070 con 0x7f31540cfe90 2024-03-26T06:17:30.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31540c9e10 con 0x7f31540cfe90 2024-03-26T06:17:30.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.031+0000 7f3150c00640 1 -- 172.21.15.63:0/3055114769 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144014a00 con 0x7f31540cfe90 2024-03-26T06:17:30.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.032+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31540c6190 con 0x7f31540cfe90 2024-03-26T06:17:30.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.033+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3154074730 con 0x7f31540cfe90 2024-03-26T06:17:30.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.034+0000 7f3150c00640 1 -- 172.21.15.63:0/3055114769 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3144014ba0 con 0x7f31540cfe90 2024-03-26T06:17:30.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.035+0000 7f3150c00640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f313006bbd0 0x7f313006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.035+0000 7f3150c00640 1 -- 172.21.15.63:0/3055114769 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f314408b6e0 con 0x7f31540cfe90 2024-03-26T06:17:30.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.035+0000 7f3153e00640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f313006bbd0 0x7f313006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.036+0000 7f3153e00640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f313006bbd0 0x7f313006e090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f313c036000 tx=0x7f313c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.039+0000 7f3150c00640 1 -- 172.21.15.63:0/3055114769 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f3144059e80 con 0x7f31540cfe90 2024-03-26T06:17:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.240+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3154071f00 con 0x7f31540cfe90 2024-03-26T06:17:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.241+0000 7f3150c00640 1 -- 172.21.15.63:0/3055114769 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3144059780 con 0x7f31540cfe90 2024-03-26T06:17:30.241 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:30.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f313006bbd0 msgr2=0x7f313006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f313006bbd0 0x7f313006e090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f313c036000 tx=0x7f313c030000 comp rx=0 tx=0).stop 2024-03-26T06:17:30.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 msgr2=0x7f3154148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 0x7f3154148b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3144007e40 tx=0x7f314400e4b0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 shutdown_connections 2024-03-26T06:17:30.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f313006bbd0 0x7f313006e090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315415dc70 0x7f31540c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31540d1780 0x7f31540c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 --2- 172.21.15.63:0/3055114769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31540cfe90 0x7f3154148b30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 >> 172.21.15.63:0/3055114769 conn(0x7f3154071000 msgr2=0x7f3154160ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:30.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 shutdown_connections 2024-03-26T06:17:30.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.245+0000 7f315b400640 1 -- 172.21.15.63:0/3055114769 wait complete. 2024-03-26T06:17:30.262 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:17:30.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.473+0000 7f0950a00640 1 Processor -- start 2024-03-26T06:17:30.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.473+0000 7f0950a00640 1 -- start start 2024-03-26T06:17:30.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.474+0000 7f0950a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f094c1438d0 0x7f094c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.475+0000 7f0950a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c143cb0 con 0x7f094c06e990 2024-03-26T06:17:30.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.475+0000 7f0950a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0ceed0 con 0x7f094c0ce330 2024-03-26T06:17:30.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.475+0000 7f0950a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c0ccef0 con 0x7f094c1438d0 2024-03-26T06:17:30.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.475+0000 7f094be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f094c06e990 0x7f094c0b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43996/0 (socket says 172.21.15.63:43996) 2024-03-26T06:17:30.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.475+0000 7f094be00640 1 -- 172.21.15.63:0/2902865915 learned_addr learned my addr 172.21.15.63:0/2902865915 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:30.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.475+0000 7f094b400640 1 --2- 172.21.15.63:0/2902865915 >> v2:172.21.15.204:3300/0 conn(0x7f094c1438d0 0x7f094c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.475+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80244708 0 0) 0x7f094c143cb0 con 0x7f094c06e990 2024-03-26T06:17:30.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0930003520 con 0x7f094c06e990 2024-03-26T06:17:30.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3628381252 0 0) 0x7f0930003520 con 0x7f094c06e990 2024-03-26T06:17:30.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 >> v2:172.21.15.204:3300/0 conn(0x7f094c1438d0 msgr2=0x7f094c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 --2- 172.21.15.63:0/2902865915 >> v2:172.21.15.204:3300/0 conn(0x7f094c1438d0 0x7f094c15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 >> v1:172.21.15.204:6789/0 conn(0x7f094c0ce330 legacy=0x7f094c06e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c0cf1b0 con 0x7f094c06e990 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f0944001670 con 0x7f094c06e990 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 >> v1:172.21.15.63:6789/0 conn(0x7f094c06e990 legacy=0x7f094c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0930003a00 0x7f0930003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0930004800 0x7f0930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09300051c0 0x7f093000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0ccef0 con 0x7f0930004800 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093000c0c0 con 0x7f0930003a00 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093000c2c0 con 0x7f09300051c0 2024-03-26T06:17:30.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.476+0000 7f094aa00640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0930004800 0x7f0930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.477+0000 7f094be00640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09300051c0 0x7f093000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.477+0000 7f094b400640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0930003a00 0x7f0930003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.477+0000 7f094aa00640 1 -- 172.21.15.63:0/2902865915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09300051c0 msgr2=0x7f093000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.477+0000 7f094aa00640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09300051c0 0x7f093000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.477+0000 7f094aa00640 1 -- 172.21.15.63:0/2902865915 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0930003a00 msgr2=0x7f0930003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.477+0000 7f094aa00640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0930003a00 0x7f0930003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.477+0000 7f094aa00640 1 -- 172.21.15.63:0/2902865915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930003520 con 0x7f0930004800 2024-03-26T06:17:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.477+0000 7f094b400640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0930003a00 0x7f0930003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.477+0000 7f094be00640 1 -- 172.21.15.63:0/2902865915 reap_dead start 2024-03-26T06:17:30.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.478+0000 7f094aa00640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0930004800 0x7f0930004c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0934001750 tx=0x7f0930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7079c8a8d4e43778 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:30.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.478+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934001370 con 0x7f0930004800 2024-03-26T06:17:30.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.478+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09340052d0 con 0x7f0930004800 2024-03-26T06:17:30.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.478+0000 7f094a000640 1 -- 172.21.15.63:0/2902865915 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934003830 con 0x7f0930004800 2024-03-26T06:17:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.479+0000 7f0950a00640 1 -- 172.21.15.63:0/2902865915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0930004800 msgr2=0x7f0930004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.479+0000 7f0950a00640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0930004800 0x7f0930004c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0934001750 tx=0x7f0930005830 comp rx=0 tx=0).stop 2024-03-26T06:17:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.479+0000 7f0950a00640 1 -- 172.21.15.63:0/2902865915 shutdown_connections 2024-03-26T06:17:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.479+0000 7f0950a00640 1 --2- 172.21.15.63:0/2902865915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0930004800 0x7f0930004c80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.479+0000 7f0950a00640 1 -- 172.21.15.63:0/2902865915 >> 172.21.15.63:0/2902865915 conn(0x7f094c0670b0 msgr2=0x7f094c0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.479+0000 7f0950a00640 1 -- 172.21.15.63:0/2902865915 shutdown_connections 2024-03-26T06:17:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.479+0000 7f0950a00640 1 -- 172.21.15.63:0/2902865915 wait complete. 2024-03-26T06:17:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.481+0000 7f0950a00640 1 Processor -- start 2024-03-26T06:17:30.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.481+0000 7f0950a00640 1 -- start start 2024-03-26T06:17:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.482+0000 7f0950a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0930004800 0x7f094c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.482+0000 7f0950a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094c13bee0 0x7f094c13d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.482+0000 7f0950a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c0a9ad0 0x7f094c0a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.482+0000 7f0950a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c15e880 con 0x7f094c0a9ad0 2024-03-26T06:17:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.482+0000 7f0950a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c15e5a0 con 0x7f094c13bee0 2024-03-26T06:17:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.482+0000 7f0950a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1440d0 con 0x7f0930004800 2024-03-26T06:17:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.482+0000 7f094be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c0a9ad0 0x7f094c0a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.482+0000 7f094be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c0a9ad0 0x7f094c0a9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50200/0 (socket says 172.21.15.63:50200) 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.482+0000 7f094be00640 1 -- 172.21.15.63:0/908046158 learned_addr learned my addr 172.21.15.63:0/908046158 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f094b400640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0930004800 0x7f094c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f094aa00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094c13bee0 0x7f094c13d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f094be00640 1 -- 172.21.15.63:0/908046158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0930004800 msgr2=0x7f094c150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f094be00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0930004800 0x7f094c150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f094be00640 1 -- 172.21.15.63:0/908046158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094c13bee0 msgr2=0x7f094c13d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f094be00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094c13bee0 0x7f094c13d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f094be00640 1 -- 172.21.15.63:0/908046158 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c13c450 con 0x7f094c0a9ad0 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f094aa00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094c13bee0 0x7f094c13d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f094be00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c0a9ad0 0x7f094c0a9f50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f094c15ac50 tx=0x7f094400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:30.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.483+0000 7f0943400640 1 -- 172.21.15.63:0/908046158 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944019070 con 0x7f094c0a9ad0 2024-03-26T06:17:30.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.484+0000 7f0943400640 1 -- 172.21.15.63:0/908046158 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944010510 con 0x7f094c0a9ad0 2024-03-26T06:17:30.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.484+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c13c730 con 0x7f094c0a9ad0 2024-03-26T06:17:30.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.484+0000 7f0943400640 1 -- 172.21.15.63:0/908046158 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440108e0 con 0x7f094c0a9ad0 2024-03-26T06:17:30.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.484+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c13ccf0 con 0x7f094c0a9ad0 2024-03-26T06:17:30.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.485+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c04f0c0 con 0x7f094c0a9ad0 2024-03-26T06:17:30.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.486+0000 7f0943400640 1 -- 172.21.15.63:0/908046158 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f094401c070 con 0x7f094c0a9ad0 2024-03-26T06:17:30.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.487+0000 7f0943400640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f092806bbd0 0x7f092806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.487+0000 7f0943400640 1 -- 172.21.15.63:0/908046158 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f094408a280 con 0x7f094c0a9ad0 2024-03-26T06:17:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.487+0000 7f094b400640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f092806bbd0 0x7f092806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.488+0000 7f094b400640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f092806bbd0 0x7f092806e090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f094c050950 tx=0x7f093c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:30.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.491+0000 7f0943400640 1 -- 172.21.15.63:0/908046158 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f0944058990 con 0x7f094c0a9ad0 2024-03-26T06:17:30.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.698+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f094c0a98b0 con 0x7f094c0a9ad0 2024-03-26T06:17:30.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.698+0000 7f0943400640 1 -- 172.21.15.63:0/908046158 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0944058290 con 0x7f094c0a9ad0 2024-03-26T06:17:30.699 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:17:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f092806bbd0 msgr2=0x7f092806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f092806bbd0 0x7f092806e090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f094c050950 tx=0x7f093c00b040 comp rx=0 tx=0).stop 2024-03-26T06:17:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c0a9ad0 msgr2=0x7f094c0a9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c0a9ad0 0x7f094c0a9f50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f094c15ac50 tx=0x7f094400e960 comp rx=0 tx=0).stop 2024-03-26T06:17:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 shutdown_connections 2024-03-26T06:17:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f092806bbd0 0x7f092806e090 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c0a9ad0 0x7f094c0a9f50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094c13bee0 0x7f094c13d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 --2- 172.21.15.63:0/908046158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0930004800 0x7f094c150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 >> 172.21.15.63:0/908046158 conn(0x7f094c0670b0 msgr2=0x7f094c06df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 shutdown_connections 2024-03-26T06:17:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.701+0000 7f0950a00640 1 -- 172.21.15.63:0/908046158 wait complete. 2024-03-26T06:17:30.720 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:17:30.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.949+0000 7f55a4e00640 1 Processor -- start 2024-03-26T06:17:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.950+0000 7f55a4e00640 1 -- start start 2024-03-26T06:17:30.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.951+0000 7f55a4e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a00d1e90 0x7f55a006c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.951+0000 7f55a4e00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f55a00cfe90 0x7f55a00cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.951+0000 7f55a4e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a006d1f0 con 0x7f55a015dc70 2024-03-26T06:17:30.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.951+0000 7f55a4e00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a00cc480 con 0x7f55a00cfe90 2024-03-26T06:17:30.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.951+0000 7f55a4e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00d0310 con 0x7f55a00d1e90 2024-03-26T06:17:30.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.951+0000 7f559de00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f55a015dc70 0x7f55a00d1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46832/0 (socket says 172.21.15.63:46832) 2024-03-26T06:17:30.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.951+0000 7f559de00640 1 -- 172.21.15.63:0/696587634 learned_addr learned my addr 172.21.15.63:0/696587634 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:30.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.951+0000 7f559d400640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a00d1e90 0x7f55a006c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559e800640 1 --2- 172.21.15.63:0/696587634 >> v2:172.21.15.204:3300/0 conn(0x7f55a00cfe90 0x7f55a00cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160575517 0 0) 0x7f55a006d1f0 con 0x7f55a015dc70 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5580003520 con 0x7f55a015dc70 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 663439490 0 0) 0x7f5580003520 con 0x7f55a015dc70 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a00d1e90 msgr2=0x7f55a006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a00d1e90 0x7f55a006c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 >> v2:172.21.15.204:3300/0 conn(0x7f55a00cfe90 msgr2=0x7f55a00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 --2- 172.21.15.63:0/696587634 >> v2:172.21.15.204:3300/0 conn(0x7f55a00cfe90 0x7f55a00cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a006c950 con 0x7f55a015dc70 2024-03-26T06:17:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f5590001670 con 0x7f55a015dc70 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 >> v1:172.21.15.63:6789/0 conn(0x7f55a015dc70 legacy=0x7f55a00d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f5580003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a00d1e90 0x7f5580004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5580004d40 0x7f55800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00cc480 con 0x7f55800039b0 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00d0310 con 0x7f5580004d40 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.952+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558000b9c0 con 0x7f55a00d1e90 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.953+0000 7f559de00640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f5580003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.953+0000 7f559d400640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a00d1e90 0x7f5580004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.953+0000 7f559e800640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5580004d40 0x7f55800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.953+0000 7f559de00640 1 -- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a00d1e90 msgr2=0x7f5580004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.953+0000 7f559de00640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a00d1e90 0x7f5580004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.953+0000 7f559de00640 1 -- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5580004d40 msgr2=0x7f55800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.953+0000 7f559de00640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5580004d40 0x7f55800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.953+0000 7f559de00640 1 -- 172.21.15.63:0/696587634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580003520 con 0x7f55800039b0 2024-03-26T06:17:30.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.953+0000 7f559d400640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a00d1e90 0x7f5580004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:30.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.954+0000 7f559de00640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f5580003dd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f559000c160 tx=0x7f5580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8932477266e702 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:30.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.954+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590007c80 con 0x7f55800039b0 2024-03-26T06:17:30.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.954+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590030070 con 0x7f55800039b0 2024-03-26T06:17:30.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.954+0000 7f559ca00640 1 -- 172.21.15.63:0/696587634 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590005d30 con 0x7f55800039b0 2024-03-26T06:17:30.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.955+0000 7f55a4e00640 1 -- 172.21.15.63:0/696587634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 msgr2=0x7f5580003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.955+0000 7f55a4e00640 1 --2- 172.21.15.63:0/696587634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f5580003dd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f559000c160 tx=0x7f5580005830 comp rx=0 tx=0).stop 2024-03-26T06:17:30.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.955+0000 7f559e800640 1 -- 172.21.15.63:0/696587634 reap_dead start 2024-03-26T06:17:30.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.955+0000 7f55a4e00640 1 -- 172.21.15.63:0/696587634 shutdown_connections 2024-03-26T06:17:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.955+0000 7f55a4e00640 1 -- 172.21.15.63:0/696587634 >> 172.21.15.63:0/696587634 conn(0x7f55a0071000 msgr2=0x7f55a00713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.955+0000 7f55a4e00640 1 -- 172.21.15.63:0/696587634 shutdown_connections 2024-03-26T06:17:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.955+0000 7f55a4e00640 1 -- 172.21.15.63:0/696587634 wait complete. 2024-03-26T06:17:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.957+0000 7f55a4e00640 1 Processor -- start 2024-03-26T06:17:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.957+0000 7f55a4e00640 1 -- start start 2024-03-26T06:17:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.958+0000 7f55a4e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f55a00ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.958+0000 7f55a4e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55a00c8010 0x7f55a00c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.958+0000 7f55a4e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a0151ab0 0x7f55a00ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.958+0000 7f55a4e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a015e050 con 0x7f55800039b0 2024-03-26T06:17:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.958+0000 7f55a4e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a006cf10 con 0x7f55a00c8010 2024-03-26T06:17:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.958+0000 7f55a4e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a006c270 con 0x7f55a0151ab0 2024-03-26T06:17:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.958+0000 7f559de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f55a00ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.958+0000 7f559de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f55a00ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59542/0 (socket says 172.21.15.63:59542) 2024-03-26T06:17:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.958+0000 7f559de00640 1 -- 172.21.15.63:0/2248783410 learned_addr learned my addr 172.21.15.63:0/2248783410 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.959+0000 7f559d400640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55a00c8010 0x7f55a00c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.959+0000 7f559e800640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a0151ab0 0x7f55a00ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.959+0000 7f559de00640 1 -- 172.21.15.63:0/2248783410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a0151ab0 msgr2=0x7f55a00ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.959+0000 7f559de00640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a0151ab0 0x7f55a00ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.959+0000 7f559de00640 1 -- 172.21.15.63:0/2248783410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55a00c8010 msgr2=0x7f55a00c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.959+0000 7f559de00640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55a00c8010 0x7f55a00c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.959+0000 7f559de00640 1 -- 172.21.15.63:0/2248783410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a00c61f0 con 0x7f55800039b0 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.959+0000 7f559d400640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55a00c8010 0x7f55a00c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.959+0000 7f559de00640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f55a00ac9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f559002c4c0 tx=0x7f55a006da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.960+0000 7f5596000640 1 -- 172.21.15.63:0/2248783410 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590004bf0 con 0x7f55800039b0 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.960+0000 7f5596000640 1 -- 172.21.15.63:0/2248783410 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590004d90 con 0x7f55800039b0 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.960+0000 7f5596000640 1 -- 172.21.15.63:0/2248783410 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590007270 con 0x7f55800039b0 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.960+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a00c64d0 con 0x7f55800039b0 2024-03-26T06:17:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.960+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a00c6a90 con 0x7f55800039b0 2024-03-26T06:17:30.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.961+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a0071f00 con 0x7f55800039b0 2024-03-26T06:17:30.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.962+0000 7f5596000640 1 -- 172.21.15.63:0/2248783410 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5590048020 con 0x7f55800039b0 2024-03-26T06:17:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.963+0000 7f5596000640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f557c06bc00 0x7f557c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.963+0000 7f5596000640 1 -- 172.21.15.63:0/2248783410 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f55900ac170 con 0x7f55800039b0 2024-03-26T06:17:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.963+0000 7f559d400640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f557c06bc00 0x7f557c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.964+0000 7f559d400640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f557c06bc00 0x7f557c06e0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f55a00cb910 tx=0x7f558800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:30.967+0000 7f5596000640 1 -- 172.21.15.63:0/2248783410 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f559007a920 con 0x7f55800039b0 2024-03-26T06:17:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.169+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f55a00c6e70 con 0x7f55800039b0 2024-03-26T06:17:31.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.170+0000 7f5596000640 1 -- 172.21.15.63:0/2248783410 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f559007a220 con 0x7f55800039b0 2024-03-26T06:17:31.170 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.172+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f557c06bc00 msgr2=0x7f557c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.172+0000 7f55a4e00640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f557c06bc00 0x7f557c06e0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f55a00cb910 tx=0x7f558800b040 comp rx=0 tx=0).stop 2024-03-26T06:17:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.172+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 msgr2=0x7f55a00ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.172+0000 7f55a4e00640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f55a00ac9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f559002c4c0 tx=0x7f55a006da90 comp rx=0 tx=0).stop 2024-03-26T06:17:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.172+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 shutdown_connections 2024-03-26T06:17:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.172+0000 7f55a4e00640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f557c06bc00 0x7f557c06e0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.172+0000 7f55a4e00640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55a0151ab0 0x7f55a00ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.173+0000 7f55a4e00640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55a00c8010 0x7f55a00c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.173+0000 7f55a4e00640 1 --2- 172.21.15.63:0/2248783410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55800039b0 0x7f55a00ac9f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.173+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 >> 172.21.15.63:0/2248783410 conn(0x7f55a0071000 msgr2=0x7f55a00cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.173+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 shutdown_connections 2024-03-26T06:17:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.173+0000 7f55a4e00640 1 -- 172.21.15.63:0/2248783410 wait complete. 2024-03-26T06:17:31.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:17:31.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.415+0000 7f2c47800640 1 Processor -- start 2024-03-26T06:17:31.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.415+0000 7f2c47800640 1 -- start start 2024-03-26T06:17:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.417+0000 7f2c47800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2c4006cca0 0x7f2c400cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.417+0000 7f2c47800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4006d0d0 con 0x7f2c400cfd10 2024-03-26T06:17:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.417+0000 7f2c47800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c400ce630 con 0x7f2c4015dd80 2024-03-26T06:17:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.417+0000 7f2c47800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c400ce400 con 0x7f2c4006cca0 2024-03-26T06:17:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.417+0000 7f2c45800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2c4006cca0 0x7f2c400cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.417+0000 7f2c3fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2c400cfd10 0x7f2c400cc750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46844/0 (socket says 172.21.15.63:46844) 2024-03-26T06:17:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.417+0000 7f2c3fe00640 1 -- 172.21.15.63:0/1787413970 learned_addr learned my addr 172.21.15.63:0/1787413970 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:31.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.418+0000 7f2c45800640 1 -- 172.21.15.63:0/1787413970 >> v1:172.21.15.204:6789/0 conn(0x7f2c4015dd80 legacy=0x7f2c400cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.418+0000 7f2c45800640 1 -- 172.21.15.63:0/1787413970 >> v1:172.21.15.63:6789/0 conn(0x7f2c400cfd10 legacy=0x7f2c400cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.418+0000 7f2c45800640 1 -- 172.21.15.63:0/1787413970 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c400ce910 con 0x7f2c4006cca0 2024-03-26T06:17:31.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.419+0000 7f2c45800640 1 --2- 172.21.15.63:0/1787413970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 0x7f2c400cdec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009d90 tx=0x7f2c3802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8c4981562bd700 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:31.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.419+0000 7f2c3f400640 1 -- 172.21.15.63:0/1787413970 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38039070 con 0x7f2c4006cca0 2024-03-26T06:17:31.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.419+0000 7f2c3f400640 1 -- 172.21.15.63:0/1787413970 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3802cc60 con 0x7f2c4006cca0 2024-03-26T06:17:31.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.419+0000 7f2c3f400640 1 -- 172.21.15.63:0/1787413970 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38034660 con 0x7f2c4006cca0 2024-03-26T06:17:31.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.420+0000 7f2c47800640 1 -- 172.21.15.63:0/1787413970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 msgr2=0x7f2c400cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.420+0000 7f2c47800640 1 --2- 172.21.15.63:0/1787413970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 0x7f2c400cdec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009d90 tx=0x7f2c3802beb0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.420+0000 7f2c47800640 1 -- 172.21.15.63:0/1787413970 shutdown_connections 2024-03-26T06:17:31.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.420+0000 7f2c47800640 1 --2- 172.21.15.63:0/1787413970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 0x7f2c400cdec0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.420+0000 7f2c47800640 1 -- 172.21.15.63:0/1787413970 >> 172.21.15.63:0/1787413970 conn(0x7f2c400b3410 msgr2=0x7f2c400b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:31.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.420+0000 7f2c47800640 1 -- 172.21.15.63:0/1787413970 shutdown_connections 2024-03-26T06:17:31.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.420+0000 7f2c47800640 1 -- 172.21.15.63:0/1787413970 wait complete. 2024-03-26T06:17:31.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.422+0000 7f2c47800640 1 Processor -- start 2024-03-26T06:17:31.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.422+0000 7f2c47800640 1 -- start start 2024-03-26T06:17:31.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c47800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 0x7f2c40152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c47800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2c400cfd10 0x7f2c400ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c47800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2c4015dd80 0x7f2c401e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c47800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4015e160 con 0x7f2c4006cca0 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c47800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400cc230 con 0x7f2c400cfd10 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c47800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400cbe70 con 0x7f2c4015dd80 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c44e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 0x7f2c40152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c44e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 0x7f2c40152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59552/0 (socket says 172.21.15.63:59552) 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c44e00640 1 -- 172.21.15.63:0/2928466813 learned_addr learned my addr 172.21.15.63:0/2928466813 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c45800640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2c4015dd80 0x7f2c401e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c3fe00640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2c400cfd10 0x7f2c400ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c44e00640 1 -- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2c4015dd80 msgr2=0x7f2c401e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c44e00640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2c4015dd80 0x7f2c401e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c44e00640 1 -- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2c400cfd10 msgr2=0x7f2c400ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c44e00640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2c400cfd10 0x7f2c400ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c44e00640 1 -- 172.21.15.63:0/2928466813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c400ad2d0 con 0x7f2c4006cca0 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c45800640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2c4015dd80 0x7f2c401e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.423+0000 7f2c3fe00640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2c400cfd10 0x7f2c400ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.424+0000 7f2c44e00640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 0x7f2c40152ba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000c450 tx=0x7f2c3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.424+0000 7f2c3cc00640 1 -- 172.21.15.63:0/2928466813 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300052d0 con 0x7f2c4006cca0 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.424+0000 7f2c3cc00640 1 -- 172.21.15.63:0/2928466813 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c30005470 con 0x7f2c4006cca0 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.424+0000 7f2c3cc00640 1 -- 172.21.15.63:0/2928466813 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30012870 con 0x7f2c4006cca0 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.424+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c400ad5b0 con 0x7f2c4006cca0 2024-03-26T06:17:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.424+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c400adb70 con 0x7f2c4006cca0 2024-03-26T06:17:31.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.425+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4006df30 con 0x7f2c4006cca0 2024-03-26T06:17:31.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.426+0000 7f2c3cc00640 1 -- 172.21.15.63:0/2928466813 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2c30012a10 con 0x7f2c4006cca0 2024-03-26T06:17:31.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.427+0000 7f2c3cc00640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c2006bbd0 0x7f2c2006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.427+0000 7f2c3cc00640 1 -- 172.21.15.63:0/2928466813 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2c3008a950 con 0x7f2c4006cca0 2024-03-26T06:17:31.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.427+0000 7f2c3fe00640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c2006bbd0 0x7f2c2006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.428+0000 7f2c3fe00640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c2006bbd0 0x7f2c2006e090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2c401e36a0 tx=0x7f2c2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:31.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.431+0000 7f2c3cc00640 1 -- 172.21.15.63:0/2928466813 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2c30059190 con 0x7f2c4006cca0 2024-03-26T06:17:31.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.674+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c400c5860 con 0x7f2c4006cca0 2024-03-26T06:17:31.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.675+0000 7f2c3cc00640 1 -- 172.21.15.63:0/2928466813 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4937 (secure 0 0 0) 0x7f2c30058a90 con 0x7f2c4006cca0 2024-03-26T06:17:31.675 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:31.675 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:20.131439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-26T06:17:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-03-26T06:17:31.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c2006bbd0 msgr2=0x7f2c2006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c2006bbd0 0x7f2c2006e090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2c401e36a0 tx=0x7f2c2c009040 comp rx=0 tx=0).stop 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 msgr2=0x7f2c40152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 0x7f2c40152ba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000c450 tx=0x7f2c3000c910 comp rx=0 tx=0).stop 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 shutdown_connections 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2c2006bbd0 0x7f2c2006e090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2c4015dd80 0x7f2c401e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2c400cfd10 0x7f2c400ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 --2- 172.21.15.63:0/2928466813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c4006cca0 0x7f2c40152ba0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 >> 172.21.15.63:0/2928466813 conn(0x7f2c400b3410 msgr2=0x7f2c400b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 shutdown_connections 2024-03-26T06:17:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.678+0000 7f2c47800640 1 -- 172.21.15.63:0/2928466813 wait complete. 2024-03-26T06:17:31.700 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:31.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.921+0000 7f49a2200640 1 Processor -- start 2024-03-26T06:17:31.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.921+0000 7f49a2200640 1 -- start start 2024-03-26T06:17:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.923+0000 7f49a2200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c145100 0x7f499c06ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.923+0000 7f49a2200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f499c071a60 0x7f499c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.923+0000 7f49a2200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c15bf80 con 0x7f499c06ef70 2024-03-26T06:17:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.923+0000 7f49a2200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c0a86e0 con 0x7f499c071a60 2024-03-26T06:17:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.923+0000 7f49a2200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c06e2f0 con 0x7f499c145100 2024-03-26T06:17:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.924+0000 7f499aa00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f499c06ef70 0x7f499c071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:49066/0 (socket says 172.21.15.63:49066) 2024-03-26T06:17:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.924+0000 7f499b400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c145100 0x7f499c06ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.924+0000 7f499aa00640 1 -- 172.21.15.63:0/2302343170 learned_addr learned my addr 172.21.15.63:0/2302343170 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.924+0000 7f499be00640 1 --2- 172.21.15.63:0/2302343170 >> v2:172.21.15.204:3300/0 conn(0x7f499c071a60 0x7f499c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.925+0000 7f499a000640 1 -- 172.21.15.63:0/2302343170 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590792300 0 0) 0x7f499c15bf80 con 0x7f499c06ef70 2024-03-26T06:17:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.925+0000 7f499a000640 1 -- 172.21.15.63:0/2302343170 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4980003520 con 0x7f499c06ef70 2024-03-26T06:17:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.925+0000 7f499b400640 1 -- 172.21.15.63:0/2302343170 >> v2:172.21.15.204:3300/0 conn(0x7f499c071a60 msgr2=0x7f499c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.925+0000 7f499b400640 1 --2- 172.21.15.63:0/2302343170 >> v2:172.21.15.204:3300/0 conn(0x7f499c071a60 0x7f499c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.925+0000 7f499b400640 1 -- 172.21.15.63:0/2302343170 >> v1:172.21.15.204:6789/0 conn(0x7f499c06ef70 legacy=0x7f499c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.925+0000 7f499b400640 1 -- 172.21.15.63:0/2302343170 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c06d770 con 0x7f499c145100 2024-03-26T06:17:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.925+0000 7f499be00640 1 --2- 172.21.15.63:0/2302343170 >> v2:172.21.15.204:3300/0 conn(0x7f499c071a60 0x7f499c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:17:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.926+0000 7f499b400640 1 --2- 172.21.15.63:0/2302343170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c145100 0x7f499c06ea30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f499c06e4d0 tx=0x7f498c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ea3bab163dd8f5c server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.927+0000 7f499a000640 1 -- 172.21.15.63:0/2302343170 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c035020 con 0x7f499c145100 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.927+0000 7f499a000640 1 -- 172.21.15.63:0/2302343170 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c031800 con 0x7f499c145100 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.927+0000 7f499a000640 1 -- 172.21.15.63:0/2302343170 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c031bb0 con 0x7f499c145100 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.927+0000 7f49a2200640 1 -- 172.21.15.63:0/2302343170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c145100 msgr2=0x7f499c06ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.927+0000 7f49a2200640 1 --2- 172.21.15.63:0/2302343170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c145100 0x7f499c06ea30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f499c06e4d0 tx=0x7f498c02b8a0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.927+0000 7f49a2200640 1 -- 172.21.15.63:0/2302343170 shutdown_connections 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.927+0000 7f49a2200640 1 --2- 172.21.15.63:0/2302343170 >> v2:172.21.15.204:3300/0 conn(0x7f499c071a60 0x7f499c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.927+0000 7f49a2200640 1 --2- 172.21.15.63:0/2302343170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c145100 0x7f499c06ea30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.927+0000 7f49a2200640 1 -- 172.21.15.63:0/2302343170 >> 172.21.15.63:0/2302343170 conn(0x7f499c06ac90 msgr2=0x7f499c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.928+0000 7f49a2200640 1 -- 172.21.15.63:0/2302343170 shutdown_connections 2024-03-26T06:17:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.928+0000 7f49a2200640 1 -- 172.21.15.63:0/2302343170 wait complete. 2024-03-26T06:17:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.929+0000 7f49a2200640 1 Processor -- start 2024-03-26T06:17:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.930+0000 7f49a2200640 1 -- start start 2024-03-26T06:17:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.930+0000 7f49a2200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f499c06ef70 0x7f499c13b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.930+0000 7f49a2200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c071a60 0x7f499c140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f49a2200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499c145100 0x7f499c140540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f49a2200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c06e010 con 0x7f499c06ef70 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f49a2200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c06dd30 con 0x7f499c145100 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f49a2200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c1454e0 con 0x7f499c071a60 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f499c06ef70 0x7f499c13b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f499c06ef70 0x7f499c13b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59566/0 (socket says 172.21.15.63:59566) 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499b400640 1 -- 172.21.15.63:0/3231035599 learned_addr learned my addr 172.21.15.63:0/3231035599 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499aa00640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c071a60 0x7f499c140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499be00640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499c145100 0x7f499c140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499b400640 1 -- 172.21.15.63:0/3231035599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c071a60 msgr2=0x7f499c140000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499b400640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c071a60 0x7f499c140000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499b400640 1 -- 172.21.15.63:0/3231035599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499c145100 msgr2=0x7f499c140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499b400640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499c145100 0x7f499c140540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.931+0000 7f499b400640 1 -- 172.21.15.63:0/3231035599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c15cab0 con 0x7f499c06ef70 2024-03-26T06:17:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.932+0000 7f499b400640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f499c06ef70 0x7f499c13b110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f498c009890 tx=0x7f498c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.932+0000 7f4993400640 1 -- 172.21.15.63:0/3231035599 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c035040 con 0x7f499c06ef70 2024-03-26T06:17:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.932+0000 7f4993400640 1 -- 172.21.15.63:0/3231035599 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c03ad00 con 0x7f499c06ef70 2024-03-26T06:17:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.932+0000 7f4993400640 1 -- 172.21.15.63:0/3231035599 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0466c0 con 0x7f499c06ef70 2024-03-26T06:17:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.932+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c15cd90 con 0x7f499c06ef70 2024-03-26T06:17:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.932+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c15d350 con 0x7f499c06ef70 2024-03-26T06:17:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.934+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c074730 con 0x7f499c06ef70 2024-03-26T06:17:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.934+0000 7f4993400640 1 -- 172.21.15.63:0/3231035599 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f498c038020 con 0x7f499c06ef70 2024-03-26T06:17:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.935+0000 7f4993400640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f497c06bc00 0x7f497c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.935+0000 7f4993400640 1 -- 172.21.15.63:0/3231035599 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f498c0acf00 con 0x7f499c06ef70 2024-03-26T06:17:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.936+0000 7f499aa00640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f497c06bc00 0x7f497c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.936+0000 7f499aa00640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f497c06bc00 0x7f497c06e0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f499c1443a0 tx=0x7f4988009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:31.940+0000 7f4993400640 1 -- 172.21.15.63:0/3231035599 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f498c07b610 con 0x7f499c06ef70 2024-03-26T06:17:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.144+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f499c15a760 con 0x7f499c06ef70 2024-03-26T06:17:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.146+0000 7f4993400640 1 -- 172.21.15.63:0/3231035599 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f498c07af10 con 0x7f499c06ef70 2024-03-26T06:17:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:32.147 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:32.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f497c06bc00 msgr2=0x7f497c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f497c06bc00 0x7f497c06e0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f499c1443a0 tx=0x7f4988009040 comp rx=0 tx=0).stop 2024-03-26T06:17:32.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f499c06ef70 msgr2=0x7f499c13b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f499c06ef70 0x7f499c13b110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f498c009890 tx=0x7f498c0046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 shutdown_connections 2024-03-26T06:17:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f497c06bc00 0x7f497c06e0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499c145100 0x7f499c140540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499c071a60 0x7f499c140000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 --2- 172.21.15.63:0/3231035599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f499c06ef70 0x7f499c13b110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 >> 172.21.15.63:0/3231035599 conn(0x7f499c06ac90 msgr2=0x7f499c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 shutdown_connections 2024-03-26T06:17:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.149+0000 7f49a2200640 1 -- 172.21.15.63:0/3231035599 wait complete. 2024-03-26T06:17:32.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:17:32.167 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:17:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.396+0000 7f566ec00640 1 Processor -- start 2024-03-26T06:17:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.396+0000 7f566ec00640 1 -- start start 2024-03-26T06:17:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.398+0000 7f566ec00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5668071850 0x7f566806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.398+0000 7f566ec00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566815eb80 con 0x7f566815dec0 2024-03-26T06:17:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.398+0000 7f566ec00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566806d2a0 con 0x7f5668143eb0 2024-03-26T06:17:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.398+0000 7f566ec00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5668144290 con 0x7f5668071850 2024-03-26T06:17:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.398+0000 7f566e200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f566815dec0 0x7f566815e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46858/0 (socket says 172.21.15.63:46858) 2024-03-26T06:17:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.398+0000 7f566e200640 1 -- 172.21.15.63:0/2679813565 learned_addr learned my addr 172.21.15.63:0/2679813565 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f566ce00640 1 --2- 172.21.15.63:0/2679813565 >> v2:172.21.15.204:3300/0 conn(0x7f5668071850 0x7f566806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872453398 0 0) 0x7f566815eb80 con 0x7f566815dec0 2024-03-26T06:17:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5650003520 con 0x7f566815dec0 2024-03-26T06:17:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249739574 0 0) 0x7f5650003520 con 0x7f566815dec0 2024-03-26T06:17:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 >> v2:172.21.15.204:3300/0 conn(0x7f5668071850 msgr2=0x7f566806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 --2- 172.21.15.63:0/2679813565 >> v2:172.21.15.204:3300/0 conn(0x7f5668071850 0x7f566806dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 >> v1:172.21.15.204:6789/0 conn(0x7f5668143eb0 legacy=0x7f5668071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566806d580 con 0x7f566815dec0 2024-03-26T06:17:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f56600019f0 con 0x7f566815dec0 2024-03-26T06:17:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 >> v1:172.21.15.63:6789/0 conn(0x7f566815dec0 legacy=0x7f566815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56500039b0 0x7f5650003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5650004800 0x7f5650004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56500051c0 0x7f565000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5668144290 con 0x7f56500039b0 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565000c160 con 0x7f5650004800 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.399+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565000c360 con 0x7f56500051c0 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566d800640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56500039b0 0x7f5650003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566e200640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56500051c0 0x7f565000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566ce00640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5650004800 0x7f5650004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566d800640 1 -- 172.21.15.63:0/2679813565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56500051c0 msgr2=0x7f565000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566d800640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56500051c0 0x7f565000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566d800640 1 -- 172.21.15.63:0/2679813565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5650004800 msgr2=0x7f5650004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566d800640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5650004800 0x7f5650004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566d800640 1 -- 172.21.15.63:0/2679813565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650003520 con 0x7f56500039b0 2024-03-26T06:17:32.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566ce00640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5650004800 0x7f5650004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:32.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.400+0000 7f566e200640 1 -- 172.21.15.63:0/2679813565 reap_dead start 2024-03-26T06:17:32.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.401+0000 7f566d800640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56500039b0 0x7f5650003dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f565c001750 tx=0x7f5650005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ea13713d9d1bda server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:32.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.401+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c001370 con 0x7f56500039b0 2024-03-26T06:17:32.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.402+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c0052d0 con 0x7f56500039b0 2024-03-26T06:17:32.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.402+0000 7f5667e00640 1 -- 172.21.15.63:0/2679813565 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c003830 con 0x7f56500039b0 2024-03-26T06:17:32.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.402+0000 7f566ec00640 1 -- 172.21.15.63:0/2679813565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56500039b0 msgr2=0x7f5650003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.402+0000 7f566ec00640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56500039b0 0x7f5650003dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f565c001750 tx=0x7f5650005830 comp rx=0 tx=0).stop 2024-03-26T06:17:32.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.402+0000 7f566ec00640 1 -- 172.21.15.63:0/2679813565 shutdown_connections 2024-03-26T06:17:32.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.402+0000 7f566ec00640 1 --2- 172.21.15.63:0/2679813565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56500039b0 0x7f5650003dd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.402+0000 7f566ec00640 1 -- 172.21.15.63:0/2679813565 >> 172.21.15.63:0/2679813565 conn(0x7f56680670b0 msgr2=0x7f56680b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:32.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.402+0000 7f566ec00640 1 -- 172.21.15.63:0/2679813565 shutdown_connections 2024-03-26T06:17:32.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.402+0000 7f566ec00640 1 -- 172.21.15.63:0/2679813565 wait complete. 2024-03-26T06:17:32.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.404+0000 7f566ec00640 1 Processor -- start 2024-03-26T06:17:32.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.404+0000 7f566ec00640 1 -- start start 2024-03-26T06:17:32.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.405+0000 7f566ec00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56500039b0 0x7f566813bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.405+0000 7f566ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56680b2510 0x7f56680b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.405+0000 7f566ec00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f566813c7e0 0x7f566813cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.405+0000 7f566ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566806dd80 con 0x7f56680b2510 2024-03-26T06:17:32.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.405+0000 7f566ec00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566815ee60 con 0x7f56500039b0 2024-03-26T06:17:32.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.405+0000 7f566ec00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566806df00 con 0x7f566813c7e0 2024-03-26T06:17:32.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.405+0000 7f566ce00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56680b2510 0x7f56680b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.405+0000 7f566ce00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56680b2510 0x7f56680b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59574/0 (socket says 172.21.15.63:59574) 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.405+0000 7f566ce00640 1 -- 172.21.15.63:0/778433954 learned_addr learned my addr 172.21.15.63:0/778433954 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f566e200640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f566813c7e0 0x7f566813cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f566d800640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56500039b0 0x7f566813bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f566ce00640 1 -- 172.21.15.63:0/778433954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f566813c7e0 msgr2=0x7f566813cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f566ce00640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f566813c7e0 0x7f566813cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f566ce00640 1 -- 172.21.15.63:0/778433954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56500039b0 msgr2=0x7f566813bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f566ce00640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56500039b0 0x7f566813bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f566ce00640 1 -- 172.21.15.63:0/778433954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566813c1c0 con 0x7f56680b2510 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f566e200640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f566813c7e0 0x7f566813cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f566ce00640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56680b2510 0x7f56680b2990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5654010740 tx=0x7f5654010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f5665600640 1 -- 172.21.15.63:0/778433954 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400f040 con 0x7f56680b2510 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.406+0000 7f5665600640 1 -- 172.21.15.63:0/778433954 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565400eb80 con 0x7f56680b2510 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.407+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566813d550 con 0x7f56680b2510 2024-03-26T06:17:32.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.407+0000 7f5665600640 1 -- 172.21.15.63:0/778433954 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654010e50 con 0x7f56680b2510 2024-03-26T06:17:32.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.407+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566813db10 con 0x7f56680b2510 2024-03-26T06:17:32.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.408+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566804f0c0 con 0x7f56680b2510 2024-03-26T06:17:32.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.409+0000 7f5665600640 1 -- 172.21.15.63:0/778433954 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f56540253f0 con 0x7f56680b2510 2024-03-26T06:17:32.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.410+0000 7f5665600640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f564806bbd0 0x7f564806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.410+0000 7f5665600640 1 -- 172.21.15.63:0/778433954 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f565408b2a0 con 0x7f56680b2510 2024-03-26T06:17:32.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.410+0000 7f566d800640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f564806bbd0 0x7f564806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.411+0000 7f566d800640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f564806bbd0 0x7f564806e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f565c033000 tx=0x7f565c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:32.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.414+0000 7f5665600640 1 -- 172.21.15.63:0/778433954 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f566813c1c0 con 0x7f56680b2510 2024-03-26T06:17:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.616+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f566806e6b0 con 0x7f56680b2510 2024-03-26T06:17:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.617+0000 7f5665600640 1 -- 172.21.15.63:0/778433954 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5654018030 con 0x7f56680b2510 2024-03-26T06:17:32.617 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f564806bbd0 msgr2=0x7f564806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f564806bbd0 0x7f564806e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f565c033000 tx=0x7f565c009030 comp rx=0 tx=0).stop 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56680b2510 msgr2=0x7f56680b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56680b2510 0x7f56680b2990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5654010740 tx=0x7f5654010c00 comp rx=0 tx=0).stop 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 shutdown_connections 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f564806bbd0 0x7f564806e090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f566813c7e0 0x7f566813cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56680b2510 0x7f56680b2990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 --2- 172.21.15.63:0/778433954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56500039b0 0x7f566813bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 >> 172.21.15.63:0/778433954 conn(0x7f56680670b0 msgr2=0x7f56680ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 shutdown_connections 2024-03-26T06:17:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.620+0000 7f566ec00640 1 -- 172.21.15.63:0/778433954 wait complete. 2024-03-26T06:17:32.639 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:17:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.868+0000 7f88a7000640 1 Processor -- start 2024-03-26T06:17:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.869+0000 7f88a7000640 1 -- start start 2024-03-26T06:17:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.870+0000 7f88a7000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a00cfd60 0x7f88a00b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.870+0000 7f88a7000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f88a0144c70 0x7f88a00712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.870+0000 7f88a7000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f88a01450d0 0x7f88a0071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.870+0000 7f88a7000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a00d0140 con 0x7f88a01450d0 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.870+0000 7f88a7000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a00b4b10 con 0x7f88a0144c70 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.870+0000 7f88a7000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00b3530 con 0x7f88a00cfd60 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f88a5000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f88a01450d0 0x7f88a0071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f88a5000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f88a01450d0 0x7f88a0071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59590/0 (socket says 172.21.15.63:59590) 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f88a5000640 1 -- 172.21.15.63:0/3090380024 learned_addr learned my addr 172.21.15.63:0/3090380024 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f889fe00640 1 --2- 172.21.15.63:0/3090380024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a00cfd60 0x7f88a00b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f889f400640 1 --2- 172.21.15.63:0/3090380024 >> v2:172.21.15.204:3300/0 conn(0x7f88a0144c70 0x7f88a00712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f88a5000640 1 -- 172.21.15.63:0/3090380024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a00cfd60 msgr2=0x7f88a00b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f88a5000640 1 --2- 172.21.15.63:0/3090380024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a00cfd60 0x7f88a00b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f88a5000640 1 -- 172.21.15.63:0/3090380024 >> v2:172.21.15.204:3300/0 conn(0x7f88a0144c70 msgr2=0x7f88a00712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f88a5000640 1 --2- 172.21.15.63:0/3090380024 >> v2:172.21.15.204:3300/0 conn(0x7f88a0144c70 0x7f88a00712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.871+0000 7f88a5000640 1 -- 172.21.15.63:0/3090380024 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00b3810 con 0x7f88a01450d0 2024-03-26T06:17:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.873+0000 7f88a5000640 1 --2- 172.21.15.63:0/3090380024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 0x7f88a0071830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f88a006bb30 tx=0x7f889802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb4d106533d2baa server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.873+0000 7f889ea00640 1 -- 172.21.15.63:0/3090380024 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898035020 con 0x7f88a01450d0 2024-03-26T06:17:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.873+0000 7f889ea00640 1 -- 172.21.15.63:0/3090380024 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8898031870 con 0x7f88a01450d0 2024-03-26T06:17:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.873+0000 7f889ea00640 1 -- 172.21.15.63:0/3090380024 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898031c40 con 0x7f88a01450d0 2024-03-26T06:17:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.873+0000 7f88a7000640 1 -- 172.21.15.63:0/3090380024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 msgr2=0x7f88a0071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.873+0000 7f88a7000640 1 --2- 172.21.15.63:0/3090380024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 0x7f88a0071830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f88a006bb30 tx=0x7f889802b910 comp rx=0 tx=0).stop 2024-03-26T06:17:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.874+0000 7f88a7000640 1 -- 172.21.15.63:0/3090380024 shutdown_connections 2024-03-26T06:17:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.874+0000 7f88a7000640 1 --2- 172.21.15.63:0/3090380024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 0x7f88a0071830 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.874+0000 7f88a7000640 1 --2- 172.21.15.63:0/3090380024 >> v2:172.21.15.204:3300/0 conn(0x7f88a0144c70 0x7f88a00712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.874+0000 7f88a7000640 1 --2- 172.21.15.63:0/3090380024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a00cfd60 0x7f88a00b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.874+0000 7f88a7000640 1 -- 172.21.15.63:0/3090380024 >> 172.21.15.63:0/3090380024 conn(0x7f88a006ac90 msgr2=0x7f88a006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.874+0000 7f88a7000640 1 -- 172.21.15.63:0/3090380024 shutdown_connections 2024-03-26T06:17:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.874+0000 7f88a7000640 1 -- 172.21.15.63:0/3090380024 wait complete. 2024-03-26T06:17:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.875+0000 7f88a7000640 1 Processor -- start 2024-03-26T06:17:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.875+0000 7f88a7000640 1 -- start start 2024-03-26T06:17:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.876+0000 7f88a7000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88a00cfd60 0x7f88a015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.876+0000 7f88a7000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a0144c70 0x7f88a00c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.876+0000 7f88a7000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 0x7f88a00ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.876+0000 7f88a7000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00b40b0 con 0x7f88a01450d0 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.876+0000 7f88a7000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00b3dd0 con 0x7f88a00cfd60 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.876+0000 7f88a7000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00b31c0 con 0x7f88a0144c70 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f88a5000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 0x7f88a00ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f88a5000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 0x7f88a00ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59602/0 (socket says 172.21.15.63:59602) 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f88a5000640 1 -- 172.21.15.63:0/3018362752 learned_addr learned my addr 172.21.15.63:0/3018362752 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f889fe00640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88a00cfd60 0x7f88a015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f889f400640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a0144c70 0x7f88a00c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f88a5000640 1 -- 172.21.15.63:0/3018362752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a0144c70 msgr2=0x7f88a00c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f88a5000640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a0144c70 0x7f88a00c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f88a5000640 1 -- 172.21.15.63:0/3018362752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88a00cfd60 msgr2=0x7f88a015b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f88a5000640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88a00cfd60 0x7f88a015b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.877+0000 7f88a5000640 1 -- 172.21.15.63:0/3018362752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a006e2c0 con 0x7f88a01450d0 2024-03-26T06:17:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.878+0000 7f88a5000640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 0x7f88a00ada60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88980090b0 tx=0x7f88980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.878+0000 7f8897e00640 1 -- 172.21.15.63:0/3018362752 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898040070 con 0x7f88a01450d0 2024-03-26T06:17:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.878+0000 7f8897e00640 1 -- 172.21.15.63:0/3018362752 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8898030c50 con 0x7f88a01450d0 2024-03-26T06:17:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.878+0000 7f8897e00640 1 -- 172.21.15.63:0/3018362752 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898035040 con 0x7f88a01450d0 2024-03-26T06:17:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.878+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a006e5a0 con 0x7f88a01450d0 2024-03-26T06:17:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.878+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a00c4860 con 0x7f88a01450d0 2024-03-26T06:17:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.879+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a0074730 con 0x7f88a01450d0 2024-03-26T06:17:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.880+0000 7f8897e00640 1 -- 172.21.15.63:0/3018362752 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8898038020 con 0x7f88a01450d0 2024-03-26T06:17:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.881+0000 7f8897e00640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f888006bbd0 0x7f888006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.881+0000 7f8897e00640 1 -- 172.21.15.63:0/3018362752 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f88980acaa0 con 0x7f88a01450d0 2024-03-26T06:17:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.881+0000 7f889fe00640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f888006bbd0 0x7f888006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.882+0000 7f889fe00640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f888006bbd0 0x7f888006e090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8890006fd0 tx=0x7f8890008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:32.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:32.886+0000 7f8897e00640 1 -- 172.21.15.63:0/3018362752 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f889807b2e0 con 0x7f88a01450d0 2024-03-26T06:17:33.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.086+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88a015e630 con 0x7f88a01450d0 2024-03-26T06:17:33.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.087+0000 7f8897e00640 1 -- 172.21.15.63:0/3018362752 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f889807abe0 con 0x7f88a01450d0 2024-03-26T06:17:33.087 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f888006bbd0 msgr2=0x7f888006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f888006bbd0 0x7f888006e090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8890006fd0 tx=0x7f8890008040 comp rx=0 tx=0).stop 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 msgr2=0x7f88a00ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 0x7f88a00ada60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88980090b0 tx=0x7f88980046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 shutdown_connections 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f888006bbd0 0x7f888006e090 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a01450d0 0x7f88a00ada60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88a0144c70 0x7f88a00c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 --2- 172.21.15.63:0/3018362752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88a00cfd60 0x7f88a015b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.090+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 >> 172.21.15.63:0/3018362752 conn(0x7f88a006ac90 msgr2=0x7f88a015dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.091+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 shutdown_connections 2024-03-26T06:17:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.091+0000 7f88a7000640 1 -- 172.21.15.63:0/3018362752 wait complete. 2024-03-26T06:17:33.110 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:17:33.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.338+0000 7f8f6b200640 1 Processor -- start 2024-03-26T06:17:33.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.338+0000 7f8f6b200640 1 -- start start 2024-03-26T06:17:33.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.340+0000 7f8f6b200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f640cfd60 0x7f8f640b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.340+0000 7f8f6b200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f64144c70 0x7f8f640712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.340+0000 7f8f6b200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8f641450d0 0x7f8f64071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.340+0000 7f8f6b200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f640d0140 con 0x7f8f640cfd60 2024-03-26T06:17:33.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.340+0000 7f8f6b200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f640b4b10 con 0x7f8f641450d0 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.340+0000 7f8f6b200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b3530 con 0x7f8f64144c70 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.341+0000 7f8f63e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f640cfd60 0x7f8f640b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.341+0000 7f8f63e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f640cfd60 0x7f8f640b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59610/0 (socket says 172.21.15.63:59610) 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.341+0000 7f8f63e00640 1 -- 172.21.15.63:0/1516891155 learned_addr learned my addr 172.21.15.63:0/1516891155 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.341+0000 7f8f69200640 1 --2- 172.21.15.63:0/1516891155 >> v2:172.21.15.204:3300/0 conn(0x7f8f641450d0 0x7f8f64071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.341+0000 7f8f63e00640 1 -- 172.21.15.63:0/1516891155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f64144c70 msgr2=0x7f8f640712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.341+0000 7f8f63e00640 1 --2- 172.21.15.63:0/1516891155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f64144c70 0x7f8f640712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.341+0000 7f8f63e00640 1 -- 172.21.15.63:0/1516891155 >> v2:172.21.15.204:3300/0 conn(0x7f8f641450d0 msgr2=0x7f8f64071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.341+0000 7f8f63e00640 1 --2- 172.21.15.63:0/1516891155 >> v2:172.21.15.204:3300/0 conn(0x7f8f641450d0 0x7f8f64071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.341+0000 7f8f63e00640 1 -- 172.21.15.63:0/1516891155 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640b3810 con 0x7f8f640cfd60 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.342+0000 7f8f63e00640 1 --2- 172.21.15.63:0/1516891155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f640cfd60 0x7f8f640b45d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f640af250 tx=0x7f8f5402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47166000ffd3876 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f63400640 1 -- 172.21.15.63:0/1516891155 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5402ca70 con 0x7f8f640cfd60 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f63400640 1 -- 172.21.15.63:0/1516891155 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5402cc10 con 0x7f8f640cfd60 2024-03-26T06:17:33.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f63400640 1 -- 172.21.15.63:0/1516891155 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f540343f0 con 0x7f8f640cfd60 2024-03-26T06:17:33.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f6b200640 1 -- 172.21.15.63:0/1516891155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f640cfd60 msgr2=0x7f8f640b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f6b200640 1 --2- 172.21.15.63:0/1516891155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f640cfd60 0x7f8f640b45d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f640af250 tx=0x7f8f5402bed0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f6b200640 1 -- 172.21.15.63:0/1516891155 shutdown_connections 2024-03-26T06:17:33.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f6b200640 1 --2- 172.21.15.63:0/1516891155 >> v2:172.21.15.204:3300/0 conn(0x7f8f641450d0 0x7f8f64071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f6b200640 1 --2- 172.21.15.63:0/1516891155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f64144c70 0x7f8f640712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f6b200640 1 --2- 172.21.15.63:0/1516891155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f640cfd60 0x7f8f640b45d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.343+0000 7f8f6b200640 1 -- 172.21.15.63:0/1516891155 >> 172.21.15.63:0/1516891155 conn(0x7f8f6406ac90 msgr2=0x7f8f6406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:33.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.344+0000 7f8f6b200640 1 -- 172.21.15.63:0/1516891155 shutdown_connections 2024-03-26T06:17:33.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.344+0000 7f8f6b200640 1 -- 172.21.15.63:0/1516891155 wait complete. 2024-03-26T06:17:33.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.345+0000 7f8f6b200640 1 Processor -- start 2024-03-26T06:17:33.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.345+0000 7f8f6b200640 1 -- start start 2024-03-26T06:17:33.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.346+0000 7f8f6b200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f640cfd60 0x7f8f641f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.346+0000 7f8f6b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f64144c70 0x7f8f640a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.346+0000 7f8f6b200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f641450d0 0x7f8f640a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.346+0000 7f8f6b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b40b0 con 0x7f8f64144c70 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.346+0000 7f8f6b200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b3dd0 con 0x7f8f640cfd60 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.346+0000 7f8f6b200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b31c0 con 0x7f8f641450d0 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f5b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f64144c70 0x7f8f640a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f5b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f64144c70 0x7f8f640a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59612/0 (socket says 172.21.15.63:59612) 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f5b400640 1 -- 172.21.15.63:0/3815288621 learned_addr learned my addr 172.21.15.63:0/3815288621 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f63e00640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f640cfd60 0x7f8f641f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f69200640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f641450d0 0x7f8f640a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f5b400640 1 -- 172.21.15.63:0/3815288621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f641450d0 msgr2=0x7f8f640a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f5b400640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f641450d0 0x7f8f640a8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f5b400640 1 -- 172.21.15.63:0/3815288621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f640cfd60 msgr2=0x7f8f641f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f5b400640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f640cfd60 0x7f8f641f4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f5b400640 1 -- 172.21.15.63:0/3815288621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64137a00 con 0x7f8f64144c70 2024-03-26T06:17:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.347+0000 7f8f63e00640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f640cfd60 0x7f8f641f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.348+0000 7f8f5b400640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f64144c70 0x7f8f640a84d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00b410 tx=0x7f8f4c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.348+0000 7f8f60c00640 1 -- 172.21.15.63:0/3815288621 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c015020 con 0x7f8f64144c70 2024-03-26T06:17:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.348+0000 7f8f60c00640 1 -- 172.21.15.63:0/3815288621 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c011850 con 0x7f8f64144c70 2024-03-26T06:17:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.348+0000 7f8f60c00640 1 -- 172.21.15.63:0/3815288621 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c011c40 con 0x7f8f64144c70 2024-03-26T06:17:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.348+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f640a90b0 con 0x7f8f64144c70 2024-03-26T06:17:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.348+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f640a9670 con 0x7f8f64144c70 2024-03-26T06:17:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.349+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f64074730 con 0x7f8f64144c70 2024-03-26T06:17:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.350+0000 7f8f60c00640 1 -- 172.21.15.63:0/3815288621 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8f4c018020 con 0x7f8f64144c70 2024-03-26T06:17:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.352+0000 7f8f60c00640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8f4006bbd0 0x7f8f4006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.352+0000 7f8f60c00640 1 -- 172.21.15.63:0/3815288621 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8f4c08ad50 con 0x7f8f64144c70 2024-03-26T06:17:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.352+0000 7f8f63e00640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8f4006bbd0 0x7f8f4006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.353+0000 7f8f63e00640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8f4006bbd0 0x7f8f4006e090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8f54035000 tx=0x7f8f54030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.356+0000 7f8f60c00640 1 -- 172.21.15.63:0/3815288621 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8f4c01f020 con 0x7f8f64144c70 2024-03-26T06:17:33.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.554+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f640b2640 con 0x7f8f64144c70 2024-03-26T06:17:33.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.555+0000 7f8f60c00640 1 -- 172.21.15.63:0/3815288621 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f4c0172c0 con 0x7f8f64144c70 2024-03-26T06:17:33.555 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:17:33.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8f4006bbd0 msgr2=0x7f8f4006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8f4006bbd0 0x7f8f4006e090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8f54035000 tx=0x7f8f54030000 comp rx=0 tx=0).stop 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f64144c70 msgr2=0x7f8f640a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f64144c70 0x7f8f640a84d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00b410 tx=0x7f8f4c00b8d0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 shutdown_connections 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8f4006bbd0 0x7f8f4006e090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f641450d0 0x7f8f640a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f64144c70 0x7f8f640a84d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 --2- 172.21.15.63:0/3815288621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f640cfd60 0x7f8f641f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 >> 172.21.15.63:0/3815288621 conn(0x7f8f6406ac90 msgr2=0x7f8f640b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 shutdown_connections 2024-03-26T06:17:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.558+0000 7f8f6b200640 1 -- 172.21.15.63:0/3815288621 wait complete. 2024-03-26T06:17:33.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:17:33.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.813+0000 7fe91e200640 1 Processor -- start 2024-03-26T06:17:33.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.813+0000 7fe91e200640 1 -- start start 2024-03-26T06:17:33.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.814+0000 7fe91e200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 0x7fe9180d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.814+0000 7fe91e200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe9180b9320 0x7fe9180b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.814+0000 7fe91e200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9180d4160 con 0x7fe91815dca0 2024-03-26T06:17:33.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.814+0000 7fe91e200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9180d2070 con 0x7fe9180b9320 2024-03-26T06:17:33.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.814+0000 7fe91e200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180d22d0 con 0x7fe9180d3840 2024-03-26T06:17:33.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.815+0000 7fe91d800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe9180b9320 0x7fe9180b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.815+0000 7fe91ce00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 0x7fe9180d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.815+0000 7fe917e00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fe91815dca0 0x7fe9180d1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:49086/0 (socket says 172.21.15.63:49086) 2024-03-26T06:17:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.815+0000 7fe91d800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe9180b9320 0x7fe9180b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:47338/0 (socket says 172.21.15.63:47338) 2024-03-26T06:17:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.815+0000 7fe917e00640 1 -- 172.21.15.63:0/1324359380 learned_addr learned my addr 172.21.15.63:0/1324359380 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.816+0000 7fe91d800640 1 -- 172.21.15.63:0/1324359380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 msgr2=0x7fe9180d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.816+0000 7fe91d800640 1 --2- 172.21.15.63:0/1324359380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 0x7fe9180d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.816+0000 7fe91d800640 1 -- 172.21.15.63:0/1324359380 >> v1:172.21.15.204:6789/0 conn(0x7fe91815dca0 legacy=0x7fe9180d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.816+0000 7fe91d800640 1 -- 172.21.15.63:0/1324359380 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9180d25b0 con 0x7fe9180b9320 2024-03-26T06:17:33.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.817+0000 7fe91d800640 1 --2- 172.21.15.63:0/1324359380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9180b9320 0x7fe9180b6a50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe910009d90 tx=0x7fe91002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f532d4e5e3c0f0a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:33.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.818+0000 7fe917400640 1 -- 172.21.15.63:0/1324359380 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910039070 con 0x7fe9180b9320 2024-03-26T06:17:33.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.818+0000 7fe917400640 1 -- 172.21.15.63:0/1324359380 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91002cc50 con 0x7fe9180b9320 2024-03-26T06:17:33.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.818+0000 7fe917400640 1 -- 172.21.15.63:0/1324359380 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910034440 con 0x7fe9180b9320 2024-03-26T06:17:33.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.818+0000 7fe91e200640 1 -- 172.21.15.63:0/1324359380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9180b9320 msgr2=0x7fe9180b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.818+0000 7fe91e200640 1 --2- 172.21.15.63:0/1324359380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9180b9320 0x7fe9180b6a50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe910009d90 tx=0x7fe91002bea0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.819+0000 7fe91e200640 1 -- 172.21.15.63:0/1324359380 shutdown_connections 2024-03-26T06:17:33.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.819+0000 7fe91e200640 1 --2- 172.21.15.63:0/1324359380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9180b9320 0x7fe9180b6a50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.819+0000 7fe91e200640 1 --2- 172.21.15.63:0/1324359380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 0x7fe9180d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.819+0000 7fe91e200640 1 -- 172.21.15.63:0/1324359380 >> 172.21.15.63:0/1324359380 conn(0x7fe91806c570 msgr2=0x7fe91806c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:33.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.819+0000 7fe91e200640 1 -- 172.21.15.63:0/1324359380 shutdown_connections 2024-03-26T06:17:33.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.819+0000 7fe91e200640 1 -- 172.21.15.63:0/1324359380 wait complete. 2024-03-26T06:17:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.821+0000 7fe91e200640 1 Processor -- start 2024-03-26T06:17:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.821+0000 7fe91e200640 1 -- start start 2024-03-26T06:17:33.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91e200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9180b9320 0x7fe91814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91e200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 0x7fe9180ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91e200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe91815dca0 0x7fe9180c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91e200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180d2e50 con 0x7fe91815dca0 2024-03-26T06:17:33.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91e200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180d2b70 con 0x7fe9180b9320 2024-03-26T06:17:33.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91e200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180d3370 con 0x7fe9180d3840 2024-03-26T06:17:33.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe91815dca0 0x7fe9180c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe91815dca0 0x7fe9180c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59624/0 (socket says 172.21.15.63:59624) 2024-03-26T06:17:33.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91d800640 1 -- 172.21.15.63:0/3206799779 learned_addr learned my addr 172.21.15.63:0/3206799779 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:33.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe91ce00640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9180b9320 0x7fe91814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.823+0000 7fe917e00640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 0x7fe9180ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.824+0000 7fe91d800640 1 -- 172.21.15.63:0/3206799779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 msgr2=0x7fe9180ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.824+0000 7fe91d800640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 0x7fe9180ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.824+0000 7fe91d800640 1 -- 172.21.15.63:0/3206799779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9180b9320 msgr2=0x7fe91814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:33.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.824+0000 7fe91d800640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9180b9320 0x7fe91814dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:33.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.824+0000 7fe91d800640 1 -- 172.21.15.63:0/3206799779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91814e2a0 con 0x7fe91815dca0 2024-03-26T06:17:33.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.824+0000 7fe917e00640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 0x7fe9180ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:33.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.824+0000 7fe91d800640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe91815dca0 0x7fe9180c96c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe910009d90 tx=0x7fe910004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:33.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.825+0000 7fe914c00640 1 -- 172.21.15.63:0/3206799779 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910039050 con 0x7fe91815dca0 2024-03-26T06:17:33.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.825+0000 7fe914c00640 1 -- 172.21.15.63:0/3206799779 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910045070 con 0x7fe91815dca0 2024-03-26T06:17:33.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.825+0000 7fe914c00640 1 -- 172.21.15.63:0/3206799779 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910009450 con 0x7fe91815dca0 2024-03-26T06:17:33.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.825+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9180cd450 con 0x7fe91815dca0 2024-03-26T06:17:33.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.825+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91815e1b0 con 0x7fe91815dca0 2024-03-26T06:17:33.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.826+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91804f0c0 con 0x7fe91815dca0 2024-03-26T06:17:33.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.827+0000 7fe914c00640 1 -- 172.21.15.63:0/3206799779 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe91003e610 con 0x7fe91815dca0 2024-03-26T06:17:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.828+0000 7fe914c00640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8f806bbd0 0x7fe8f806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.828+0000 7fe914c00640 1 -- 172.21.15.63:0/3206799779 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe9100ad810 con 0x7fe91815dca0 2024-03-26T06:17:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.828+0000 7fe91ce00640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8f806bbd0 0x7fe8f806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:33.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.829+0000 7fe91ce00640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8f806bbd0 0x7fe8f806e090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe908009b40 tx=0x7fe908009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:33.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:33.833+0000 7fe914c00640 1 -- 172.21.15.63:0/3206799779 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe91814e2a0 con 0x7fe91815dca0 2024-03-26T06:17:34.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.047+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe91815be40 con 0x7fe91815dca0 2024-03-26T06:17:34.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.048+0000 7fe914c00640 1 -- 172.21.15.63:0/3206799779 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe91007bfb0 con 0x7fe91815dca0 2024-03-26T06:17:34.048 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:34.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8f806bbd0 msgr2=0x7fe8f806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8f806bbd0 0x7fe8f806e090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe908009b40 tx=0x7fe908009190 comp rx=0 tx=0).stop 2024-03-26T06:17:34.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe91815dca0 msgr2=0x7fe9180c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe91815dca0 0x7fe9180c96c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe910009d90 tx=0x7fe910004a40 comp rx=0 tx=0).stop 2024-03-26T06:17:34.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 shutdown_connections 2024-03-26T06:17:34.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8f806bbd0 0x7fe8f806e090 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe91815dca0 0x7fe9180c96c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9180d3840 0x7fe9180ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 --2- 172.21.15.63:0/3206799779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9180b9320 0x7fe91814dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 >> 172.21.15.63:0/3206799779 conn(0x7fe91806c570 msgr2=0x7fe91815b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:34.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 shutdown_connections 2024-03-26T06:17:34.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.051+0000 7fe91e200640 1 -- 172.21.15.63:0/3206799779 wait complete. 2024-03-26T06:17:34.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:17:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.292+0000 7f8af8800640 1 Processor -- start 2024-03-26T06:17:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.292+0000 7f8af8800640 1 -- start start 2024-03-26T06:17:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af8800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8af00ced60 0x7f8af006e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af8800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 0x7f8af0071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af8800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8af0071890 0x7f8af0162710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af8800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af006e750 con 0x7f8af00ced60 2024-03-26T06:17:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af8800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af0163490 con 0x7f8af0071890 2024-03-26T06:17:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af8800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af006d450 con 0x7f8af00cf140 2024-03-26T06:17:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af5e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8af00ced60 0x7f8af006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af5e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8af00ced60 0x7f8af006e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59634/0 (socket says 172.21.15.63:59634) 2024-03-26T06:17:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af5e00640 1 -- 172.21.15.63:0/3945413385 learned_addr learned my addr 172.21.15.63:0/3945413385 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.294+0000 7f8af6800640 1 --2- 172.21.15.63:0/3945413385 >> v2:172.21.15.204:3300/0 conn(0x7f8af0071890 0x7f8af0162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.295+0000 7f8af5400640 1 --2- 172.21.15.63:0/3945413385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 0x7f8af0071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.295+0000 7f8af5e00640 1 -- 172.21.15.63:0/3945413385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 msgr2=0x7f8af0071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.295+0000 7f8af5e00640 1 --2- 172.21.15.63:0/3945413385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 0x7f8af0071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.295+0000 7f8af5e00640 1 -- 172.21.15.63:0/3945413385 >> v2:172.21.15.204:3300/0 conn(0x7f8af0071890 msgr2=0x7f8af0162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:34.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.295+0000 7f8af5e00640 1 --2- 172.21.15.63:0/3945413385 >> v2:172.21.15.204:3300/0 conn(0x7f8af0071890 0x7f8af0162710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.295+0000 7f8af5e00640 1 -- 172.21.15.63:0/3945413385 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af006d730 con 0x7f8af00ced60 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.296+0000 7f8af5e00640 1 --2- 172.21.15.63:0/3945413385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 0x7f8af006e210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8af00cbc70 tx=0x7f8ae802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1470a0dc8adfabdb server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.296+0000 7f8af4a00640 1 -- 172.21.15.63:0/3945413385 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae802ca70 con 0x7f8af00ced60 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.296+0000 7f8af4a00640 1 -- 172.21.15.63:0/3945413385 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae802cc10 con 0x7f8af00ced60 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.296+0000 7f8af4a00640 1 -- 172.21.15.63:0/3945413385 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80343f0 con 0x7f8af00ced60 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.297+0000 7f8af8800640 1 -- 172.21.15.63:0/3945413385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 msgr2=0x7f8af006e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.297+0000 7f8af8800640 1 --2- 172.21.15.63:0/3945413385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 0x7f8af006e210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8af00cbc70 tx=0x7f8ae802bed0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.297+0000 7f8af8800640 1 -- 172.21.15.63:0/3945413385 shutdown_connections 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.297+0000 7f8af8800640 1 --2- 172.21.15.63:0/3945413385 >> v2:172.21.15.204:3300/0 conn(0x7f8af0071890 0x7f8af0162710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.297+0000 7f8af8800640 1 --2- 172.21.15.63:0/3945413385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 0x7f8af0071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.297+0000 7f8af8800640 1 --2- 172.21.15.63:0/3945413385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 0x7f8af006e210 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.297+0000 7f8af8800640 1 -- 172.21.15.63:0/3945413385 >> 172.21.15.63:0/3945413385 conn(0x7f8af006ac90 msgr2=0x7f8af006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:34.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.297+0000 7f8af8800640 1 -- 172.21.15.63:0/3945413385 shutdown_connections 2024-03-26T06:17:34.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.297+0000 7f8af8800640 1 -- 172.21.15.63:0/3945413385 wait complete. 2024-03-26T06:17:34.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.299+0000 7f8af8800640 1 Processor -- start 2024-03-26T06:17:34.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.300+0000 7f8af8800640 1 -- start start 2024-03-26T06:17:34.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af8800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8af0071890 0x7f8af01f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af8800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 0x7f8af01597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af8800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 0x7f8af01fb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af8800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0162c50 con 0x7f8af00ced60 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af8800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af006dcf0 con 0x7f8af0071890 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af8800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0162dd0 con 0x7f8af00cf140 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 0x7f8af01597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 0x7f8af01597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59642/0 (socket says 172.21.15.63:59642) 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af5400640 1 -- 172.21.15.63:0/3682946474 learned_addr learned my addr 172.21.15.63:0/3682946474 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af5e00640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8af0071890 0x7f8af01f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.301+0000 7f8af6800640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 0x7f8af01fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8af5400640 1 -- 172.21.15.63:0/3682946474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 msgr2=0x7f8af01fb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8af5400640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 0x7f8af01fb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8af5400640 1 -- 172.21.15.63:0/3682946474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8af0071890 msgr2=0x7f8af01f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8af5400640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8af0071890 0x7f8af01f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8af5400640 1 -- 172.21.15.63:0/3682946474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af015b350 con 0x7f8af00ced60 2024-03-26T06:17:34.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8af5e00640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8af0071890 0x7f8af01f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:34.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8af5400640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 0x7f8af01597f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000c7f0 tx=0x7f8ae000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:34.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8ae6000640 1 -- 172.21.15.63:0/3682946474 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0015070 con 0x7f8af00ced60 2024-03-26T06:17:34.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8ae6000640 1 -- 172.21.15.63:0/3682946474 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0004240 con 0x7f8af00ced60 2024-03-26T06:17:34.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8ae6000640 1 -- 172.21.15.63:0/3682946474 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0003610 con 0x7f8af00ced60 2024-03-26T06:17:34.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af015b5d0 con 0x7f8af00ced60 2024-03-26T06:17:34.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.302+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af015bb90 con 0x7f8af00ced60 2024-03-26T06:17:34.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.303+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af0074730 con 0x7f8af00ced60 2024-03-26T06:17:34.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.304+0000 7f8ae6000640 1 -- 172.21.15.63:0/3682946474 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8ae00039c0 con 0x7f8af00ced60 2024-03-26T06:17:34.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.306+0000 7f8ae6000640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ad406bbd0 0x7f8ad406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.306+0000 7f8ae6000640 1 -- 172.21.15.63:0/3682946474 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8ae008b190 con 0x7f8af00ced60 2024-03-26T06:17:34.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.306+0000 7f8af5e00640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ad406bbd0 0x7f8ad406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.307+0000 7f8af5e00640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ad406bbd0 0x7f8ad406e090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8035000 tx=0x7f8ae8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:34.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.311+0000 7f8ae6000640 1 -- 172.21.15.63:0/3682946474 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8af015b350 con 0x7f8af00ced60 2024-03-26T06:17:34.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.553+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8af00b2960 con 0x7f8af00ced60 2024-03-26T06:17:34.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.554+0000 7f8ae6000640 1 -- 172.21.15.63:0/3682946474 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4937 (secure 0 0 0) 0x7f8ae0059920 con 0x7f8af00ced60 2024-03-26T06:17:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:20.131439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-26T06:17:34.555 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-03-26T06:17:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ad406bbd0 msgr2=0x7f8ad406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ad406bbd0 0x7f8ad406e090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8035000 tx=0x7f8ae8030000 comp rx=0 tx=0).stop 2024-03-26T06:17:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 msgr2=0x7f8af01597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 0x7f8af01597f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000c7f0 tx=0x7f8ae000ccb0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 shutdown_connections 2024-03-26T06:17:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8ad406bbd0 0x7f8ad406e090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8af00cf140 0x7f8af01fb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8af00ced60 0x7f8af01597f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 --2- 172.21.15.63:0/3682946474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8af0071890 0x7f8af01f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 >> 172.21.15.63:0/3682946474 conn(0x7f8af006ac90 msgr2=0x7f8af00b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 shutdown_connections 2024-03-26T06:17:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.557+0000 7f8af8800640 1 -- 172.21.15.63:0/3682946474 wait complete. 2024-03-26T06:17:34.576 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.794+0000 7f78df400640 1 Processor -- start 2024-03-26T06:17:34.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.795+0000 7f78df400640 1 -- start start 2024-03-26T06:17:34.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.796+0000 7f78df400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f78d815dc30 0x7f78d80b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.796+0000 7f78df400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f78d806ef10 0x7f78d806f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.796+0000 7f78df400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d80af8a0 con 0x7f78d80af440 2024-03-26T06:17:34.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.796+0000 7f78df400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d80b3c20 con 0x7f78d806ef10 2024-03-26T06:17:34.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.796+0000 7f78df400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d8070070 con 0x7f78d815dc30 2024-03-26T06:17:34.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.797+0000 7f78dd400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f78d806ef10 0x7f78d806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.797+0000 7f78dd400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f78d806ef10 0x7f78d806f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59644/0 (socket says 172.21.15.63:59644) 2024-03-26T06:17:34.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.797+0000 7f78dd400640 1 -- 172.21.15.63:0/21972295 learned_addr learned my addr 172.21.15.63:0/21972295 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:34.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.797+0000 7f78dca00640 1 --2- 172.21.15.63:0/21972295 >> v2:172.21.15.204:3300/0 conn(0x7f78d815dc30 0x7f78d80b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.797+0000 7f78dd400640 1 -- 172.21.15.63:0/21972295 >> v2:172.21.15.204:3300/0 conn(0x7f78d815dc30 msgr2=0x7f78d80b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.797+0000 7f78dd400640 1 --2- 172.21.15.63:0/21972295 >> v2:172.21.15.204:3300/0 conn(0x7f78d815dc30 0x7f78d80b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.797+0000 7f78dd400640 1 -- 172.21.15.63:0/21972295 >> v1:172.21.15.63:6789/0 conn(0x7f78d80af440 legacy=0x7f78d80ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.797+0000 7f78dd400640 1 -- 172.21.15.63:0/21972295 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80b5820 con 0x7f78d806ef10 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.797+0000 7f78d7400640 1 -- 172.21.15.63:0/21972295 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987110810 0 0) 0x7f78d80af8a0 con 0x7f78d80af440 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.799+0000 7f78dd400640 1 --2- 172.21.15.63:0/21972295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 0x7f78d806f320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f78d80d16e0 tx=0x7f78d002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8c6d9a3cb03ab2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.799+0000 7f78d7400640 1 -- 172.21.15.63:0/21972295 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d002ca80 con 0x7f78d806ef10 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.799+0000 7f78d7400640 1 -- 172.21.15.63:0/21972295 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d002cc20 con 0x7f78d806ef10 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.799+0000 7f78d7400640 1 -- 172.21.15.63:0/21972295 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d00343f0 con 0x7f78d806ef10 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.800+0000 7f78df400640 1 -- 172.21.15.63:0/21972295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 msgr2=0x7f78d806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.800+0000 7f78df400640 1 --2- 172.21.15.63:0/21972295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 0x7f78d806f320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f78d80d16e0 tx=0x7f78d002bee0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.800+0000 7f78df400640 1 -- 172.21.15.63:0/21972295 shutdown_connections 2024-03-26T06:17:34.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.800+0000 7f78df400640 1 --2- 172.21.15.63:0/21972295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 0x7f78d806f320 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.800+0000 7f78df400640 1 --2- 172.21.15.63:0/21972295 >> v2:172.21.15.204:3300/0 conn(0x7f78d815dc30 0x7f78d80b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.800+0000 7f78df400640 1 -- 172.21.15.63:0/21972295 >> 172.21.15.63:0/21972295 conn(0x7f78d80b5ae0 msgr2=0x7f78d80b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.800+0000 7f78df400640 1 -- 172.21.15.63:0/21972295 shutdown_connections 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.800+0000 7f78df400640 1 -- 172.21.15.63:0/21972295 wait complete. 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.802+0000 7f78df400640 1 Processor -- start 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.802+0000 7f78df400640 1 -- start start 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78df400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 0x7f78d809a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78df400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d80af440 0x7f78d8157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78df400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d815dc30 0x7f78d81f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78df400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80b3940 con 0x7f78d806ef10 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78df400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80adcb0 con 0x7f78d815dc30 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78df400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8070500 con 0x7f78d80af440 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78dca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 0x7f78d809a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78dca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 0x7f78d809a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59654/0 (socket says 172.21.15.63:59654) 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78dca00640 1 -- 172.21.15.63:0/997215838 learned_addr learned my addr 172.21.15.63:0/997215838 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78dd400640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d815dc30 0x7f78d81f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78d7e00640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d80af440 0x7f78d8157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78dca00640 1 -- 172.21.15.63:0/997215838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d80af440 msgr2=0x7f78d8157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78dca00640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d80af440 0x7f78d8157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78dca00640 1 -- 172.21.15.63:0/997215838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d815dc30 msgr2=0x7f78d81f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78dca00640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d815dc30 0x7f78d81f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.803+0000 7f78dca00640 1 -- 172.21.15.63:0/997215838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d815bbc0 con 0x7f78d806ef10 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.804+0000 7f78dd400640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d815dc30 0x7f78d81f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.804+0000 7f78dca00640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 0x7f78d809a6b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78c800e870 tx=0x7f78c800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.804+0000 7f78d4c00640 1 -- 172.21.15.63:0/997215838 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8017070 con 0x7f78d806ef10 2024-03-26T06:17:34.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.804+0000 7f78d4c00640 1 -- 172.21.15.63:0/997215838 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c800c940 con 0x7f78d806ef10 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.804+0000 7f78d4c00640 1 -- 172.21.15.63:0/997215838 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c800cd30 con 0x7f78d806ef10 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.804+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d815bea0 con 0x7f78d806ef10 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.804+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d815c980 con 0x7f78d806ef10 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.806+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d8074730 con 0x7f78d806ef10 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.806+0000 7f78d4c00640 1 -- 172.21.15.63:0/997215838 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f78c801a070 con 0x7f78d806ef10 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.807+0000 7f78d4c00640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f78b806bc00 0x7f78b806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.807+0000 7f78d4c00640 1 -- 172.21.15.63:0/997215838 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f78c808aba0 con 0x7f78d806ef10 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.808+0000 7f78d7e00640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f78b806bc00 0x7f78b806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.808+0000 7f78d7e00640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f78b806bc00 0x7f78b806e0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f78d809be70 tx=0x7f78c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:34.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:34.812+0000 7f78d4c00640 1 -- 172.21.15.63:0/997215838 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f78c80593e0 con 0x7f78d806ef10 2024-03-26T06:17:35.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.022+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78d80b32b0 con 0x7f78d806ef10 2024-03-26T06:17:35.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.026+0000 7f78d4c00640 1 -- 172.21.15.63:0/997215838 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18526 (secure 0 0 0) 0x7f78c8058ce0 con 0x7f78d806ef10 2024-03-26T06:17:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:35.026 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:03.049711+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:35.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f78b806bc00 msgr2=0x7f78b806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f78b806bc00 0x7f78b806e0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f78d809be70 tx=0x7f78c4009040 comp rx=0 tx=0).stop 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 msgr2=0x7f78d809a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 0x7f78d809a6b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78c800e870 tx=0x7f78c800ed30 comp rx=0 tx=0).stop 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 shutdown_connections 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f78b806bc00 0x7f78b806e0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d815dc30 0x7f78d81f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d80af440 0x7f78d8157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 --2- 172.21.15.63:0/997215838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78d806ef10 0x7f78d809a6b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.028+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 >> 172.21.15.63:0/997215838 conn(0x7f78d80b5ae0 msgr2=0x7f78d806ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.029+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 shutdown_connections 2024-03-26T06:17:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.029+0000 7f78df400640 1 -- 172.21.15.63:0/997215838 wait complete. 2024-03-26T06:17:35.050 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:17:35.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.275+0000 7f81a9600640 1 Processor -- start 2024-03-26T06:17:35.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.275+0000 7f81a9600640 1 -- start start 2024-03-26T06:17:35.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.277+0000 7f81a9600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f81a41658a0 0x7f81a40b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:35.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.277+0000 7f81a9600640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f81a40b54a0 0x7f81a4165c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:35.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.277+0000 7f81a9600640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a40b3c70 con 0x7f81a41661c0 2024-03-26T06:17:35.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.277+0000 7f81a9600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40b4720 con 0x7f81a41658a0 2024-03-26T06:17:35.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.277+0000 7f81a9600640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40b49c0 con 0x7f81a40b54a0 2024-03-26T06:17:35.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.277+0000 7f81a3e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f81a41658a0 0x7f81a40b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:35.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.277+0000 7f81a3e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f81a41658a0 0x7f81a40b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59670/0 (socket says 172.21.15.63:59670) 2024-03-26T06:17:35.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.277+0000 7f81a3e00640 1 -- 172.21.15.63:0/173728453 learned_addr learned my addr 172.21.15.63:0/173728453 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:35.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.278+0000 7f819be00640 1 --2- 172.21.15.63:0/173728453 >> v2:172.21.15.204:3300/0 conn(0x7f81a40b54a0 0x7f81a4165c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:35.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.278+0000 7f81a3e00640 1 -- 172.21.15.63:0/173728453 >> v2:172.21.15.204:3300/0 conn(0x7f81a40b54a0 msgr2=0x7f81a4165c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:35.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.278+0000 7f81a3e00640 1 --2- 172.21.15.63:0/173728453 >> v2:172.21.15.204:3300/0 conn(0x7f81a40b54a0 0x7f81a4165c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.278+0000 7f81a3e00640 1 -- 172.21.15.63:0/173728453 >> v1:172.21.15.204:6789/0 conn(0x7f81a41661c0 legacy=0x7f81a406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:35.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.278+0000 7f81a3e00640 1 -- 172.21.15.63:0/173728453 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a40b4ca0 con 0x7f81a41658a0 2024-03-26T06:17:35.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.278+0000 7f819be00640 1 --2- 172.21.15.63:0/173728453 >> v2:172.21.15.204:3300/0 conn(0x7f81a40b54a0 0x7f81a4165c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:35.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.279+0000 7f81a3e00640 1 --2- 172.21.15.63:0/173728453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41658a0 0x7f81a40b3680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f81a40aecc0 tx=0x7f819402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6b012c828aaa4 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:35.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.279+0000 7f81a3400640 1 -- 172.21.15.63:0/173728453 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194038070 con 0x7f81a41658a0 2024-03-26T06:17:35.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.279+0000 7f81a3400640 1 -- 172.21.15.63:0/173728453 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819402f050 con 0x7f81a41658a0 2024-03-26T06:17:35.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.279+0000 7f81a3400640 1 -- 172.21.15.63:0/173728453 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194031970 con 0x7f81a41658a0 2024-03-26T06:17:35.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.280+0000 7f81a9600640 1 -- 172.21.15.63:0/173728453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41658a0 msgr2=0x7f81a40b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:35.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.280+0000 7f81a9600640 1 --2- 172.21.15.63:0/173728453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41658a0 0x7f81a40b3680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f81a40aecc0 tx=0x7f819402b7f0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.280+0000 7f81a9600640 1 -- 172.21.15.63:0/173728453 shutdown_connections 2024-03-26T06:17:35.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.280+0000 7f81a9600640 1 --2- 172.21.15.63:0/173728453 >> v2:172.21.15.204:3300/0 conn(0x7f81a40b54a0 0x7f81a4165c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.280+0000 7f81a9600640 1 --2- 172.21.15.63:0/173728453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41658a0 0x7f81a40b3680 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.280+0000 7f81a9600640 1 -- 172.21.15.63:0/173728453 >> 172.21.15.63:0/173728453 conn(0x7f81a40b13d0 msgr2=0x7f81a40b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:35.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.280+0000 7f81a9600640 1 -- 172.21.15.63:0/173728453 shutdown_connections 2024-03-26T06:17:35.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.280+0000 7f81a9600640 1 -- 172.21.15.63:0/173728453 wait complete. 2024-03-26T06:17:35.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.282+0000 7f81a9600640 1 Processor -- start 2024-03-26T06:17:35.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.282+0000 7f81a9600640 1 -- start start 2024-03-26T06:17:35.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.283+0000 7f81a9600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81a40b54a0 0x7f81a4153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:35.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.283+0000 7f81a9600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81a41658a0 0x7f81a40711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:35.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.283+0000 7f81a9600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41661c0 0x7f81a4071730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.283+0000 7f81a9600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a41665f0 con 0x7f81a41661c0 2024-03-26T06:17:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.283+0000 7f81a9600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a41630a0 con 0x7f81a40b54a0 2024-03-26T06:17:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.283+0000 7f81a9600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4166770 con 0x7f81a41658a0 2024-03-26T06:17:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.283+0000 7f81a8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41661c0 0x7f81a4071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.283+0000 7f81a8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41661c0 0x7f81a4071730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59686/0 (socket says 172.21.15.63:59686) 2024-03-26T06:17:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.283+0000 7f81a8c00640 1 -- 172.21.15.63:0/2560442699 learned_addr learned my addr 172.21.15.63:0/2560442699 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f81a3e00640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81a40b54a0 0x7f81a4153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f819be00640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81a41658a0 0x7f81a40711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f81a8c00640 1 -- 172.21.15.63:0/2560442699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81a41658a0 msgr2=0x7f81a40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f81a8c00640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81a41658a0 0x7f81a40711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f81a8c00640 1 -- 172.21.15.63:0/2560442699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81a40b54a0 msgr2=0x7f81a4153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f81a8c00640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81a40b54a0 0x7f81a4153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f81a8c00640 1 -- 172.21.15.63:0/2560442699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4158920 con 0x7f81a41661c0 2024-03-26T06:17:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f81a8c00640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41661c0 0x7f81a4071730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f819c00b970 tx=0x7f819c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f81a0c00640 1 -- 172.21.15.63:0/2560442699 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c019070 con 0x7f81a41661c0 2024-03-26T06:17:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.284+0000 7f81a0c00640 1 -- 172.21.15.63:0/2560442699 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c00cb40 con 0x7f81a41661c0 2024-03-26T06:17:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.285+0000 7f81a0c00640 1 -- 172.21.15.63:0/2560442699 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c014440 con 0x7f81a41661c0 2024-03-26T06:17:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.285+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a4158bc0 con 0x7f81a41661c0 2024-03-26T06:17:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.285+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4159460 con 0x7f81a41661c0 2024-03-26T06:17:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.286+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a404f050 con 0x7f81a41661c0 2024-03-26T06:17:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.287+0000 7f81a0c00640 1 -- 172.21.15.63:0/2560442699 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f819c01c070 con 0x7f81a41661c0 2024-03-26T06:17:35.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.287+0000 7f81a0c00640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f818006bbd0 0x7f818006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:35.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.288+0000 7f81a0c00640 1 -- 172.21.15.63:0/2560442699 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f819c08aa60 con 0x7f81a41661c0 2024-03-26T06:17:35.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.288+0000 7f81a3e00640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f818006bbd0 0x7f818006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:35.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.288+0000 7f81a3e00640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f818006bbd0 0x7f818006e090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8194035000 tx=0x7f8194008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:35.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.292+0000 7f81a0c00640 1 -- 172.21.15.63:0/2560442699 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f819c059170 con 0x7f81a41661c0 2024-03-26T06:17:35.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.533+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81a406f380 con 0x7f81a41661c0 2024-03-26T06:17:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.534+0000 7f81a0c00640 1 -- 172.21.15.63:0/2560442699 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4937 (secure 0 0 0) 0x7f819c058a70 con 0x7f81a41661c0 2024-03-26T06:17:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:35.535 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:20.131439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-26T06:17:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-03-26T06:17:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f818006bbd0 msgr2=0x7f818006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f818006bbd0 0x7f818006e090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8194035000 tx=0x7f8194008030 comp rx=0 tx=0).stop 2024-03-26T06:17:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41661c0 msgr2=0x7f81a4071730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41661c0 0x7f81a4071730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f819c00b970 tx=0x7f819c00be30 comp rx=0 tx=0).stop 2024-03-26T06:17:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 shutdown_connections 2024-03-26T06:17:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f818006bbd0 0x7f818006e090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a41661c0 0x7f81a4071730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81a41658a0 0x7f81a40711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 --2- 172.21.15.63:0/2560442699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81a40b54a0 0x7f81a4153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 >> 172.21.15.63:0/2560442699 conn(0x7f81a40b13d0 msgr2=0x7f81a40afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 shutdown_connections 2024-03-26T06:17:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:35.537+0000 7f81a9600640 1 -- 172.21.15.63:0/2560442699 wait complete. 2024-03-26T06:17:35.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-26T06:16:57.955344+0000', 'modified': '2024-03-26T06:17:20.131439+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6835/135702470', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6834', 'nonce': 135702470}, {'type': 'v1', 'addr': '172.21.15.204:6835', 'nonce': 135702470}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-26T06:17:35.962 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-26T06:17:35.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-26T06:17:36.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.193+0000 7f32f7200640 1 Processor -- start 2024-03-26T06:17:36.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.194+0000 7f32f7200640 1 -- start start 2024-03-26T06:17:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.195+0000 7f32f7200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f32f8071850 0x7f32f8166590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.195+0000 7f32f7200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f815f410 con 0x7f32f806d270 2024-03-26T06:17:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.195+0000 7f32f7200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f815f6f0 con 0x7f32f813e650 2024-03-26T06:17:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.195+0000 7f32f7200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f815f9d0 con 0x7f32f8071850 2024-03-26T06:17:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.195+0000 7f32f5400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f32f806d270 0x7f32f8071140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46870/0 (socket says 172.21.15.63:46870) 2024-03-26T06:17:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.195+0000 7f32f5400640 1 -- 172.21.15.63:0/4033104805 learned_addr learned my addr 172.21.15.63:0/4033104805 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f6800640 1 --2- 172.21.15.63:0/4033104805 >> v2:172.21.15.204:3300/0 conn(0x7f32f8071850 0x7f32f8166590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994757338 0 0) 0x7f32f815f410 con 0x7f32f806d270 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32dc003520 con 0x7f32f806d270 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2656231313 0 0) 0x7f32dc003520 con 0x7f32f806d270 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 >> v2:172.21.15.204:3300/0 conn(0x7f32f8071850 msgr2=0x7f32f8166590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 --2- 172.21.15.63:0/4033104805 >> v2:172.21.15.204:3300/0 conn(0x7f32f8071850 0x7f32f8166590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 >> v1:172.21.15.204:6789/0 conn(0x7f32f813e650 legacy=0x7f32f806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f815fcb0 con 0x7f32f806d270 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f32e4001670 con 0x7f32f806d270 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 >> v1:172.21.15.63:6789/0 conn(0x7f32f806d270 legacy=0x7f32f8071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32dc0039b0 0x7f32dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32dc004800 0x7f32dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32dc0051c0 0x7f32dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f815f9d0 con 0x7f32dc0039b0 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc00c060 con 0x7f32dc0051c0 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.196+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc00c260 con 0x7f32dc004800 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f5e00640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32dc0039b0 0x7f32dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f5400640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32dc004800 0x7f32dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f6800640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32dc0051c0 0x7f32dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f5e00640 1 -- 172.21.15.63:0/4033104805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32dc004800 msgr2=0x7f32dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f5e00640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32dc004800 0x7f32dc004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f5e00640 1 -- 172.21.15.63:0/4033104805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32dc0051c0 msgr2=0x7f32dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f5e00640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32dc0051c0 0x7f32dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f5e00640 1 -- 172.21.15.63:0/4033104805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc003520 con 0x7f32dc0039b0 2024-03-26T06:17:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f6800640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32dc0051c0 0x7f32dc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.197+0000 7f32f6800640 1 -- 172.21.15.63:0/4033104805 reap_dead start 2024-03-26T06:17:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.198+0000 7f32f5e00640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32dc0039b0 0x7f32dc003dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f32e8001750 tx=0x7f32dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c035bb850e809918 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.198+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8001370 con 0x7f32dc0039b0 2024-03-26T06:17:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.198+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e80052d0 con 0x7f32dc0039b0 2024-03-26T06:17:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.198+0000 7f32f4a00640 1 -- 172.21.15.63:0/4033104805 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8003830 con 0x7f32dc0039b0 2024-03-26T06:17:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.199+0000 7f32f7200640 1 -- 172.21.15.63:0/4033104805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32dc0039b0 msgr2=0x7f32dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.199+0000 7f32f7200640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32dc0039b0 0x7f32dc003dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f32e8001750 tx=0x7f32dc005830 comp rx=0 tx=0).stop 2024-03-26T06:17:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.199+0000 7f32f7200640 1 -- 172.21.15.63:0/4033104805 shutdown_connections 2024-03-26T06:17:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.199+0000 7f32f7200640 1 --2- 172.21.15.63:0/4033104805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32dc0039b0 0x7f32dc003dd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.199+0000 7f32f7200640 1 -- 172.21.15.63:0/4033104805 >> 172.21.15.63:0/4033104805 conn(0x7f32f80670b0 msgr2=0x7f32f80b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.199+0000 7f32f7200640 1 -- 172.21.15.63:0/4033104805 shutdown_connections 2024-03-26T06:17:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.199+0000 7f32f7200640 1 -- 172.21.15.63:0/4033104805 wait complete. 2024-03-26T06:17:36.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.201+0000 7f32f7200640 1 Processor -- start 2024-03-26T06:17:36.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.201+0000 7f32f7200640 1 -- start start 2024-03-26T06:17:36.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f7200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32dc0039b0 0x7f32f80b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f7200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32f81f44a0 0x7f32f8154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f8153cd0 0x7f32f8154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f7200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f813ee20 con 0x7f32f8153cd0 2024-03-26T06:17:36.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f7200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f813eca0 con 0x7f32f81f44a0 2024-03-26T06:17:36.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f7200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f813efa0 con 0x7f32dc0039b0 2024-03-26T06:17:36.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f8153cd0 0x7f32f8154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f8153cd0 0x7f32f8154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59706/0 (socket says 172.21.15.63:59706) 2024-03-26T06:17:36.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f6800640 1 -- 172.21.15.63:0/3448730688 learned_addr learned my addr 172.21.15.63:0/3448730688 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:36.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f5400640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32f81f44a0 0x7f32f8154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.202+0000 7f32f5e00640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32dc0039b0 0x7f32f80b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.203+0000 7f32f6800640 1 -- 172.21.15.63:0/3448730688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32dc0039b0 msgr2=0x7f32f80b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.203+0000 7f32f6800640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32dc0039b0 0x7f32f80b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.203+0000 7f32f6800640 1 -- 172.21.15.63:0/3448730688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32f81f44a0 msgr2=0x7f32f8154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.203+0000 7f32f6800640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32f81f44a0 0x7f32f8154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.203+0000 7f32f6800640 1 -- 172.21.15.63:0/3448730688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80ac8e0 con 0x7f32f8153cd0 2024-03-26T06:17:36.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.203+0000 7f32f6800640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f8153cd0 0x7f32f8154e90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32f8156260 tx=0x7f32f000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:36.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.204+0000 7f32ee000640 1 -- 172.21.15.63:0/3448730688 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0016420 con 0x7f32f8153cd0 2024-03-26T06:17:36.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.204+0000 7f32ee000640 1 -- 172.21.15.63:0/3448730688 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f001b070 con 0x7f32f8153cd0 2024-03-26T06:17:36.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.204+0000 7f32ee000640 1 -- 172.21.15.63:0/3448730688 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f00167c0 con 0x7f32f8153cd0 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.204+0000 7f32f7200640 1 -- 172.21.15.63:0/3448730688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f8154270 con 0x7f32f8153cd0 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.204+0000 7f32f7200640 1 -- 172.21.15.63:0/3448730688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f80acba0 con 0x7f32f8153cd0 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.206+0000 7f32ee000640 1 -- 172.21.15.63:0/3448730688 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f32f0005d10 con 0x7f32f8153cd0 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.208+0000 7f32ee000640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f32d806bbd0 0x7f32d806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.208+0000 7f32ee000640 1 -- 172.21.15.63:0/3448730688 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f32f008b840 con 0x7f32f8153cd0 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.208+0000 7f32f5e00640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f32d806bbd0 0x7f32d806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.208+0000 7f32ff661740 1 Processor -- start 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.209+0000 7f32ff661740 1 -- start start 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.209+0000 7f32f5e00640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f32d806bbd0 0x7f32d806e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f32e8033000 tx=0x7f32e8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.209+0000 7f32ff661740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055810 0x55f6230287b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.209+0000 7f32ff661740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f6230585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.209+0000 7f32ff661740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623028cf0 0x55f623058ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.209+0000 7f32ff661740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622f926f0 con 0x55f623028cf0 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.209+0000 7f32ff661740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622f3b9e0 con 0x55f623055bf0 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.209+0000 7f32ff661740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f622f8e790 con 0x55f623055810 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623028cf0 0x55f623058ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623028cf0 0x55f623058ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59722/0 (socket says 172.21.15.63:59722) 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f6800640 1 -- 172.21.15.63:0/3180040476 learned_addr learned my addr 172.21.15.63:0/3180040476 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f6800640 1 -- 172.21.15.63:0/3180040476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055810 msgr2=0x55f6230287b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f5400640 1 --2- 172.21.15.63:0/3180040476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f6230585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f5e00640 1 --2- 172.21.15.63:0/3180040476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055810 0x55f6230287b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f6800640 1 --2- 172.21.15.63:0/3180040476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055810 0x55f6230287b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f6800640 1 -- 172.21.15.63:0/3180040476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 msgr2=0x55f6230585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f6800640 1 --2- 172.21.15.63:0/3180040476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f6230585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f6800640 1 -- 172.21.15.63:0/3180040476 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f622f2f720 con 0x55f623028cf0 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.210+0000 7f32f6800640 1 --2- 172.21.15.63:0/3180040476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623028cf0 0x55f623058ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32f0059a80 tx=0x7f32f0059570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619cf6ea09baca03 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.211+0000 7f32e2600640 1 -- 172.21.15.63:0/3180040476 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0057c00 con 0x55f623028cf0 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.211+0000 7f32e2600640 1 -- 172.21.15.63:0/3180040476 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f0055f70 con 0x55f623028cf0 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.211+0000 7f32e2600640 1 -- 172.21.15.63:0/3180040476 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0061cd0 con 0x55f623028cf0 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.211+0000 7f32ff661740 1 -- 172.21.15.63:0/3180040476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623028cf0 msgr2=0x55f623058ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.211+0000 7f32ff661740 1 --2- 172.21.15.63:0/3180040476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623028cf0 0x55f623058ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32f0059a80 tx=0x7f32f0059570 comp rx=0 tx=0).stop 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.211+0000 7f32ff661740 1 -- 172.21.15.63:0/3180040476 shutdown_connections 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.211+0000 7f32ff661740 1 --2- 172.21.15.63:0/3180040476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623028cf0 0x55f623058ae0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.211+0000 7f32ff661740 1 --2- 172.21.15.63:0/3180040476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f6230585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.211+0000 7f32ff661740 1 --2- 172.21.15.63:0/3180040476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055810 0x55f6230287b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.212+0000 7f32ff661740 1 -- 172.21.15.63:0/3180040476 >> 172.21.15.63:0/3180040476 conn(0x55f62302aa20 msgr2=0x55f6230735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:36.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.212+0000 7f32ff661740 1 -- 172.21.15.63:0/3180040476 shutdown_connections 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.212+0000 7f32ff661740 1 -- 172.21.15.63:0/3180040476 wait complete. 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.212+0000 7f32ff661740 1 -- start start 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.212+0000 7f32ff661740 1 Processor -- start 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.213+0000 7f32ff661740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f623052690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.213+0000 7f32ff661740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055bf0 0x55f62306bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.213+0000 7f32ff661740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623074060 0x55f62305baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32ff661740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62302cfc0 con 0x55f623055810 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32ff661740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622f4ee20 con 0x55f623074060 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32ff661740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f62302c3b0 con 0x55f623055bf0 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32ff661740 10 client.0 _ll_register_callbacks cb 0x55f622f898d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f623052690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f623052690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59736/0 (socket says 172.21.15.63:59736) 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f5e00640 1 -- 172.21.15.63:0/273046108 learned_addr learned my addr 172.21.15.63:0/273046108 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f6800640 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623074060 0x55f62305baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f5400640 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055bf0 0x55f62306bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f5e00640 1 -- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055bf0 msgr2=0x55f62306bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f5e00640 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055bf0 0x55f62306bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f5e00640 1 -- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623074060 msgr2=0x55f62305baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f5e00640 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623074060 0x55f62305baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.214+0000 7f32f5e00640 1 -- 172.21.15.63:0/273046108 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f622ca72d0 con 0x55f623055810 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.215+0000 7f32f5e00640 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f623052690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f32e8041040 tx=0x7f32e8001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d3ca170da497f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.215+0000 7f32d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.215+0000 7f32d6a00640 1 -- 172.21.15.63:0/273046108 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8006d20 con 0x55f623055810 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.215+0000 7f32d6a00640 1 -- 172.21.15.63:0/273046108 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f32e8054e00 con 0x55f623055810 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.215+0000 7f32ff661740 1 -- 172.21.15.63:0/273046108 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32f0055f70 con 0x55f623055810 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.215+0000 7f32d6a00640 1 -- 172.21.15.63:0/273046108 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32e80035f0 con 0x55f623055810 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.215+0000 7f32ff661740 10 client.4839 fetch_fsmap learned FSMap version 9 2024-03-26T06:17:36.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.215+0000 7f32ff661740 1 -- 172.21.15.63:0/273046108 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55f622d716b0 con 0x55f623055810 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.215+0000 7f32d6a00640 1 -- 172.21.15.63:0/273046108 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f0055f70 con 0x55f623055810 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.216+0000 7f32d6a00640 1 -- 172.21.15.63:0/273046108 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f32e8003790 con 0x55f623055810 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.216+0000 7f32ff661740 10 client.4839 fetch_fsmap finished waiting for FSMap version 9 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.216+0000 7f32ff661740 10 client.4839 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.216+0000 7f32ff661740 20 client.4839 populate_metadata read hostname 'smithi063' 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.216+0000 7f32ff661740 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x55f623086b20 0x55f623086f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.216+0000 7f32ff661740 4 client.4839 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.216+0000 7f32ff661740 1 -- 172.21.15.63:0/273046108 --> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f622f9fc30 con 0x55f623086b20 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.216+0000 7f32f5400640 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x55f623086b20 0x55f623086f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.217+0000 7f32f5400640 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x55f623086b20 0x55f623086f00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4254c9190f6b36dd server_cookie=c64afdc3b18bc0e6 in_seq=0 out_seq=0 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.217+0000 7f32d6a00640 10 client.4839 ms_handle_connect on v2:172.21.15.204:6834/135702470 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32d6a00640 1 -- 172.21.15.63:0/273046108 <== mds.0 v2:172.21.15.204:6834/135702470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f622f9fc30 con 0x55f623086b20 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32d6a00640 10 client.4839 handle_command_reply: tid=0 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 client.4839 shutdown 2024-03-26T06:17:36.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 -- 172.21.15.63:0/273046108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 msgr2=0x55f623052690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f623052690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f32e8041040 tx=0x7f32e8001190 comp rx=0 tx=0).stop 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 -- 172.21.15.63:0/273046108 shutdown_connections 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x55f623086b20 0x55f623086f00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623074060 0x55f62305baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623055bf0 0x55f62306bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 --2- 172.21.15.63:0/273046108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f623052690 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 -- 172.21.15.63:0/273046108 >> 172.21.15.63:0/273046108 conn(0x55f623028cf0 msgr2=0x55f623027ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32d6a00640 0 client.4839 ms_handle_reset on v2:172.21.15.204:6834/135702470 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 -- 172.21.15.63:0/273046108 shutdown_connections 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.219+0000 7f32ff661740 1 -- 172.21.15.63:0/273046108 wait complete. 2024-03-26T06:17:36.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.220+0000 7f32ff661740 20 client.4839 trim_cache size 0 max 16384 2024-03-26T06:17:36.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.237+0000 7f32ff661740 1 Processor -- start 2024-03-26T06:17:36.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.237+0000 7f32ff661740 1 -- start start 2024-03-26T06:17:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32ff661740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f62304f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32ff661740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f6230546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32ff661740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623074060 0x55f6230769a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32ff661740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f8200a50 con 0x55f623055810 2024-03-26T06:17:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32ff661740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f81ffe50 con 0x55f623055bf0 2024-03-26T06:17:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32ff661740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f8200450 con 0x55f623074060 2024-03-26T06:17:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f62304f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f62304f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59744/0 (socket says 172.21.15.63:59744) 2024-03-26T06:17:36.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5e00640 1 -- 172.21.15.63:0/1784484462 learned_addr learned my addr 172.21.15.63:0/1784484462 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5400640 1 --2- 172.21.15.63:0/1784484462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f6230546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5e00640 1 -- 172.21.15.63:0/1784484462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623074060 msgr2=0x55f6230769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5e00640 1 --2- 172.21.15.63:0/1784484462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623074060 0x55f6230769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5e00640 1 -- 172.21.15.63:0/1784484462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 msgr2=0x55f6230546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5e00640 1 --2- 172.21.15.63:0/1784484462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f6230546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5e00640 1 -- 172.21.15.63:0/1784484462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f62306b920 con 0x55f623055810 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.238+0000 7f32f5400640 1 --2- 172.21.15.63:0/1784484462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f6230546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.239+0000 7f32f5e00640 1 --2- 172.21.15.63:0/1784484462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f62304f1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32e8001870 tx=0x7f32e804a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5f90e7c6caf16 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.239+0000 7f32e1c00640 1 -- 172.21.15.63:0/1784484462 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8042040 con 0x55f623055810 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.239+0000 7f32e1c00640 1 -- 172.21.15.63:0/1784484462 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8006da0 con 0x55f623055810 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.239+0000 7f32e1c00640 1 -- 172.21.15.63:0/1784484462 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e803e620 con 0x55f623055810 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.240+0000 7f32ff661740 1 -- 172.21.15.63:0/1784484462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 msgr2=0x55f62304f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.240+0000 7f32ff661740 1 --2- 172.21.15.63:0/1784484462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f62304f1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32e8001870 tx=0x7f32e804a000 comp rx=0 tx=0).stop 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.240+0000 7f32ff661740 1 -- 172.21.15.63:0/1784484462 shutdown_connections 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.240+0000 7f32ff661740 1 --2- 172.21.15.63:0/1784484462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623074060 0x55f6230769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.240+0000 7f32ff661740 1 --2- 172.21.15.63:0/1784484462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f6230546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.240+0000 7f32ff661740 1 --2- 172.21.15.63:0/1784484462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f62304f1a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.240+0000 7f32ff661740 1 -- 172.21.15.63:0/1784484462 >> 172.21.15.63:0/1784484462 conn(0x55f623028cf0 msgr2=0x55f62308cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.240+0000 7f32ff661740 1 -- 172.21.15.63:0/1784484462 shutdown_connections 2024-03-26T06:17:36.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.240+0000 7f32ff661740 1 -- 172.21.15.63:0/1784484462 wait complete. 2024-03-26T06:17:36.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.241+0000 7f32ff661740 1 -- start start 2024-03-26T06:17:36.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.241+0000 7f32ff661740 1 Processor -- start 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32ff661740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f6230de030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32ff661740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f62305a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32ff661740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623074060 0x55f623027650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32ff661740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6230597a0 con 0x55f623055810 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32ff661740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62306a4f0 con 0x55f623055bf0 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32ff661740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f62306b680 con 0x55f623074060 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32ff661740 10 client.0 _ll_register_callbacks cb 0x7f32f0055ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f6230de030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f6230de030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59760/0 (socket says 172.21.15.63:59760) 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.242+0000 7f32f5e00640 1 -- 172.21.15.63:0/3376495575 learned_addr learned my addr 172.21.15.63:0/3376495575 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32f5e00640 1 -- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623074060 msgr2=0x55f623027650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32f5e00640 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623074060 0x55f623027650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32f5e00640 1 -- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 msgr2=0x55f62305a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32f5e00640 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f62305a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32f5e00640 1 -- 172.21.15.63:0/3376495575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f623086690 con 0x55f623055810 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32f5e00640 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f6230de030 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32e8041040 tx=0x7f32e8007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae7da300baf64f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32d6a00640 1 -- 172.21.15.63:0/3376495575 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e806a020 con 0x55f623055810 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32d6a00640 1 -- 172.21.15.63:0/3376495575 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f32e805dd60 con 0x55f623055810 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32ff661740 1 -- 172.21.15.63:0/3376495575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32e8006da0 con 0x55f623055810 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32d6a00640 1 -- 172.21.15.63:0/3376495575 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32e8071050 con 0x55f623055810 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32ff661740 10 client.4845 fetch_fsmap learned FSMap version 9 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.243+0000 7f32ff661740 1 -- 172.21.15.63:0/3376495575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55f62304eaf0 con 0x55f623055810 2024-03-26T06:17:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.244+0000 7f32d6a00640 1 -- 172.21.15.63:0/3376495575 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8006da0 con 0x55f623055810 2024-03-26T06:17:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.244+0000 7f32d6a00640 1 -- 172.21.15.63:0/3376495575 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f32e8074020 con 0x55f623055810 2024-03-26T06:17:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.244+0000 7f32ff661740 10 client.4845 fetch_fsmap finished waiting for FSMap version 9 2024-03-26T06:17:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.244+0000 7f32ff661740 10 client.4845 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-26T06:17:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.244+0000 7f32ff661740 20 client.4845 populate_metadata read hostname 'smithi063' 2024-03-26T06:17:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.244+0000 7f32ff661740 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x55f623027b90 0x55f62302d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.244+0000 7f32ff661740 4 client.4845 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-26T06:17:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.244+0000 7f32ff661740 1 -- 172.21.15.63:0/3376495575 --> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f623029df0 con 0x55f623027b90 2024-03-26T06:17:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.244+0000 7f32f5400640 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x55f623027b90 0x55f62302d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:36.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.245+0000 7f32f5400640 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x55f623027b90 0x55f62302d4b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18523b199c037c78 server_cookie=e83c1e4064df807f in_seq=0 out_seq=0 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.245+0000 7f32d6a00640 10 client.4845 ms_handle_connect on v2:172.21.15.204:6834/135702470 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32d6a00640 1 -- 172.21.15.63:0/3376495575 <== mds.0 v2:172.21.15.204:6834/135702470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55f623029df0 con 0x55f623027b90 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32d6a00640 10 client.4845 handle_command_reply: tid=0 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 client.4845 shutdown 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 -- 172.21.15.63:0/3376495575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 msgr2=0x55f6230de030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f6230de030 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32e8041040 tx=0x7f32e8007c80 comp rx=0 tx=0).stop 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 -- 172.21.15.63:0/3376495575 shutdown_connections 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:6834/135702470,v1:172.21.15.204:6835/135702470] conn(0x55f623027b90 0x55f62302d4b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f623074060 0x55f623027650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f623055bf0 0x55f62305a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 --2- 172.21.15.63:0/3376495575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f623055810 0x55f6230de030 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 -- 172.21.15.63:0/3376495575 >> 172.21.15.63:0/3376495575 conn(0x55f623028cf0 msgr2=0x55f62306cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32d6a00640 0 client.4845 ms_handle_reset on v2:172.21.15.204:6834/135702470 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 -- 172.21.15.63:0/3376495575 shutdown_connections 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.246+0000 7f32ff661740 1 -- 172.21.15.63:0/3376495575 wait complete. 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32ff661740 20 client.4845 trim_cache size 0 max 16384 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "82863fce-9065-4f8e-a61f-944fd870ef74", 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4278, 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-03-26T06:17:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-03-26T06:17:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 37.734983065999998, 2024-03-26T06:17:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 9, 2024-03-26T06:17:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 25, 2024-03-26T06:17:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 25, 2024-03-26T06:17:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 43.065721314999998 2024-03-26T06:17:36.251 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 -- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f32d806bbd0 msgr2=0x7f32d806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f32d806bbd0 0x7f32d806e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f32e8033000 tx=0x7f32e8009030 comp rx=0 tx=0).stop 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 -- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f8153cd0 msgr2=0x7f32f8154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f8153cd0 0x7f32f8154e90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32f8156260 tx=0x7f32f000f520 comp rx=0 tx=0).stop 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 -- 172.21.15.63:0/3448730688 shutdown_connections 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f32d806bbd0 0x7f32d806e090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f8153cd0 0x7f32f8154e90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32f81f44a0 0x7f32f8154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 --2- 172.21.15.63:0/3448730688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32dc0039b0 0x7f32f80b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 -- 172.21.15.63:0/3448730688 >> 172.21.15.63:0/3448730688 conn(0x7f32f80670b0 msgr2=0x7f32f80cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 -- 172.21.15.63:0/3448730688 shutdown_connections 2024-03-26T06:17:36.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:36.247+0000 7f32f7200640 1 -- 172.21.15.63:0/3448730688 wait complete. 2024-03-26T06:17:36.264 INFO:teuthology.run_tasks:Running task kclient... 2024-03-26T06:17:36.279 INFO:tasks.kclient:Mounting kernel clients... 2024-03-26T06:17:36.279 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-26T06:17:36.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:36.279 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-03-26T06:17:36.335 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-26T06:17:36.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:36.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-26T06:17:36.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:36.439 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-03-26T06:17:36.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:36.575 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-03-26T06:17:36.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:36.623 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-03-26T06:17:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-03-26T06:17:36.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T06:17:36.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:36.706 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-26T06:17:36.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:36.766 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-03-26T06:17:36.862 INFO:teuthology.orchestra.run.smithi204.stderr:Cannot find device "ceph-brx" 2024-03-26T06:17:36.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T06:17:36.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:36.867 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-26T06:17:36.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:36.920 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-03-26T06:17:37.015 INFO:teuthology.orchestra.run.smithi204.stderr:Cannot find device "ceph-brx" 2024-03-26T06:17:37.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T06:17:37.019 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-03-26T06:17:37.019 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-26T06:17:37.019 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-26T06:17:37.020 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-26T06:17:37.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.249+0000 7f7523200640 1 Processor -- start 2024-03-26T06:17:37.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.249+0000 7f7523200640 1 -- start start 2024-03-26T06:17:37.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.251+0000 7f7523200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f752406f330 0x7f75240cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:37.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.251+0000 7f7523200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75240cca00 0x7f75240b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:37.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.251+0000 7f7523200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752415a9e0 con 0x7f752415a600 2024-03-26T06:17:37.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.251+0000 7f7523200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752415e1c0 con 0x7f75240cca00 2024-03-26T06:17:37.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.251+0000 7f7523200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752415e4a0 con 0x7f752406f330 2024-03-26T06:17:37.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.251+0000 7f7521e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f752415a600 0x7f752406ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46882/0 (socket says 172.21.15.63:46882) 2024-03-26T06:17:37.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.251+0000 7f7521e00640 1 -- 172.21.15.63:0/207814688 learned_addr learned my addr 172.21.15.63:0/207814688 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:37.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.251+0000 7f7522800640 1 --2- 172.21.15.63:0/207814688 >> v2:172.21.15.63:3300/0 conn(0x7f75240cca00 0x7f75240b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:37.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.252+0000 7f7520a00640 1 -- 172.21.15.63:0/207814688 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262626589 0 0) 0x7f7514001110 con 0x7f752415a600 2024-03-26T06:17:37.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.252+0000 7f7521400640 1 --2- 172.21.15.63:0/207814688 >> v2:172.21.15.204:3300/0 conn(0x7f752406f330 0x7f75240cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:37.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.252+0000 7f7520a00640 1 -- 172.21.15.63:0/207814688 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7508003520 con 0x7f752415a600 2024-03-26T06:17:37.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.252+0000 7f7522800640 1 -- 172.21.15.63:0/207814688 >> v2:172.21.15.204:3300/0 conn(0x7f752406f330 msgr2=0x7f75240cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:37.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.252+0000 7f7522800640 1 --2- 172.21.15.63:0/207814688 >> v2:172.21.15.204:3300/0 conn(0x7f752406f330 0x7f75240cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.252+0000 7f7522800640 1 -- 172.21.15.63:0/207814688 >> v1:172.21.15.63:6789/0 conn(0x7f752415a600 legacy=0x7f752406ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:37.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.252+0000 7f7522800640 1 -- 172.21.15.63:0/207814688 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752415e780 con 0x7f75240cca00 2024-03-26T06:17:37.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.253+0000 7f7522800640 1 --2- 172.21.15.63:0/207814688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 0x7f75240b27d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f75240b2100 tx=0x7f751c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2771f640b8309c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:37.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.253+0000 7f7520a00640 1 -- 172.21.15.63:0/207814688 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c039070 con 0x7f75240cca00 2024-03-26T06:17:37.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.253+0000 7f7520a00640 1 -- 172.21.15.63:0/207814688 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c02cc80 con 0x7f75240cca00 2024-03-26T06:17:37.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.253+0000 7f7520a00640 1 -- 172.21.15.63:0/207814688 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c034660 con 0x7f75240cca00 2024-03-26T06:17:37.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.254+0000 7f7523200640 1 -- 172.21.15.63:0/207814688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 msgr2=0x7f75240b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:37.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.254+0000 7f7523200640 1 --2- 172.21.15.63:0/207814688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 0x7f75240b27d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f75240b2100 tx=0x7f751c02bed0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.254+0000 7f7523200640 1 -- 172.21.15.63:0/207814688 shutdown_connections 2024-03-26T06:17:37.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.254+0000 7f7523200640 1 --2- 172.21.15.63:0/207814688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 0x7f75240b27d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.254+0000 7f7523200640 1 --2- 172.21.15.63:0/207814688 >> v2:172.21.15.204:3300/0 conn(0x7f752406f330 0x7f75240cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.254+0000 7f7523200640 1 -- 172.21.15.63:0/207814688 >> 172.21.15.63:0/207814688 conn(0x7f75240b13d0 msgr2=0x7f75240b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:37.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.254+0000 7f7523200640 1 -- 172.21.15.63:0/207814688 shutdown_connections 2024-03-26T06:17:37.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.254+0000 7f7523200640 1 -- 172.21.15.63:0/207814688 wait complete. 2024-03-26T06:17:37.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.256+0000 7f7523200640 1 Processor -- start 2024-03-26T06:17:37.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.256+0000 7f7523200640 1 -- start start 2024-03-26T06:17:37.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.257+0000 7f7523200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f752406f330 0x7f7524148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:37.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.257+0000 7f7523200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 0x7f7524158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:37.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.257+0000 7f7523200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f752415a600 0x7f7524159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:37.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.257+0000 7f7523200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75240cce90 con 0x7f75240cca00 2024-03-26T06:17:37.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.257+0000 7f7523200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752415ed40 con 0x7f752406f330 2024-03-26T06:17:37.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.257+0000 7f7523200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7524150d80 con 0x7f752415a600 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.257+0000 7f7521400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 0x7f7524158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.257+0000 7f7521400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 0x7f7524158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59772/0 (socket says 172.21.15.63:59772) 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.257+0000 7f7521400640 1 -- 172.21.15.63:0/3183971797 learned_addr learned my addr 172.21.15.63:0/3183971797 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f7521e00640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f752406f330 0x7f7524148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f7522800640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f752415a600 0x7f7524159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f7521400640 1 -- 172.21.15.63:0/3183971797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f752415a600 msgr2=0x7f7524159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f7521400640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f752415a600 0x7f7524159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f7521400640 1 -- 172.21.15.63:0/3183971797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f752406f330 msgr2=0x7f7524148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f7521400640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f752406f330 0x7f7524148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f7521400640 1 -- 172.21.15.63:0/3183971797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524151000 con 0x7f75240cca00 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f7521400640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 0x7f7524158c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f751000d830 tx=0x7f751000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f751a000640 1 -- 172.21.15.63:0/3183971797 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000b6c0 con 0x7f75240cca00 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f751a000640 1 -- 172.21.15.63:0/3183971797 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7510019070 con 0x7f75240cca00 2024-03-26T06:17:37.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.258+0000 7f751a000640 1 -- 172.21.15.63:0/3183971797 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000ba80 con 0x7f75240cca00 2024-03-26T06:17:37.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.259+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75241549e0 con 0x7f75240cca00 2024-03-26T06:17:37.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.259+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524149450 con 0x7f75240cca00 2024-03-26T06:17:37.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.260+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752404f050 con 0x7f75240cca00 2024-03-26T06:17:37.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.261+0000 7f751a000640 1 -- 172.21.15.63:0/3183971797 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f751000bc20 con 0x7f75240cca00 2024-03-26T06:17:37.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.262+0000 7f751a000640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f750406bbd0 0x7f750406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:37.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.262+0000 7f751a000640 1 -- 172.21.15.63:0/3183971797 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f751008b2a0 con 0x7f75240cca00 2024-03-26T06:17:37.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.262+0000 7f7521e00640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f750406bbd0 0x7f750406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:37.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.263+0000 7f7521e00640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f750406bbd0 0x7f750406e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7514007fd0 tx=0x7f7514009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:37.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.266+0000 7f751a000640 1 -- 172.21.15.63:0/3183971797 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f751001c360 con 0x7f75240cca00 2024-03-26T06:17:37.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.514+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f752406d840 con 0x7f75240cca00 2024-03-26T06:17:37.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.515+0000 7f751a000640 1 -- 172.21.15.63:0/3183971797 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7510059a50 con 0x7f75240cca00 2024-03-26T06:17:37.515 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-26T06:17:37.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f750406bbd0 msgr2=0x7f750406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:37.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f750406bbd0 0x7f750406e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7514007fd0 tx=0x7f7514009040 comp rx=0 tx=0).stop 2024-03-26T06:17:37.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 msgr2=0x7f7524158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:37.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 0x7f7524158c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f751000d830 tx=0x7f751000dcf0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 shutdown_connections 2024-03-26T06:17:37.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f750406bbd0 0x7f750406e090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f752415a600 0x7f7524159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75240cca00 0x7f7524158c40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 --2- 172.21.15.63:0/3183971797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f752406f330 0x7f7524148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:37.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.517+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 >> 172.21.15.63:0/3183971797 conn(0x7f75240b13d0 msgr2=0x7f752406e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:37.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.518+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 shutdown_connections 2024-03-26T06:17:37.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:37.518+0000 7f7523200640 1 -- 172.21.15.63:0/3183971797 wait complete. 2024-03-26T06:17:37.538 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-26T06:17:37.538 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-26T06:17:37.538 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-03-26T06:17:37.538 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-26T06:17:37.538 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-26T06:17:37.538 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-26T06:17:37.538 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-26T06:17:37.538 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-26T06:17:37.538 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-26T06:17:37.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:37.539 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-03-26T06:17:37.593 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:17:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:17:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:17:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-26T06:17:37.595 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42495sec preferred_lft 42495sec 2024-03-26T06:17:37.595 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2024-03-26T06:17:37.595 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:37.595 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-26T06:17:37.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:37.595 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:37.595 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:37.595 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-03-26T06:17:37.595 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-03-26T06:17:37.595 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-03-26T06:17:37.595 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-26T06:17:37.596 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:37.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:37.838 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-26T06:17:37.922 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-03-26T06:17:37.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:37.926 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-03-26T06:17:37.979 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-03-26T06:17:37.979 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-26T06:17:37.979 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-26T06:17:37.979 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-26T06:17:37.979 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-26T06:17:37.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:37.980 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:37.980 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:37.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-26T06:17:37.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-26T06:17:37.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-26T06:17:37.980 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:38.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:38.170 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-03-26T06:17:38.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:38.226 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-03-26T06:17:38.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:38.279 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:38.279 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:38.279 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-26T06:17:38.279 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-26T06:17:38.279 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:38.417 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-26T06:17:38.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:38.418 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:38.418 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:38.418 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-26T06:17:38.418 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-26T06:17:38.418 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-26T06:17:38.418 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-26T06:17:38.418 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-26T06:17:38.418 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:38.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:38.674 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:38.674 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:38.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-03-26T06:17:38.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-03-26T06:17:38.675 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:38.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:38.840 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-26T06:17:38.881 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-26T06:17:38.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:38.882 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-26T06:17:38.972 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-26T06:17:38.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:38.972 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:39.087 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:39.087 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:17:39.774 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:39.775 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:17:39.775 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.204:3300,172.21.15.204:3301" 2024-03-26T06:17:39.775 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 0@82863fce-9065-4f8e-a61f-944fd870ef74.cephfs=/ 2024-03-26T06:17:39.775 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.63:3300/172.21.15.204:3300/172.21.15.204:3301" will pass to kernel 2024-03-26T06:17:39.778 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-26T06:17:39.778 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-03-26T06:17:39.778 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-26T06:17:39.778 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-03-26T06:17:39.778 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-26T06:17:39.781 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-26T06:17:39.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:39.782 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-26T06:17:39.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:39.851 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:39.898 INFO:teuthology.orchestra.run.smithi063.stdout:client4669 2024-03-26T06:17:39.898 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:17:39.898 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:17:39.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:39.941 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:40.039 INFO:teuthology.orchestra.run.smithi063.stdout:client4669 2024-03-26T06:17:40.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:40.040 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:40.085 INFO:teuthology.orchestra.run.smithi063.stdout:client4669 2024-03-26T06:17:40.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:40.086 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/82863fce-9065-4f8e-a61f-944fd870ef74.client4669/status') 2024-03-26T06:17:40.221 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4669 (3)172.21.15.63:0/3226853939 2024-03-26T06:17:40.221 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2024-03-26T06:17:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2024-03-26T06:17:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2024-03-26T06:17:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:70 bytes copied, 7.1085e-05 s, 985 kB/s 2024-03-26T06:17:40.225 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-03-26T06:17:40.226 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-26T06:17:40.226 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-26T06:17:40.226 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-26T06:17:40.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.444+0000 7feb55200640 1 Processor -- start 2024-03-26T06:17:40.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.444+0000 7feb55200640 1 -- start start 2024-03-26T06:17:40.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.445+0000 7feb55200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb501440a0 0x7feb50071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:40.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.445+0000 7feb55200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb50071930 con 0x7feb5006ebd0 2024-03-26T06:17:40.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.445+0000 7feb55200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb50071c10 con 0x7feb500cce00 2024-03-26T06:17:40.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.445+0000 7feb55200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb500b33f0 con 0x7feb501440a0 2024-03-26T06:17:40.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.446+0000 7feb4e800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7feb5006ebd0 0x7feb500b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46890/0 (socket says 172.21.15.63:46890) 2024-03-26T06:17:40.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.446+0000 7feb4e800640 1 -- 172.21.15.63:0/872863476 learned_addr learned my addr 172.21.15.63:0/872863476 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:40.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.446+0000 7feb4de00640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb501440a0 0x7feb50071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:40.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.446+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122515057 0 0) 0x7feb50071930 con 0x7feb5006ebd0 2024-03-26T06:17:40.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.446+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb34005730 con 0x7feb5006ebd0 2024-03-26T06:17:40.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.446+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718011162 0 0) 0x7feb34005730 con 0x7feb5006ebd0 2024-03-26T06:17:40.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.446+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb501440a0 msgr2=0x7feb50071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:40.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.446+0000 7feb4d400640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb501440a0 0x7feb50071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:40.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.446+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 >> v1:172.21.15.204:6789/0 conn(0x7feb500cce00 legacy=0x7feb5006e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb50071ef0 con 0x7feb5006ebd0 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7feb48001670 con 0x7feb5006ebd0 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 >> v1:172.21.15.63:6789/0 conn(0x7feb5006ebd0 legacy=0x7feb500b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4d400640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb501440a0 0x7feb34005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4d400640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb34006170 0x7feb34006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4d400640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb340073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb500b33f0 con 0x7feb34006f50 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3400dcb0 con 0x7feb34006170 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3400deb0 con 0x7feb501440a0 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4e800640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb340073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4de00640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb501440a0 0x7feb34005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb45400640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb34006170 0x7feb34006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:40.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4e800640 1 -- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb501440a0 msgr2=0x7feb34005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:40.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4e800640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb501440a0 0x7feb34005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:40.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4e800640 1 -- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb34006170 msgr2=0x7feb34006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:40.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4e800640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb34006170 0x7feb34006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:40.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.447+0000 7feb4e800640 1 -- 172.21.15.63:0/872863476 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb34005730 con 0x7feb34006f50 2024-03-26T06:17:40.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.448+0000 7feb45400640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb34006170 0x7feb34006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:40.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.449+0000 7feb4e800640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb340073d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feb4800c240 tx=0x7feb34007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445faf5bba65cfae server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:40.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.449+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48007cf0 con 0x7feb34006f50 2024-03-26T06:17:40.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.449+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb48030070 con 0x7feb34006f50 2024-03-26T06:17:40.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.449+0000 7feb4d400640 1 -- 172.21.15.63:0/872863476 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48005d70 con 0x7feb34006f50 2024-03-26T06:17:40.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.449+0000 7feb55200640 1 -- 172.21.15.63:0/872863476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 msgr2=0x7feb340073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:40.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.449+0000 7feb55200640 1 --2- 172.21.15.63:0/872863476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb340073d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feb4800c240 tx=0x7feb34007a40 comp rx=0 tx=0).stop 2024-03-26T06:17:40.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.449+0000 7feb4e800640 1 -- 172.21.15.63:0/872863476 reap_dead start 2024-03-26T06:17:40.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.450+0000 7feb55200640 1 -- 172.21.15.63:0/872863476 shutdown_connections 2024-03-26T06:17:40.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.450+0000 7feb55200640 1 -- 172.21.15.63:0/872863476 >> 172.21.15.63:0/872863476 conn(0x7feb5006ac90 msgr2=0x7feb5006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:40.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.450+0000 7feb55200640 1 -- 172.21.15.63:0/872863476 shutdown_connections 2024-03-26T06:17:40.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.450+0000 7feb55200640 1 -- 172.21.15.63:0/872863476 wait complete. 2024-03-26T06:17:40.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.451+0000 7feb55200640 1 Processor -- start 2024-03-26T06:17:40.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.452+0000 7feb55200640 1 -- start start 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb55200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb500b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb55200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb500af180 0x7feb500b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb55200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb5013e6d0 0x7feb501f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb55200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb500cd280 con 0x7feb34006f50 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb55200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb50144480 con 0x7feb5013e6d0 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb55200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb500cd400 con 0x7feb500af180 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb4de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb500b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb4de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb500b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59780/0 (socket says 172.21.15.63:59780) 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb4de00640 1 -- 172.21.15.63:0/3229914214 learned_addr learned my addr 172.21.15.63:0/3229914214 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb45400640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb500af180 0x7feb500b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:40.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb4e800640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb5013e6d0 0x7feb501f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:40.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb4de00640 1 -- 172.21.15.63:0/3229914214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb500af180 msgr2=0x7feb500b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:40.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb4de00640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb500af180 0x7feb500b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:40.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb4de00640 1 -- 172.21.15.63:0/3229914214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb5013e6d0 msgr2=0x7feb501f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:40.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb4de00640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb5013e6d0 0x7feb501f6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:40.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.453+0000 7feb4de00640 1 -- 172.21.15.63:0/3229914214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500b0bf0 con 0x7feb34006f50 2024-03-26T06:17:40.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.454+0000 7feb4de00640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb500b06b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feb40007f60 tx=0x7feb40007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:40.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.454+0000 7feb46a00640 1 -- 172.21.15.63:0/3229914214 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4001a020 con 0x7feb34006f50 2024-03-26T06:17:40.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.454+0000 7feb46a00640 1 -- 172.21.15.63:0/3229914214 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40016470 con 0x7feb34006f50 2024-03-26T06:17:40.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.454+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb500af610 con 0x7feb34006f50 2024-03-26T06:17:40.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.454+0000 7feb46a00640 1 -- 172.21.15.63:0/3229914214 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40016860 con 0x7feb34006f50 2024-03-26T06:17:40.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.454+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb500afbd0 con 0x7feb34006f50 2024-03-26T06:17:40.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.455+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb50074730 con 0x7feb34006f50 2024-03-26T06:17:40.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.456+0000 7feb46a00640 1 -- 172.21.15.63:0/3229914214 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7feb40005d10 con 0x7feb34006f50 2024-03-26T06:17:40.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.457+0000 7feb46a00640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7feb2c06bc00 0x7feb2c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:40.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.457+0000 7feb46a00640 1 -- 172.21.15.63:0/3229914214 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7feb4008be10 con 0x7feb34006f50 2024-03-26T06:17:40.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.457+0000 7feb45400640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7feb2c06bc00 0x7feb2c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:40.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.458+0000 7feb45400640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7feb2c06bc00 0x7feb2c06e0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feb500add10 tx=0x7feb38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:40.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.462+0000 7feb46a00640 1 -- 172.21.15.63:0/3229914214 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7feb40024030 con 0x7feb34006f50 2024-03-26T06:17:40.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.704+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feb5015a880 con 0x7feb34006f50 2024-03-26T06:17:40.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.705+0000 7feb46a00640 1 -- 172.21.15.63:0/3229914214 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7feb4005a460 con 0x7feb34006f50 2024-03-26T06:17:40.705 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-26T06:17:40.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7feb2c06bc00 msgr2=0x7feb2c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:40.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7feb2c06bc00 0x7feb2c06e0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feb500add10 tx=0x7feb38009040 comp rx=0 tx=0).stop 2024-03-26T06:17:40.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 msgr2=0x7feb500b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:40.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb500b06b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feb40007f60 tx=0x7feb40007f90 comp rx=0 tx=0).stop 2024-03-26T06:17:40.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 shutdown_connections 2024-03-26T06:17:40.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7feb2c06bc00 0x7feb2c06e0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:40.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb5013e6d0 0x7feb501f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:40.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb500af180 0x7feb500b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:40.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 --2- 172.21.15.63:0/3229914214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb34006f50 0x7feb500b06b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:40.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.708+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 >> 172.21.15.63:0/3229914214 conn(0x7feb5006ac90 msgr2=0x7feb5006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:40.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.709+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 shutdown_connections 2024-03-26T06:17:40.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:40.709+0000 7feb55200640 1 -- 172.21.15.63:0/3229914214 wait complete. 2024-03-26T06:17:40.727 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-26T06:17:40.727 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-26T06:17:40.727 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-03-26T06:17:40.727 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-26T06:17:40.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-26T06:17:40.727 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-26T06:17:40.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-26T06:17:40.727 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-26T06:17:40.727 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-26T06:17:40.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:40.728 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-03-26T06:17:40.779 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42491sec preferred_lft 42491sec 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether a6:61:25:fb:2a:e7 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-26T06:17:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::c84a:9ff:fe88:6746/64 scope link 2024-03-26T06:17:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:40.781 INFO:teuthology.orchestra.run.smithi063.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-26T06:17:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether a6:61:25:fb:2a:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-26T06:17:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::a461:25ff:fefb:2ae7/64 scope link 2024-03-26T06:17:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:40.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:40.782 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-26T06:17:40.877 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-03-26T06:17:40.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:40.882 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-03-26T06:17:40.937 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-03-26T06:17:40.937 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-26T06:17:40.938 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-26T06:17:40.938 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-26T06:17:40.938 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-26T06:17:40.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:40.938 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:40.938 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:40.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-26T06:17:40.939 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-26T06:17:40.939 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-26T06:17:40.939 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:41.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:41.129 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-03-26T06:17:41.185 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-26T06:17:41.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:41.186 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-03-26T06:17:41.240 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-26T06:17:41.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:41.241 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:41.241 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:41.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-26T06:17:41.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-26T06:17:41.241 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:41.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:41.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-26T06:17:41.484 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:17:41.484 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:17:41.484 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:17:41.484 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:41.484 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-03-26T06:17:41.484 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:41.485 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-26T06:17:41.485 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether e2:3d:f3:32:31:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-26T06:17:41.485 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-26T06:17:41.485 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:41.485 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::e03d:f3ff:fe32:319f/64 scope link 2024-03-26T06:17:41.485 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:41.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:41.488 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-26T06:17:41.587 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:17:41.587 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:17:41.587 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:17:41.587 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:41.588 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-03-26T06:17:41.588 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:41.588 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-26T06:17:41.588 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether e2:3d:f3:32:31:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-26T06:17:41.588 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-26T06:17:41.588 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:41.588 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::e03d:f3ff:fe32:319f/64 scope link 2024-03-26T06:17:41.588 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:41.592 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-26T06:17:41.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:41.593 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:41.593 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:41.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-26T06:17:41.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-26T06:17:41.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-26T06:17:41.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-26T06:17:41.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-26T06:17:41.593 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:41.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:41.883 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:17:41.883 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:17:41.883 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.1 up 2024-03-26T06:17:41.883 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.1 master ceph-brx 2024-03-26T06:17:41.883 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:17:42.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:42.056 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-26T06:17:42.111 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-26T06:17:42.111 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:42.111 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-26T06:17:42.167 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-03-26T06:17:42.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:42.167 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:42.304 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:42.305 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:17:42.343 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:42.343 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:17:42.343 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.204:3300,172.21.15.204:3301" 2024-03-26T06:17:42.343 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 2@82863fce-9065-4f8e-a61f-944fd870ef74.cephfs=/ 2024-03-26T06:17:42.344 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.63:3300/172.21.15.204:3300/172.21.15.204:3301" will pass to kernel 2024-03-26T06:17:42.345 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-26T06:17:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-03-26T06:17:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-26T06:17:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-03-26T06:17:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-26T06:17:42.353 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-26T06:17:42.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:42.353 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-26T06:17:42.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:42.442 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:42.504 INFO:teuthology.orchestra.run.smithi063.stdout:client4675 2024-03-26T06:17:42.504 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:17:42.504 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:17:42.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:42.559 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:42.619 INFO:teuthology.orchestra.run.smithi063.stdout:client4675 2024-03-26T06:17:42.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:42.620 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:42.672 INFO:teuthology.orchestra.run.smithi063.stdout:client4675 2024-03-26T06:17:42.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:42.672 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/82863fce-9065-4f8e-a61f-944fd870ef74.client4675/status') 2024-03-26T06:17:42.766 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4675 (3)172.21.15.63:0/161214271 2024-03-26T06:17:42.767 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2024-03-26T06:17:42.767 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2024-03-26T06:17:42.767 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2024-03-26T06:17:42.767 INFO:teuthology.orchestra.run.smithi063.stderr:69 bytes copied, 8.0886e-05 s, 853 kB/s 2024-03-26T06:17:42.771 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-03-26T06:17:42.771 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-26T06:17:42.771 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-26T06:17:42.772 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-26T06:17:42.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.996+0000 7f5475400640 1 Processor -- start 2024-03-26T06:17:42.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.996+0000 7f5475400640 1 -- start start 2024-03-26T06:17:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.997+0000 7f5475400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5470071350 0x7f54700717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.997+0000 7f5475400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f54700cc3f0 0x7f54700cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.997+0000 7f5475400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547015bf80 con 0x7f5470145100 2024-03-26T06:17:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.997+0000 7f5475400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54700a86e0 con 0x7f54700cc3f0 2024-03-26T06:17:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.997+0000 7f5475400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5470071cf0 con 0x7f5470071350 2024-03-26T06:17:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.998+0000 7f546e800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5470145100 0x7f547006ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56170/0 (socket says 172.21.15.63:56170) 2024-03-26T06:17:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.998+0000 7f546e800640 1 -- 172.21.15.63:0/2931492033 learned_addr learned my addr 172.21.15.63:0/2931492033 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.998+0000 7f5467e00640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5470071350 0x7f54700717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.998+0000 7f546f200640 1 --2- 172.21.15.63:0/2931492033 >> v2:172.21.15.204:3300/0 conn(0x7f54700cc3f0 0x7f54700cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.998+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316431772 0 0) 0x7f547015bf80 con 0x7f5470145100 2024-03-26T06:17:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.998+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5454003520 con 0x7f5470145100 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 311395861 0 0) 0x7f5454003520 con 0x7f5470145100 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5470071350 msgr2=0x7f54700717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5470071350 0x7f54700717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 >> v2:172.21.15.204:3300/0 conn(0x7f54700cc3f0 msgr2=0x7f54700cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 --2- 172.21.15.63:0/2931492033 >> v2:172.21.15.204:3300/0 conn(0x7f54700cc3f0 0x7f54700cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547006e2f0 con 0x7f5470145100 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f5460001670 con 0x7f5470145100 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 >> v1:172.21.15.63:6789/0 conn(0x7f5470145100 legacy=0x7f547006ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5470071350 0x7f54540039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454003fa0 0x7f5454004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5454004d40 0x7f54540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545400b9c0 con 0x7f5454004d40 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545400bb40 con 0x7f5454003fa0 2024-03-26T06:17:43.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545400bcf0 con 0x7f5470071350 2024-03-26T06:17:43.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:42.999+0000 7f546f200640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5454004d40 0x7f54540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:43.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.000+0000 7f546e800640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5470071350 0x7f54540039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:43.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.000+0000 7f5467e00640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454003fa0 0x7f5454004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:43.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.000+0000 7f546f200640 1 -- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5470071350 msgr2=0x7f54540039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:43.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.000+0000 7f546f200640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5470071350 0x7f54540039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.000+0000 7f546f200640 1 -- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454003fa0 msgr2=0x7f5454004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:43.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.000+0000 7f546f200640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454003fa0 0x7f5454004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.000+0000 7f546f200640 1 -- 172.21.15.63:0/2931492033 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454003520 con 0x7f5454004d40 2024-03-26T06:17:43.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.000+0000 7f546e800640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5470071350 0x7f54540039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:43.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.001+0000 7f546f200640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5454004d40 0x7f54540051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5468009fc0 tx=0x7f5454005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9962aaf7d43f761 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:43.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.001+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468039070 con 0x7f5454004d40 2024-03-26T06:17:43.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.001+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546802cc60 con 0x7f5454004d40 2024-03-26T06:17:43.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.001+0000 7f546de00640 1 -- 172.21.15.63:0/2931492033 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468009c10 con 0x7f5454004d40 2024-03-26T06:17:43.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.002+0000 7f5475400640 1 -- 172.21.15.63:0/2931492033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5454004d40 msgr2=0x7f54540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:43.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.002+0000 7f5475400640 1 --2- 172.21.15.63:0/2931492033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5454004d40 0x7f54540051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5468009fc0 tx=0x7f5454005830 comp rx=0 tx=0).stop 2024-03-26T06:17:43.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.002+0000 7f546f200640 1 -- 172.21.15.63:0/2931492033 reap_dead start 2024-03-26T06:17:43.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.002+0000 7f5475400640 1 -- 172.21.15.63:0/2931492033 shutdown_connections 2024-03-26T06:17:43.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.002+0000 7f5475400640 1 -- 172.21.15.63:0/2931492033 >> 172.21.15.63:0/2931492033 conn(0x7f547006ac90 msgr2=0x7f547006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:43.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.002+0000 7f5475400640 1 -- 172.21.15.63:0/2931492033 shutdown_connections 2024-03-26T06:17:43.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.002+0000 7f5475400640 1 -- 172.21.15.63:0/2931492033 wait complete. 2024-03-26T06:17:43.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.004+0000 7f5475400640 1 Processor -- start 2024-03-26T06:17:43.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.004+0000 7f5475400640 1 -- start start 2024-03-26T06:17:43.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.005+0000 7f5475400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454004d40 0x7f5470140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:43.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.005+0000 7f5475400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f547015e9d0 0x7f5470157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:43.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.005+0000 7f5475400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f547015f540 0x7f547015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:43.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.005+0000 7f5475400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547006dd30 con 0x7f547015f540 2024-03-26T06:17:43.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.005+0000 7f5475400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547006da50 con 0x7f5454004d40 2024-03-26T06:17:43.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.005+0000 7f5475400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547006e010 con 0x7f547015e9d0 2024-03-26T06:17:43.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.005+0000 7f546f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f547015f540 0x7f547015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:43.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.005+0000 7f546f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f547015f540 0x7f547015f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35090/0 (socket says 172.21.15.63:35090) 2024-03-26T06:17:43.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.005+0000 7f546f200640 1 -- 172.21.15.63:0/3427227861 learned_addr learned my addr 172.21.15.63:0/3427227861 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:43.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f5467e00640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f547015e9d0 0x7f5470157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:43.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f546e800640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454004d40 0x7f5470140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f546f200640 1 -- 172.21.15.63:0/3427227861 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f547015e9d0 msgr2=0x7f5470157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f546f200640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f547015e9d0 0x7f5470157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f546f200640 1 -- 172.21.15.63:0/3427227861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454004d40 msgr2=0x7f5470140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f546f200640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454004d40 0x7f5470140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f546f200640 1 -- 172.21.15.63:0/3427227861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547015f220 con 0x7f547015f540 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f546e800640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454004d40 0x7f5470140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f546f200640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f547015f540 0x7f547015f9c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f546800e230 tx=0x7f5468009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f5466a00640 1 -- 172.21.15.63:0/3427227861 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468039030 con 0x7f547015f540 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.006+0000 7f5466a00640 1 -- 172.21.15.63:0/3427227861 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546803a040 con 0x7f547015f540 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.007+0000 7f5466a00640 1 -- 172.21.15.63:0/3427227861 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468003990 con 0x7f547015f540 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.007+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547015ef40 con 0x7f547015f540 2024-03-26T06:17:43.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.007+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54700b2fc0 con 0x7f547015f540 2024-03-26T06:17:43.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.008+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54701454e0 con 0x7f547015f540 2024-03-26T06:17:43.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.009+0000 7f5466a00640 1 -- 172.21.15.63:0/3427227861 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5468045030 con 0x7f547015f540 2024-03-26T06:17:43.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.010+0000 7f5466a00640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f544c06bbd0 0x7f544c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:43.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.010+0000 7f5466a00640 1 -- 172.21.15.63:0/3427227861 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f54680ace40 con 0x7f547015f540 2024-03-26T06:17:43.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.010+0000 7f546e800640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f544c06bbd0 0x7f544c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:43.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.011+0000 7f546e800640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f544c06bbd0 0x7f544c06e090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5460005990 tx=0x7f5460000fb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:43.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.015+0000 7f5466a00640 1 -- 172.21.15.63:0/3427227861 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f54701454e0 con 0x7f547015f540 2024-03-26T06:17:43.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.257+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5470074730 con 0x7f547015f540 2024-03-26T06:17:43.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.258+0000 7f5466a00640 1 -- 172.21.15.63:0/3427227861 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f546804c020 con 0x7f547015f540 2024-03-26T06:17:43.258 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-26T06:17:43.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.260+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f544c06bbd0 msgr2=0x7f544c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:43.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.260+0000 7f5475400640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f544c06bbd0 0x7f544c06e090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5460005990 tx=0x7f5460000fb0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.260+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f547015f540 msgr2=0x7f547015f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:43.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.260+0000 7f5475400640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f547015f540 0x7f547015f9c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f546800e230 tx=0x7f5468009750 comp rx=0 tx=0).stop 2024-03-26T06:17:43.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.260+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 shutdown_connections 2024-03-26T06:17:43.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.260+0000 7f5475400640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f544c06bbd0 0x7f544c06e090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.260+0000 7f5475400640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f547015f540 0x7f547015f9c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.260+0000 7f5475400640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f547015e9d0 0x7f5470157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.261+0000 7f5475400640 1 --2- 172.21.15.63:0/3427227861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5454004d40 0x7f5470140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:43.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.261+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 >> 172.21.15.63:0/3427227861 conn(0x7f547006ac90 msgr2=0x7f547006e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:43.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.261+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 shutdown_connections 2024-03-26T06:17:43.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:43.261+0000 7f5475400640 1 -- 172.21.15.63:0/3427227861 wait complete. 2024-03-26T06:17:43.282 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-26T06:17:43.282 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-26T06:17:43.282 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2024-03-26T06:17:43.282 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-26T06:17:43.282 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-26T06:17:43.282 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-26T06:17:43.283 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-26T06:17:43.283 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-26T06:17:43.283 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-26T06:17:43.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:43.283 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2024-03-26T06:17:43.338 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:17:43.338 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:17:43.338 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:17:43.338 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:43.338 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-03-26T06:17:43.338 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:43.338 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:43.338 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:43.338 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42507sec preferred_lft 42507sec 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link 2024-03-26T06:17:43.339 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:43.339 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-26T06:17:43.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:43.340 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-26T06:17:43.340 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-26T06:17:43.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add name ceph-brx type bridge 2024-03-26T06:17:43.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr flush dev ceph-brx 2024-03-26T06:17:43.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set ceph-brx up 2024-03-26T06:17:43.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-26T06:17:43.340 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-26T06:17:43.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:43.793 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-26T06:17:43.872 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-03-26T06:17:43.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:43.876 DEBUG:teuthology.orchestra.run.smithi204:> route 2024-03-26T06:17:43.924 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2024-03-26T06:17:43.924 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-26T06:17:43.924 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-26T06:17:43.924 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-26T06:17:43.924 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-26T06:17:43.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:43.925 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-26T06:17:43.926 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-26T06:17:43.926 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-26T06:17:43.926 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-26T06:17:43.926 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-26T06:17:43.926 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-26T06:17:44.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:44.657 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-26T06:17:44.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:44.708 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2024-03-26T06:17:44.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:44.757 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-26T06:17:44.757 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-26T06:17:44.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-26T06:17:44.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-26T06:17:44.757 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-26T06:17:44.888 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-26T06:17:44.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:44.888 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-26T06:17:44.888 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-26T06:17:44.889 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-26T06:17:44.889 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-26T06:17:44.889 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-26T06:17:44.889 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-26T06:17:44.889 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-26T06:17:44.889 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-26T06:17:45.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:45.157 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-26T06:17:45.157 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-26T06:17:45.157 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.0 up 2024-03-26T06:17:45.157 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.0 master ceph-brx 2024-03-26T06:17:45.157 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-26T06:17:45.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:45.323 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-26T06:17:45.371 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-26T06:17:45.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:45.372 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-26T06:17:45.416 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-03-26T06:17:45.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:45.417 DEBUG:teuthology.orchestra.run.smithi204:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:45.591 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:45.591 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:17:46.263 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:46.264 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:17:46.264 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.204:3300,172.21.15.204:3301" 2024-03-26T06:17:46.264 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: trying mount with new device syntax: 1@82863fce-9065-4f8e-a61f-944fd870ef74.cephfs=/ 2024-03-26T06:17:46.264 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.63:3300/172.21.15.204:3300/172.21.15.204:3301" will pass to kernel 2024-03-26T06:17:46.268 INFO:teuthology.orchestra.run.smithi204.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-26T06:17:46.268 INFO:teuthology.orchestra.run.smithi204.stdout: You just mounted a file system that supports labels which does not 2024-03-26T06:17:46.268 INFO:teuthology.orchestra.run.smithi204.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-26T06:17:46.268 INFO:teuthology.orchestra.run.smithi204.stdout: applications will generate AVC messages and not be allowed access to 2024-03-26T06:17:46.268 INFO:teuthology.orchestra.run.smithi204.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-26T06:17:46.272 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-26T06:17:46.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:46.272 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-26T06:17:46.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:46.360 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:46.414 INFO:teuthology.orchestra.run.smithi204.stdout:client4529 2024-03-26T06:17:46.415 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:17:46.415 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:17:46.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:46.464 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:46.567 INFO:teuthology.orchestra.run.smithi204.stdout:client4529 2024-03-26T06:17:46.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:46.568 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:46.618 INFO:teuthology.orchestra.run.smithi204.stdout:client4529 2024-03-26T06:17:46.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:46.619 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/82863fce-9065-4f8e-a61f-944fd870ef74.client4529/status') 2024-03-26T06:17:46.698 INFO:teuthology.orchestra.run.smithi204.stdout:instance: client.4529 (3)192.168.0.1:0/2696793634 2024-03-26T06:17:46.698 INFO:teuthology.orchestra.run.smithi204.stdout:blocklisted: false 2024-03-26T06:17:46.698 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2024-03-26T06:17:46.698 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2024-03-26T06:17:46.699 INFO:teuthology.orchestra.run.smithi204.stderr:69 bytes copied, 7.0352e-05 s, 981 kB/s 2024-03-26T06:17:46.702 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-03-26T06:17:46.702 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-26T06:17:46.702 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-26T06:17:46.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-26T06:17:46.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.935+0000 7f26c3e00640 1 Processor -- start 2024-03-26T06:17:46.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.936+0000 7f26c3e00640 1 -- start start 2024-03-26T06:17:46.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.937+0000 7f26c3e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26c415d9a0 0x7f26c40b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:46.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.937+0000 7f26c3e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40cec20 0x7f26c40b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:46.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.937+0000 7f26c3e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c40b97c0 con 0x7f26c40d1c10 2024-03-26T06:17:46.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.937+0000 7f26c3e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40d21b0 con 0x7f26c415d9a0 2024-03-26T06:17:46.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.937+0000 7f26c3e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40d2490 con 0x7f26c40cec20 2024-03-26T06:17:46.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c2a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26c415d9a0 0x7f26c40b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:46.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c2000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f26c40d1c10 0x7f26c40ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56182/0 (socket says 172.21.15.63:56182) 2024-03-26T06:17:46.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c2000640 1 -- 172.21.15.63:0/3837909192 learned_addr learned my addr 172.21.15.63:0/3837909192 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:46.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c3400640 1 --2- 172.21.15.63:0/3837909192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40cec20 0x7f26c40b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:46.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c1600640 1 -- 172.21.15.63:0/3837909192 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425623169 0 0) 0x7f26c40b97c0 con 0x7f26c40d1c10 2024-03-26T06:17:46.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c1600640 1 -- 172.21.15.63:0/3837909192 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a8003520 con 0x7f26c40d1c10 2024-03-26T06:17:46.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c2a00640 1 -- 172.21.15.63:0/3837909192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40cec20 msgr2=0x7f26c40b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:46.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c2a00640 1 --2- 172.21.15.63:0/3837909192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40cec20 0x7f26c40b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:46.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c2a00640 1 -- 172.21.15.63:0/3837909192 >> v1:172.21.15.63:6789/0 conn(0x7f26c40d1c10 legacy=0x7f26c40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:46.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c2a00640 1 -- 172.21.15.63:0/3837909192 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40d2770 con 0x7f26c415d9a0 2024-03-26T06:17:46.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.938+0000 7f26c3400640 1 --2- 172.21.15.63:0/3837909192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40cec20 0x7f26c40b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.939+0000 7f26c2a00640 1 --2- 172.21.15.63:0/3837909192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 0x7f26c40b9280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009d90 tx=0x7f26b402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379d329104518d42 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.940+0000 7f26c1600640 1 -- 172.21.15.63:0/3837909192 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4039070 con 0x7f26c415d9a0 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.940+0000 7f26c1600640 1 -- 172.21.15.63:0/3837909192 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b402cc50 con 0x7f26c415d9a0 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.940+0000 7f26c1600640 1 -- 172.21.15.63:0/3837909192 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4034440 con 0x7f26c415d9a0 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.940+0000 7f26c3e00640 1 -- 172.21.15.63:0/3837909192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 msgr2=0x7f26c40b9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.940+0000 7f26c3e00640 1 --2- 172.21.15.63:0/3837909192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 0x7f26c40b9280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009d90 tx=0x7f26b402bea0 comp rx=0 tx=0).stop 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.941+0000 7f26c3e00640 1 -- 172.21.15.63:0/3837909192 shutdown_connections 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.941+0000 7f26c3e00640 1 --2- 172.21.15.63:0/3837909192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40cec20 0x7f26c40b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.941+0000 7f26c3e00640 1 --2- 172.21.15.63:0/3837909192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 0x7f26c40b9280 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.941+0000 7f26c3e00640 1 -- 172.21.15.63:0/3837909192 >> 172.21.15.63:0/3837909192 conn(0x7f26c406bfa0 msgr2=0x7f26c406c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.941+0000 7f26c3e00640 1 -- 172.21.15.63:0/3837909192 shutdown_connections 2024-03-26T06:17:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.941+0000 7f26c3e00640 1 -- 172.21.15.63:0/3837909192 wait complete. 2024-03-26T06:17:46.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.942+0000 7f26c3e00640 1 Processor -- start 2024-03-26T06:17:46.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.943+0000 7f26c3e00640 1 -- start start 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.943+0000 7f26c3e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26c40cec20 0x7f26c40ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40d1c10 0x7f26c40b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 0x7f26c40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c415dd80 con 0x7f26c415d9a0 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40d2d30 con 0x7f26c40cec20 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40d3250 con 0x7f26c40d1c10 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 0x7f26c40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 0x7f26c40b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35110/0 (socket says 172.21.15.63:35110) 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3400640 1 -- 172.21.15.63:0/568613082 learned_addr learned my addr 172.21.15.63:0/568613082 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c2a00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26c40cec20 0x7f26c40ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c2000640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40d1c10 0x7f26c40b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3400640 1 -- 172.21.15.63:0/568613082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40d1c10 msgr2=0x7f26c40b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3400640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40d1c10 0x7f26c40b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:46.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3400640 1 -- 172.21.15.63:0/568613082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26c40cec20 msgr2=0x7f26c40ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:46.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3400640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26c40cec20 0x7f26c40ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:46.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c3400640 1 -- 172.21.15.63:0/568613082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c415e150 con 0x7f26c415d9a0 2024-03-26T06:17:46.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.944+0000 7f26c2a00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26c40cec20 0x7f26c40ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:46.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.945+0000 7f26c3400640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 0x7f26c40b5bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e7e0 tx=0x7f26bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:46.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.945+0000 7f26baa00640 1 -- 172.21.15.63:0/568613082 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00f040 con 0x7f26c415d9a0 2024-03-26T06:17:46.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.945+0000 7f26baa00640 1 -- 172.21.15.63:0/568613082 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc004030 con 0x7f26c415d9a0 2024-03-26T06:17:46.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.945+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c40cc410 con 0x7f26c415d9a0 2024-03-26T06:17:46.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.945+0000 7f26baa00640 1 -- 172.21.15.63:0/568613082 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0043e0 con 0x7f26c415d9a0 2024-03-26T06:17:46.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.945+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c40cc9d0 con 0x7f26c415d9a0 2024-03-26T06:17:46.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.947+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c40ccbd0 con 0x7f26c415d9a0 2024-03-26T06:17:46.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.947+0000 7f26baa00640 1 -- 172.21.15.63:0/568613082 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f26bc00c6d0 con 0x7f26c415d9a0 2024-03-26T06:17:46.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.948+0000 7f26baa00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f26a406bbd0 0x7f26a406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:46.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.949+0000 7f26baa00640 1 -- 172.21.15.63:0/568613082 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f26bc08ab80 con 0x7f26c415d9a0 2024-03-26T06:17:46.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.949+0000 7f26c2a00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f26a406bbd0 0x7f26a406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:46.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.950+0000 7f26c2a00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f26a406bbd0 0x7f26a406e090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f26b4036000 tx=0x7f26b4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:46.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:46.953+0000 7f26baa00640 1 -- 172.21.15.63:0/568613082 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f26c40ccbd0 con 0x7f26c415d9a0 2024-03-26T06:17:47.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.197+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f26c404f050 con 0x7f26c415d9a0 2024-03-26T06:17:47.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.198+0000 7f26baa00640 1 -- 172.21.15.63:0/568613082 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f26bc017020 con 0x7f26c415d9a0 2024-03-26T06:17:47.198 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-26T06:17:47.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.200+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f26a406bbd0 msgr2=0x7f26a406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:47.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.200+0000 7f26c3e00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f26a406bbd0 0x7f26a406e090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f26b4036000 tx=0x7f26b4030000 comp rx=0 tx=0).stop 2024-03-26T06:17:47.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.200+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 msgr2=0x7f26c40b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:47.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.200+0000 7f26c3e00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 0x7f26c40b5bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e7e0 tx=0x7f26bc00eca0 comp rx=0 tx=0).stop 2024-03-26T06:17:47.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.201+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 shutdown_connections 2024-03-26T06:17:47.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.201+0000 7f26c3e00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f26a406bbd0 0x7f26a406e090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:47.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.201+0000 7f26c3e00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26c415d9a0 0x7f26c40b5bf0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:47.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.201+0000 7f26c3e00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26c40d1c10 0x7f26c40b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:47.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.201+0000 7f26c3e00640 1 --2- 172.21.15.63:0/568613082 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26c40cec20 0x7f26c40ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:47.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.201+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 >> 172.21.15.63:0/568613082 conn(0x7f26c406bfa0 msgr2=0x7f26c40d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:47.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.201+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 shutdown_connections 2024-03-26T06:17:47.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:47.201+0000 7f26c3e00640 1 -- 172.21.15.63:0/568613082 wait complete. 2024-03-26T06:17:47.222 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-26T06:17:47.222 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-26T06:17:47.222 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2024-03-26T06:17:47.222 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-26T06:17:47.222 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-26T06:17:47.222 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-26T06:17:47.222 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-26T06:17:47.222 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-26T06:17:47.222 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-26T06:17:47.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:47.223 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2024-03-26T06:17:47.281 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:17:47.281 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:17:47.281 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-26T06:17:47.282 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42503sec preferred_lft 42503sec 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether d2:62:5e:0a:91:71 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::2882:78ff:fe2e:10c3/64 scope link 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether d2:62:5e:0a:91:71 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::d062:5eff:fe0a:9171/64 scope link 2024-03-26T06:17:47.283 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:47.284 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-26T06:17:47.375 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-03-26T06:17:47.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:47.380 DEBUG:teuthology.orchestra.run.smithi204:> route 2024-03-26T06:17:47.434 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2024-03-26T06:17:47.434 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-26T06:17:47.434 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-26T06:17:47.434 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-26T06:17:47.434 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-26T06:17:47.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:47.435 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-26T06:17:47.435 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-26T06:17:47.435 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-26T06:17:47.435 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-26T06:17:47.435 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-26T06:17:47.435 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-26T06:17:47.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:47.615 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-26T06:17:47.665 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-26T06:17:47.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:47.667 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2024-03-26T06:17:47.718 INFO:teuthology.orchestra.run.smithi204.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-26T06:17:47.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:47.719 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-26T06:17:47.719 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-26T06:17:47.719 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-26T06:17:47.719 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-26T06:17:47.719 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-26T06:17:47.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:47.856 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-26T06:17:47.945 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:17:47.946 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:17:47.946 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:17:47.946 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:17:47.946 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.946 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-03-26T06:17:47.947 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.947 INFO:teuthology.orchestra.run.smithi204.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-26T06:17:47.947 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0e:10:b9:9c:cc:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-26T06:17:47.947 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-26T06:17:47.947 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.947 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::c10:b9ff:fe9c:cce5/64 scope link 2024-03-26T06:17:47.947 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:47.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:47.951 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-26T06:17:47.954 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:17:48.040 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:17:48.040 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:17:48.040 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:17:48.040 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:48.040 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-03-26T06:17:48.041 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:48.041 INFO:teuthology.orchestra.run.smithi204.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-26T06:17:48.041 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0e:10:b9:9c:cc:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-26T06:17:48.041 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-26T06:17:48.041 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:48.041 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::c10:b9ff:fe9c:cce5/64 scope link 2024-03-26T06:17:48.041 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:17:48.043 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-26T06:17:48.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:48.043 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-26T06:17:48.043 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-26T06:17:48.043 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-26T06:17:48.043 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-26T06:17:48.044 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-26T06:17:48.044 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-26T06:17:48.044 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-26T06:17:48.044 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-26T06:17:48.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:48.333 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-26T06:17:48.333 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-26T06:17:48.333 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.1 up 2024-03-26T06:17:48.333 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.1 master ceph-brx 2024-03-26T06:17:48.333 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-26T06:17:48.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:48.494 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-26T06:17:48.536 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-26T06:17:48.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:17:48.536 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-26T06:17:48.620 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-03-26T06:17:48.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:48.621 DEBUG:teuthology.orchestra.run.smithi204:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:48.776 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:48.776 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:17:48.808 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:17:48.808 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:17:48.808 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.204:3300,172.21.15.204:3301" 2024-03-26T06:17:48.808 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: trying mount with new device syntax: 3@82863fce-9065-4f8e-a61f-944fd870ef74.cephfs=/ 2024-03-26T06:17:48.808 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.63:3300/172.21.15.204:3300/172.21.15.204:3301" will pass to kernel 2024-03-26T06:17:48.811 INFO:teuthology.orchestra.run.smithi204.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-26T06:17:48.812 INFO:teuthology.orchestra.run.smithi204.stdout: You just mounted a file system that supports labels which does not 2024-03-26T06:17:48.812 INFO:teuthology.orchestra.run.smithi204.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-26T06:17:48.812 INFO:teuthology.orchestra.run.smithi204.stdout: applications will generate AVC messages and not be allowed access to 2024-03-26T06:17:48.812 INFO:teuthology.orchestra.run.smithi204.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-26T06:17:48.816 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-26T06:17:48.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:48.816 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-26T06:17:48.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:48.891 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:48.942 INFO:teuthology.orchestra.run.smithi204.stdout:client4681 2024-03-26T06:17:48.942 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:17:48.943 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:17:48.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:48.987 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:49.073 INFO:teuthology.orchestra.run.smithi204.stdout:client4681 2024-03-26T06:17:49.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:49.074 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:17:49.165 INFO:teuthology.orchestra.run.smithi204.stdout:client4681 2024-03-26T06:17:49.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:17:49.165 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/82863fce-9065-4f8e-a61f-944fd870ef74.client4681/status') 2024-03-26T06:17:49.248 INFO:teuthology.orchestra.run.smithi204.stdout:instance: client.4681 (3)192.168.0.2:0/222479617 2024-03-26T06:17:49.248 INFO:teuthology.orchestra.run.smithi204.stdout:blocklisted: false 2024-03-26T06:17:49.248 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2024-03-26T06:17:49.248 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2024-03-26T06:17:49.249 INFO:teuthology.orchestra.run.smithi204.stderr:68 bytes copied, 6.1351e-05 s, 1.1 MB/s 2024-03-26T06:17:49.252 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-26T06:17:49.340 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:49.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.566+0000 7fc184000640 1 Processor -- start 2024-03-26T06:17:49.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.566+0000 7fc184000640 1 -- start start 2024-03-26T06:17:49.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.568+0000 7fc184000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc17c145100 0x7fc17c06ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:49.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.568+0000 7fc184000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c15bf80 con 0x7fc17c071a60 2024-03-26T06:17:49.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.568+0000 7fc184000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c06e2f0 con 0x7fc17c06ef70 2024-03-26T06:17:49.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.568+0000 7fc184000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c0a86e0 con 0x7fc17c145100 2024-03-26T06:17:49.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.568+0000 7fc181600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc17c145100 0x7fc17c06ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:49.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.569+0000 7fc181600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc17c145100 0x7fc17c06ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35122/0 (socket says 172.21.15.63:35122) 2024-03-26T06:17:49.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.569+0000 7fc181600640 1 -- 172.21.15.63:0/74224688 learned_addr learned my addr 172.21.15.63:0/74224688 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:49.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.569+0000 7fc181600640 1 -- 172.21.15.63:0/74224688 >> v1:172.21.15.204:6789/0 conn(0x7fc17c06ef70 legacy=0x7fc17c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:49.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.569+0000 7fc181600640 1 -- 172.21.15.63:0/74224688 >> v1:172.21.15.63:6789/0 conn(0x7fc17c071a60 legacy=0x7fc17c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:49.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.569+0000 7fc181600640 1 -- 172.21.15.63:0/74224688 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c06d770 con 0x7fc17c145100 2024-03-26T06:17:49.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.570+0000 7fc181600640 1 --2- 172.21.15.63:0/74224688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c145100 0x7fc17c06ea30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc170009870 tx=0x7fc17002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c722119f7ee1135b server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:49.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc17be00640 1 -- 172.21.15.63:0/74224688 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17002f850 con 0x7fc17c145100 2024-03-26T06:17:49.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc17be00640 1 -- 172.21.15.63:0/74224688 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17002f9f0 con 0x7fc17c145100 2024-03-26T06:17:49.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc17be00640 1 -- 172.21.15.63:0/74224688 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17002fdc0 con 0x7fc17c145100 2024-03-26T06:17:49.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc184000640 1 -- 172.21.15.63:0/74224688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c145100 msgr2=0x7fc17c06ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:49.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc184000640 1 --2- 172.21.15.63:0/74224688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c145100 0x7fc17c06ea30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc170009870 tx=0x7fc17002ba30 comp rx=0 tx=0).stop 2024-03-26T06:17:49.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc184000640 1 -- 172.21.15.63:0/74224688 shutdown_connections 2024-03-26T06:17:49.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc184000640 1 --2- 172.21.15.63:0/74224688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c145100 0x7fc17c06ea30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:49.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc184000640 1 -- 172.21.15.63:0/74224688 >> 172.21.15.63:0/74224688 conn(0x7fc17c06ac90 msgr2=0x7fc17c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:49.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc184000640 1 -- 172.21.15.63:0/74224688 shutdown_connections 2024-03-26T06:17:49.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.571+0000 7fc184000640 1 -- 172.21.15.63:0/74224688 wait complete. 2024-03-26T06:17:49.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.573+0000 7fc184000640 1 Processor -- start 2024-03-26T06:17:49.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.573+0000 7fc184000640 1 -- start start 2024-03-26T06:17:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.574+0000 7fc184000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c06ef70 0x7fc17c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.574+0000 7fc184000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc17c071a60 0x7fc17c1e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.574+0000 7fc184000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc17c145100 0x7fc17c1e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.574+0000 7fc184000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c06e010 con 0x7fc17c06ef70 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.574+0000 7fc184000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c06dd30 con 0x7fc17c071a60 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.574+0000 7fc184000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1454e0 con 0x7fc17c145100 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc181600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c06ef70 0x7fc17c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc181600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c06ef70 0x7fc17c0b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35138/0 (socket says 172.21.15.63:35138) 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc181600640 1 -- 172.21.15.63:0/3094036361 learned_addr learned my addr 172.21.15.63:0/3094036361 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc180c00640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc17c071a60 0x7fc17c1e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc182000640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc17c145100 0x7fc17c1e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc181600640 1 -- 172.21.15.63:0/3094036361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc17c145100 msgr2=0x7fc17c1e84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc181600640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc17c145100 0x7fc17c1e84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc181600640 1 -- 172.21.15.63:0/3094036361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc17c071a60 msgr2=0x7fc17c1e7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc181600640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc17c071a60 0x7fc17c1e7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc181600640 1 -- 172.21.15.63:0/3094036361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c1f3a80 con 0x7fc17c06ef70 2024-03-26T06:17:49.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.575+0000 7fc182000640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc17c145100 0x7fc17c1e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:49.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.576+0000 7fc181600640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c06ef70 0x7fc17c0b3db0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc170000c00 tx=0x7fc170004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:49.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.576+0000 7fc179600640 1 -- 172.21.15.63:0/3094036361 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17002f840 con 0x7fc17c06ef70 2024-03-26T06:17:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.576+0000 7fc179600640 1 -- 172.21.15.63:0/3094036361 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc170046070 con 0x7fc17c06ef70 2024-03-26T06:17:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.576+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c1f3d60 con 0x7fc17c06ef70 2024-03-26T06:17:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.576+0000 7fc179600640 1 -- 172.21.15.63:0/3094036361 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170041620 con 0x7fc17c06ef70 2024-03-26T06:17:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.576+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c1f4320 con 0x7fc17c06ef70 2024-03-26T06:17:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.577+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c074730 con 0x7fc17c06ef70 2024-03-26T06:17:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.578+0000 7fc179600640 1 -- 172.21.15.63:0/3094036361 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc170040070 con 0x7fc17c06ef70 2024-03-26T06:17:49.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.579+0000 7fc179600640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc15c06bd70 0x7fc15c06e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:49.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.579+0000 7fc179600640 1 -- 172.21.15.63:0/3094036361 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc1700ad6a0 con 0x7fc17c06ef70 2024-03-26T06:17:49.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.579+0000 7fc180c00640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc15c06bd70 0x7fc15c06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:49.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.580+0000 7fc180c00640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc15c06bd70 0x7fc15c06e230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc17c1603b0 tx=0x7fc168009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.584+0000 7fc179600640 1 -- 172.21.15.63:0/3094036361 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc170033030 con 0x7fc17c06ef70 2024-03-26T06:17:49.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.785+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc17c0b05e0 con 0x7fc17c06ef70 2024-03-26T06:17:49.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.788+0000 7fc179600640 1 -- 172.21.15.63:0/3094036361 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7fc17007be20 con 0x7fc17c06ef70 2024-03-26T06:17:49.790 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:49.790 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.790+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc15c06bd70 msgr2=0x7fc15c06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.790+0000 7fc184000640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc15c06bd70 0x7fc15c06e230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc17c1603b0 tx=0x7fc168009040 comp rx=0 tx=0).stop 2024-03-26T06:17:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c06ef70 msgr2=0x7fc17c0b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c06ef70 0x7fc17c0b3db0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc170000c00 tx=0x7fc170004730 comp rx=0 tx=0).stop 2024-03-26T06:17:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 shutdown_connections 2024-03-26T06:17:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc15c06bd70 0x7fc15c06e230 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc17c145100 0x7fc17c1e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc17c071a60 0x7fc17c1e7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 --2- 172.21.15.63:0/3094036361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c06ef70 0x7fc17c0b3db0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:49.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 >> 172.21.15.63:0/3094036361 conn(0x7fc17c06ac90 msgr2=0x7fc17c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:49.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 shutdown_connections 2024-03-26T06:17:49.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:49.791+0000 7fc184000640 1 -- 172.21.15.63:0/3094036361 wait complete. 2024-03-26T06:17:49.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:17:49.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:17:50.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.038+0000 7f8fcd000640 1 Processor -- start 2024-03-26T06:17:50.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.038+0000 7f8fcd000640 1 -- start start 2024-03-26T06:17:50.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.040+0000 7f8fcd000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fc815dd30 0x7f8fc815ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.040+0000 7f8fcd000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc80cfc40 0x7f8fc80cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.040+0000 7f8fcd000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc815e890 con 0x7f8fc815e410 2024-03-26T06:17:50.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.040+0000 7f8fcd000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc80cd530 con 0x7f8fc815dd30 2024-03-26T06:17:50.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.040+0000 7f8fcd000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc815f3b0 con 0x7f8fc80cfc40 2024-03-26T06:17:50.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.040+0000 7f8fc5400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8fc815e410 0x7f8fc80cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56206/0 (socket says 172.21.15.63:56206) 2024-03-26T06:17:50.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.040+0000 7f8fc5400640 1 -- 172.21.15.63:0/903108412 learned_addr learned my addr 172.21.15.63:0/903108412 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc6800640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc80cfc40 0x7f8fc80cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc5e00640 1 --2- 172.21.15.63:0/903108412 >> v2:172.21.15.204:3300/0 conn(0x7f8fc815dd30 0x7f8fc815ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457019751 0 0) 0x7f8fb4001110 con 0x7f8fc815e410 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fac003520 con 0x7f8fc815e410 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2135900452 0 0) 0x7f8fac003520 con 0x7f8fc815e410 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc80cfc40 msgr2=0x7f8fc80cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc80cfc40 0x7f8fc80cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 >> v2:172.21.15.204:3300/0 conn(0x7f8fc815dd30 msgr2=0x7f8fc815ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 --2- 172.21.15.63:0/903108412 >> v2:172.21.15.204:3300/0 conn(0x7f8fc815dd30 0x7f8fc815ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc815c420 con 0x7f8fc815e410 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f8fb4001840 con 0x7f8fc815e410 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 >> v1:172.21.15.63:6789/0 conn(0x7f8fc815e410 legacy=0x7f8fc80cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc80cfc40 0x7f8fac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fac003f30 0x7f8fac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fac004d40 0x7f8fac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc815f3b0 con 0x7f8fac004d40 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac00b9c0 con 0x7f8fac003f30 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac00bb90 con 0x7f8fc80cfc40 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.041+0000 7f8fc6800640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fac004d40 0x7f8fac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.042+0000 7f8fc5e00640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc80cfc40 0x7f8fac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.042+0000 7f8fc5400640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fac003f30 0x7f8fac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.042+0000 7f8fc6800640 1 -- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc80cfc40 msgr2=0x7f8fac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.042+0000 7f8fc6800640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc80cfc40 0x7f8fac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.042+0000 7f8fc6800640 1 -- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fac003f30 msgr2=0x7f8fac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.042+0000 7f8fc6800640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fac003f30 0x7f8fac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.042+0000 7f8fc6800640 1 -- 172.21.15.63:0/903108412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac003520 con 0x7f8fac004d40 2024-03-26T06:17:50.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.042+0000 7f8fc5400640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fac003f30 0x7f8fac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:50.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.043+0000 7f8fc6800640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fac004d40 0x7f8fac0051c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0007330 tx=0x7f8fac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1669216646ad33a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:50.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.043+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0039070 con 0x7f8fac004d40 2024-03-26T06:17:50.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.043+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc002cca0 con 0x7f8fac004d40 2024-03-26T06:17:50.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.043+0000 7f8fc4a00640 1 -- 172.21.15.63:0/903108412 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0009be0 con 0x7f8fac004d40 2024-03-26T06:17:50.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.044+0000 7f8fcd000640 1 -- 172.21.15.63:0/903108412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fac004d40 msgr2=0x7f8fac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.044+0000 7f8fcd000640 1 --2- 172.21.15.63:0/903108412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fac004d40 0x7f8fac0051c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0007330 tx=0x7f8fac005830 comp rx=0 tx=0).stop 2024-03-26T06:17:50.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.044+0000 7f8fc6800640 1 -- 172.21.15.63:0/903108412 reap_dead start 2024-03-26T06:17:50.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.044+0000 7f8fcd000640 1 -- 172.21.15.63:0/903108412 shutdown_connections 2024-03-26T06:17:50.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.044+0000 7f8fcd000640 1 -- 172.21.15.63:0/903108412 >> 172.21.15.63:0/903108412 conn(0x7f8fc806ac90 msgr2=0x7f8fc806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:50.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.044+0000 7f8fcd000640 1 -- 172.21.15.63:0/903108412 shutdown_connections 2024-03-26T06:17:50.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.044+0000 7f8fcd000640 1 -- 172.21.15.63:0/903108412 wait complete. 2024-03-26T06:17:50.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.046+0000 7f8fcd000640 1 Processor -- start 2024-03-26T06:17:50.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.046+0000 7f8fcd000640 1 -- start start 2024-03-26T06:17:50.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.047+0000 7f8fcd000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fc814aec0 0x7f8fc8159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.047+0000 7f8fcd000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc814b2a0 0x7f8fc8156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.047+0000 7f8fcd000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc80b3680 0x7f8fc80b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.047+0000 7f8fcd000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc815edf0 con 0x7f8fc80b3680 2024-03-26T06:17:50.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.047+0000 7f8fcd000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc80cd7f0 con 0x7f8fc814aec0 2024-03-26T06:17:50.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.047+0000 7f8fcd000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc815f0d0 con 0x7f8fc814b2a0 2024-03-26T06:17:50.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.047+0000 7f8fc6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc80b3680 0x7f8fc80b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.047+0000 7f8fc6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc80b3680 0x7f8fc80b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35154/0 (socket says 172.21.15.63:35154) 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.047+0000 7f8fc6800640 1 -- 172.21.15.63:0/3920997868 learned_addr learned my addr 172.21.15.63:0/3920997868 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.048+0000 7f8fc5400640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc814b2a0 0x7f8fc8156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.048+0000 7f8fc5e00640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fc814aec0 0x7f8fc8159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.048+0000 7f8fc6800640 1 -- 172.21.15.63:0/3920997868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc814b2a0 msgr2=0x7f8fc8156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.048+0000 7f8fc6800640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc814b2a0 0x7f8fc8156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.048+0000 7f8fc6800640 1 -- 172.21.15.63:0/3920997868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fc814aec0 msgr2=0x7f8fc8159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.048+0000 7f8fc6800640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fc814aec0 0x7f8fc8159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.048+0000 7f8fc6800640 1 -- 172.21.15.63:0/3920997868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8153df0 con 0x7f8fc80b3680 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.048+0000 7f8fc6800640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc80b3680 0x7f8fc80b3b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0037040 tx=0x7f8fc0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.048+0000 7f8fbe000640 1 -- 172.21.15.63:0/3920997868 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0039030 con 0x7f8fc80b3680 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.049+0000 7f8fbe000640 1 -- 172.21.15.63:0/3920997868 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc0043070 con 0x7f8fc80b3680 2024-03-26T06:17:50.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.049+0000 7f8fbe000640 1 -- 172.21.15.63:0/3920997868 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0009be0 con 0x7f8fc80b3680 2024-03-26T06:17:50.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.049+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc8156ec0 con 0x7f8fc80b3680 2024-03-26T06:17:50.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.049+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc81571a0 con 0x7f8fc80b3680 2024-03-26T06:17:50.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.050+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc8074730 con 0x7f8fc80b3680 2024-03-26T06:17:50.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.051+0000 7f8fbe000640 1 -- 172.21.15.63:0/3920997868 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8fc003d7f0 con 0x7f8fc80b3680 2024-03-26T06:17:50.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.052+0000 7f8fbe000640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fa806bbd0 0x7f8fa806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.052+0000 7f8fbe000640 1 -- 172.21.15.63:0/3920997868 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8fc00acfc0 con 0x7f8fc80b3680 2024-03-26T06:17:50.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.052+0000 7f8fc5e00640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fa806bbd0 0x7f8fa806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.053+0000 7f8fc5e00640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fa806bbd0 0x7f8fa806e090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009a90 tx=0x7f8fb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.056+0000 7f8fbe000640 1 -- 172.21.15.63:0/3920997868 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8fc007b6a0 con 0x7f8fc80b3680 2024-03-26T06:17:50.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.256+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fc806ea70 con 0x7f8fc80b3680 2024-03-26T06:17:50.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.257+0000 7f8fbe000640 1 -- 172.21.15.63:0/3920997868 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fc007afa0 con 0x7f8fc80b3680 2024-03-26T06:17:50.258 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:17:50.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fa806bbd0 msgr2=0x7f8fa806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fa806bbd0 0x7f8fa806e090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009a90 tx=0x7f8fb8008040 comp rx=0 tx=0).stop 2024-03-26T06:17:50.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc80b3680 msgr2=0x7f8fc80b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc80b3680 0x7f8fc80b3b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0037040 tx=0x7f8fc0004ab0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 shutdown_connections 2024-03-26T06:17:50.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8fa806bbd0 0x7f8fa806e090 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc80b3680 0x7f8fc80b3b10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fc814b2a0 0x7f8fc8156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 --2- 172.21.15.63:0/3920997868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fc814aec0 0x7f8fc8159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 >> 172.21.15.63:0/3920997868 conn(0x7f8fc806ac90 msgr2=0x7f8fc806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:50.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 shutdown_connections 2024-03-26T06:17:50.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.260+0000 7f8fcd000640 1 -- 172.21.15.63:0/3920997868 wait complete. 2024-03-26T06:17:50.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:17:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.501+0000 7fe1b1600640 1 Processor -- start 2024-03-26T06:17:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.501+0000 7fe1b1600640 1 -- start start 2024-03-26T06:17:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.503+0000 7fe1b1600640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe1ac06d270 0x7fe1ac071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.503+0000 7fe1b1600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac15f410 con 0x7fe1ac13e650 2024-03-26T06:17:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.503+0000 7fe1b1600640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac15f6f0 con 0x7fe1ac13eca0 2024-03-26T06:17:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.503+0000 7fe1b1600640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac15f9d0 con 0x7fe1ac06d270 2024-03-26T06:17:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.503+0000 7fe1abe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe1ac13e650 0x7fe1ac06daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56214/0 (socket says 172.21.15.63:56214) 2024-03-26T06:17:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.503+0000 7fe1abe00640 1 -- 172.21.15.63:0/2077833797 learned_addr learned my addr 172.21.15.63:0/2077833797 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1ab400640 1 --2- 172.21.15.63:0/2077833797 >> v2:172.21.15.204:3300/0 conn(0x7fe1ac06d270 0x7fe1ac071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890281057 0 0) 0x7fe1ac15f410 con 0x7fe1ac13e650 2024-03-26T06:17:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe190003520 con 0x7fe1ac13e650 2024-03-26T06:17:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2315982880 0 0) 0x7fe190003520 con 0x7fe1ac13e650 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 >> v2:172.21.15.204:3300/0 conn(0x7fe1ac06d270 msgr2=0x7fe1ac071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 --2- 172.21.15.63:0/2077833797 >> v2:172.21.15.204:3300/0 conn(0x7fe1ac06d270 0x7fe1ac071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 >> v1:172.21.15.204:6789/0 conn(0x7fe1ac13eca0 legacy=0x7fe1ac140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac15fcb0 con 0x7fe1ac13e650 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fe19c001670 con 0x7fe1ac13e650 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 >> v1:172.21.15.63:6789/0 conn(0x7fe1ac13e650 legacy=0x7fe1ac06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe190003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe190004800 0x7fe190004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1900051c0 0x7fe19000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac15f9d0 con 0x7fe190003a30 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19000c0f0 con 0x7fe1900051c0 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19000c2f0 con 0x7fe190004800 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.504+0000 7fe1abe00640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe190003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.505+0000 7fe1abe00640 1 -- 172.21.15.63:0/2077833797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe190004800 msgr2=0x7fe190004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:50.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.505+0000 7fe1ab400640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe190004800 0x7fe190004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.505+0000 7fe1abe00640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe190004800 0x7fe190004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.505+0000 7fe1abe00640 1 -- 172.21.15.63:0/2077833797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1900051c0 msgr2=0x7fe19000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:50.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.505+0000 7fe1abe00640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1900051c0 0x7fe19000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.505+0000 7fe1abe00640 1 -- 172.21.15.63:0/2077833797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190003520 con 0x7fe190003a30 2024-03-26T06:17:50.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.505+0000 7fe1b0c00640 1 -- 172.21.15.63:0/2077833797 reap_dead start 2024-03-26T06:17:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.506+0000 7fe1abe00640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe190003e50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00c0e0 tx=0x7fe190005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48b5c0920648fb2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c007c20 con 0x7fe190003a30 2024-03-26T06:17:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c030070 con 0x7fe190003a30 2024-03-26T06:17:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1aaa00640 1 -- 172.21.15.63:0/2077833797 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c005d70 con 0x7fe190003a30 2024-03-26T06:17:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1b1600640 1 -- 172.21.15.63:0/2077833797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 msgr2=0x7fe190003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1b1600640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe190003e50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00c0e0 tx=0x7fe190005830 comp rx=0 tx=0).stop 2024-03-26T06:17:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1b1600640 1 -- 172.21.15.63:0/2077833797 shutdown_connections 2024-03-26T06:17:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1b1600640 1 --2- 172.21.15.63:0/2077833797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe190003e50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1b1600640 1 -- 172.21.15.63:0/2077833797 >> 172.21.15.63:0/2077833797 conn(0x7fe1ac0670b0 msgr2=0x7fe1ac0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1b1600640 1 -- 172.21.15.63:0/2077833797 shutdown_connections 2024-03-26T06:17:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.507+0000 7fe1b1600640 1 -- 172.21.15.63:0/2077833797 wait complete. 2024-03-26T06:17:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.509+0000 7fe1b1600640 1 Processor -- start 2024-03-26T06:17:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.509+0000 7fe1b1600640 1 -- start start 2024-03-26T06:17:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.510+0000 7fe1b1600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe1ac0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.510+0000 7fe1b1600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1ac159830 0x7fe1ac154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.510+0000 7fe1b1600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1ac0ad1f0 0x7fe1ac0ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.510+0000 7fe1b1600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac06dc70 con 0x7fe190003a30 2024-03-26T06:17:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.510+0000 7fe1b1600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac06daf0 con 0x7fe1ac159830 2024-03-26T06:17:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.510+0000 7fe1b1600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac06ddf0 con 0x7fe1ac0ad1f0 2024-03-26T06:17:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.510+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe1ac0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe1ac0cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35182/0 (socket says 172.21.15.63:35182) 2024-03-26T06:17:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1abe00640 1 -- 172.21.15.63:0/2922031641 learned_addr learned my addr 172.21.15.63:0/2922031641 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1b0c00640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1ac0ad1f0 0x7fe1ac0ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1ab400640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1ac159830 0x7fe1ac154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1abe00640 1 -- 172.21.15.63:0/2922031641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1ac0ad1f0 msgr2=0x7fe1ac0ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1abe00640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1ac0ad1f0 0x7fe1ac0ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1abe00640 1 -- 172.21.15.63:0/2922031641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1ac159830 msgr2=0x7fe1ac154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1abe00640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1ac159830 0x7fe1ac154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1abe00640 1 -- 172.21.15.63:0/2922031641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac0ae4d0 con 0x7fe190003a30 2024-03-26T06:17:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.511+0000 7fe1abe00640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe1ac0cd8e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe19c02c480 tx=0x7fe1ac15f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.512+0000 7fe1a3e00640 1 -- 172.21.15.63:0/2922031641 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c004bf0 con 0x7fe190003a30 2024-03-26T06:17:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.512+0000 7fe1a3e00640 1 -- 172.21.15.63:0/2922031641 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c000ed0 con 0x7fe190003a30 2024-03-26T06:17:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.512+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac159d60 con 0x7fe190003a30 2024-03-26T06:17:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.512+0000 7fe1a3e00640 1 -- 172.21.15.63:0/2922031641 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c007070 con 0x7fe190003a30 2024-03-26T06:17:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.512+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac15a320 con 0x7fe190003a30 2024-03-26T06:17:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.513+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac04f0c0 con 0x7fe190003a30 2024-03-26T06:17:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.514+0000 7fe1a3e00640 1 -- 172.21.15.63:0/2922031641 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe19c007210 con 0x7fe190003a30 2024-03-26T06:17:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.515+0000 7fe1a3e00640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe18c06bc50 0x7fe18c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.515+0000 7fe1a3e00640 1 -- 172.21.15.63:0/2922031641 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe19c0ac590 con 0x7fe190003a30 2024-03-26T06:17:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.515+0000 7fe1ab400640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe18c06bc50 0x7fe18c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.516+0000 7fe1ab400640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe18c06bc50 0x7fe18c06e110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0cb630 tx=0x7fe198008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.519+0000 7fe1a3e00640 1 -- 172.21.15.63:0/2922031641 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe19c07adf0 con 0x7fe190003a30 2024-03-26T06:17:50.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.726+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1ac0b0d50 con 0x7fe190003a30 2024-03-26T06:17:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.727+0000 7fe1a3e00640 1 -- 172.21.15.63:0/2922031641 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe19c07a6f0 con 0x7fe190003a30 2024-03-26T06:17:50.729 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe18c06bc50 msgr2=0x7fe18c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe18c06bc50 0x7fe18c06e110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0cb630 tx=0x7fe198008040 comp rx=0 tx=0).stop 2024-03-26T06:17:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 msgr2=0x7fe1ac0cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe1ac0cd8e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe19c02c480 tx=0x7fe1ac15f5e0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 shutdown_connections 2024-03-26T06:17:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe18c06bc50 0x7fe18c06e110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1ac0ad1f0 0x7fe1ac0ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1ac159830 0x7fe1ac154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 --2- 172.21.15.63:0/2922031641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe190003a30 0x7fe1ac0cd8e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 >> 172.21.15.63:0/2922031641 conn(0x7fe1ac0670b0 msgr2=0x7fe1ac155690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 shutdown_connections 2024-03-26T06:17:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.730+0000 7fe1b1600640 1 -- 172.21.15.63:0/2922031641 wait complete. 2024-03-26T06:17:50.752 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:17:50.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.980+0000 7f124b200640 1 Processor -- start 2024-03-26T06:17:50.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.980+0000 7f124b200640 1 -- start start 2024-03-26T06:17:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.982+0000 7f124b200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f124c0cea40 0x7f124c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.982+0000 7f124b200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f124c06e280 0x7f124c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.982+0000 7f124b200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124c143cb0 con 0x7f124c1438d0 2024-03-26T06:17:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.982+0000 7f124b200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124c06ec30 con 0x7f124c0cea40 2024-03-26T06:17:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.982+0000 7f124b200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124c0ccef0 con 0x7f124c06e280 2024-03-26T06:17:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.982+0000 7f1249400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f124c0cea40 0x7f124c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.982+0000 7f1249400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f124c0cea40 0x7f124c15eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47140/0 (socket says 172.21.15.63:47140) 2024-03-26T06:17:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.982+0000 7f1249400640 1 -- 172.21.15.63:0/3661090789 learned_addr learned my addr 172.21.15.63:0/3661090789 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.983+0000 7f124a800640 1 --2- 172.21.15.63:0/3661090789 >> v2:172.21.15.204:3300/0 conn(0x7f124c06e280 0x7f124c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.983+0000 7f1249400640 1 -- 172.21.15.63:0/3661090789 >> v2:172.21.15.204:3300/0 conn(0x7f124c06e280 msgr2=0x7f124c06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.983+0000 7f1249400640 1 --2- 172.21.15.63:0/3661090789 >> v2:172.21.15.204:3300/0 conn(0x7f124c06e280 0x7f124c06e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.983+0000 7f1249400640 1 -- 172.21.15.63:0/3661090789 >> v1:172.21.15.204:6789/0 conn(0x7f124c1438d0 legacy=0x7f124c0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.983+0000 7f1249400640 1 -- 172.21.15.63:0/3661090789 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c0ceed0 con 0x7f124c0cea40 2024-03-26T06:17:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.984+0000 7f1249400640 1 --2- 172.21.15.63:0/3661090789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c0cea40 0x7f124c15eda0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f124c0721e0 tx=0x7f123802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04ad06c9e4a7679 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:50.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.987+0000 7f1248a00640 1 -- 172.21.15.63:0/3661090789 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238035020 con 0x7f124c0cea40 2024-03-26T06:17:50.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.987+0000 7f1248a00640 1 -- 172.21.15.63:0/3661090789 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1238031870 con 0x7f124c0cea40 2024-03-26T06:17:50.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.987+0000 7f1248a00640 1 -- 172.21.15.63:0/3661090789 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238031c40 con 0x7f124c0cea40 2024-03-26T06:17:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.987+0000 7f124b200640 1 -- 172.21.15.63:0/3661090789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c0cea40 msgr2=0x7f124c15eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.987+0000 7f124b200640 1 --2- 172.21.15.63:0/3661090789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c0cea40 0x7f124c15eda0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f124c0721e0 tx=0x7f123802b910 comp rx=0 tx=0).stop 2024-03-26T06:17:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.988+0000 7f124b200640 1 -- 172.21.15.63:0/3661090789 shutdown_connections 2024-03-26T06:17:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.988+0000 7f124b200640 1 --2- 172.21.15.63:0/3661090789 >> v2:172.21.15.204:3300/0 conn(0x7f124c06e280 0x7f124c06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.988+0000 7f124b200640 1 --2- 172.21.15.63:0/3661090789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c0cea40 0x7f124c15eda0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.988+0000 7f124b200640 1 -- 172.21.15.63:0/3661090789 >> 172.21.15.63:0/3661090789 conn(0x7f124c0670b0 msgr2=0x7f124c0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.988+0000 7f124b200640 1 -- 172.21.15.63:0/3661090789 shutdown_connections 2024-03-26T06:17:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.988+0000 7f124b200640 1 -- 172.21.15.63:0/3661090789 wait complete. 2024-03-26T06:17:50.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.989+0000 7f124b200640 1 Processor -- start 2024-03-26T06:17:50.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.990+0000 7f124b200640 1 -- start start 2024-03-26T06:17:50.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124b200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f124c06e280 0x7f124c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124b200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f124c1438d0 0x7f124c1f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c1f78f0 0x7f124c159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c15e5a0 con 0x7f124c1f78f0 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124b200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c15e2c0 con 0x7f124c06e280 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124b200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c15e880 con 0x7f124c1438d0 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c1f78f0 0x7f124c159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c1f78f0 0x7f124c159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47150/0 (socket says 172.21.15.63:47150) 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124a800640 1 -- 172.21.15.63:0/2020347139 learned_addr learned my addr 172.21.15.63:0/2020347139 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f1249400640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f124c1438d0 0x7f124c1f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f1249e00640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f124c06e280 0x7f124c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124a800640 1 -- 172.21.15.63:0/2020347139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f124c1438d0 msgr2=0x7f124c1f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124a800640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f124c1438d0 0x7f124c1f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124a800640 1 -- 172.21.15.63:0/2020347139 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f124c06e280 msgr2=0x7f124c0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124a800640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f124c06e280 0x7f124c0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.991+0000 7f124a800640 1 -- 172.21.15.63:0/2020347139 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c1f7fc0 con 0x7f124c1f78f0 2024-03-26T06:17:50.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.992+0000 7f1249e00640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f124c06e280 0x7f124c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:50.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.992+0000 7f124a800640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c1f78f0 0x7f124c159d30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f124400cda0 tx=0x7f124400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.992+0000 7f1242000640 1 -- 172.21.15.63:0/2020347139 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244003b90 con 0x7f124c1f78f0 2024-03-26T06:17:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.992+0000 7f1242000640 1 -- 172.21.15.63:0/2020347139 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244003d30 con 0x7f124c1f78f0 2024-03-26T06:17:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.992+0000 7f1242000640 1 -- 172.21.15.63:0/2020347139 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244004240 con 0x7f124c1f78f0 2024-03-26T06:17:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.992+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c15c030 con 0x7f124c1f78f0 2024-03-26T06:17:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.992+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c15c5f0 con 0x7f124c1f78f0 2024-03-26T06:17:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.994+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c04f0c0 con 0x7f124c1f78f0 2024-03-26T06:17:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.994+0000 7f1242000640 1 -- 172.21.15.63:0/2020347139 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f12440043e0 con 0x7f124c1f78f0 2024-03-26T06:17:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.995+0000 7f1242000640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f122c06bbd0 0x7f122c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.995+0000 7f1242000640 1 -- 172.21.15.63:0/2020347139 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f124408b950 con 0x7f124c1f78f0 2024-03-26T06:17:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.996+0000 7f1249e00640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f122c06bbd0 0x7f122c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:50.996+0000 7f1249e00640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f122c06bbd0 0x7f122c06e090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f123c00a830 tx=0x7f123c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:51.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.000+0000 7f1242000640 1 -- 172.21.15.63:0/2020347139 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f124401d340 con 0x7f124c1f78f0 2024-03-26T06:17:51.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.200+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f124c1402e0 con 0x7f124c1f78f0 2024-03-26T06:17:51.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.201+0000 7f1242000640 1 -- 172.21.15.63:0/2020347139 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f124405a0d0 con 0x7f124c1f78f0 2024-03-26T06:17:51.202 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:17:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f122c06bbd0 msgr2=0x7f122c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f122c06bbd0 0x7f122c06e090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f123c00a830 tx=0x7f123c008040 comp rx=0 tx=0).stop 2024-03-26T06:17:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c1f78f0 msgr2=0x7f124c159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c1f78f0 0x7f124c159d30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f124400cda0 tx=0x7f124400a660 comp rx=0 tx=0).stop 2024-03-26T06:17:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 shutdown_connections 2024-03-26T06:17:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f122c06bbd0 0x7f122c06e090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f124c1f78f0 0x7f124c159d30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f124c1438d0 0x7f124c1f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 --2- 172.21.15.63:0/2020347139 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f124c06e280 0x7f124c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.203+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 >> 172.21.15.63:0/2020347139 conn(0x7f124c0670b0 msgr2=0x7f124c0b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:51.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.204+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 shutdown_connections 2024-03-26T06:17:51.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.204+0000 7f124b200640 1 -- 172.21.15.63:0/2020347139 wait complete. 2024-03-26T06:17:51.225 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:17:51.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.448+0000 7fdca7200640 1 Processor -- start 2024-03-26T06:17:51.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.449+0000 7fdca7200640 1 -- start start 2024-03-26T06:17:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.450+0000 7fdca7200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdca8071850 0x7fdca806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.450+0000 7fdca7200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdca815dec0 0x7fdca815e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.450+0000 7fdca7200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca815e8b0 con 0x7fdca8143eb0 2024-03-26T06:17:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.450+0000 7fdca7200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca8144290 con 0x7fdca8071850 2024-03-26T06:17:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.450+0000 7fdca7200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca815ee60 con 0x7fdca815dec0 2024-03-26T06:17:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.451+0000 7fdca5e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdca8143eb0 0x7fdca8071140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42394/0 (socket says 172.21.15.63:42394) 2024-03-26T06:17:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.451+0000 7fdca5e00640 1 -- 172.21.15.63:0/2627311979 learned_addr learned my addr 172.21.15.63:0/2627311979 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.451+0000 7fdca5400640 1 --2- 172.21.15.63:0/2627311979 >> v2:172.21.15.63:3300/0 conn(0x7fdca8071850 0x7fdca806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.451+0000 7fdca6800640 1 --2- 172.21.15.63:0/2627311979 >> v2:172.21.15.204:3300/0 conn(0x7fdca815dec0 0x7fdca815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.451+0000 7fdca4a00640 1 -- 172.21.15.63:0/2627311979 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022160041 0 0) 0x7fdca815e8b0 con 0x7fdca8143eb0 2024-03-26T06:17:51.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.451+0000 7fdca4a00640 1 -- 172.21.15.63:0/2627311979 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc8c003520 con 0x7fdca8143eb0 2024-03-26T06:17:51.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.452+0000 7fdca5400640 1 -- 172.21.15.63:0/2627311979 >> v2:172.21.15.204:3300/0 conn(0x7fdca815dec0 msgr2=0x7fdca815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:51.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.452+0000 7fdca5400640 1 --2- 172.21.15.63:0/2627311979 >> v2:172.21.15.204:3300/0 conn(0x7fdca815dec0 0x7fdca815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.452+0000 7fdca5400640 1 -- 172.21.15.63:0/2627311979 >> v1:172.21.15.63:6789/0 conn(0x7fdca8143eb0 legacy=0x7fdca8071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.452+0000 7fdca4a00640 1 -- 172.21.15.63:0/2627311979 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658869517 0 0) 0x7fdc8c003520 con 0x7fdca8143eb0 2024-03-26T06:17:51.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.452+0000 7fdca5400640 1 -- 172.21.15.63:0/2627311979 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca815eb80 con 0x7fdca8071850 2024-03-26T06:17:51.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.453+0000 7fdca5400640 1 --2- 172.21.15.63:0/2627311979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8071850 0x7fdca806dd80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdca80ad730 tx=0x7fdc9002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc371787d91d34a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:51.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.453+0000 7fdca4a00640 1 -- 172.21.15.63:0/2627311979 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90037070 con 0x7fdca8071850 2024-03-26T06:17:51.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.453+0000 7fdca4a00640 1 -- 172.21.15.63:0/2627311979 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc90030510 con 0x7fdca8071850 2024-03-26T06:17:51.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.453+0000 7fdca4a00640 1 -- 172.21.15.63:0/2627311979 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98001670 con 0x7fdca8071850 2024-03-26T06:17:51.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.454+0000 7fdca7200640 1 -- 172.21.15.63:0/2627311979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8071850 msgr2=0x7fdca806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.454+0000 7fdca7200640 1 --2- 172.21.15.63:0/2627311979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8071850 0x7fdca806dd80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdca80ad730 tx=0x7fdc9002b710 comp rx=0 tx=0).stop 2024-03-26T06:17:51.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.454+0000 7fdca7200640 1 -- 172.21.15.63:0/2627311979 shutdown_connections 2024-03-26T06:17:51.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.454+0000 7fdca7200640 1 --2- 172.21.15.63:0/2627311979 >> v2:172.21.15.204:3300/0 conn(0x7fdca815dec0 0x7fdca815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.454+0000 7fdca7200640 1 --2- 172.21.15.63:0/2627311979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8071850 0x7fdca806dd80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.454+0000 7fdca7200640 1 -- 172.21.15.63:0/2627311979 >> 172.21.15.63:0/2627311979 conn(0x7fdca80670b0 msgr2=0x7fdca80b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:51.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.454+0000 7fdca7200640 1 -- 172.21.15.63:0/2627311979 shutdown_connections 2024-03-26T06:17:51.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.454+0000 7fdca7200640 1 -- 172.21.15.63:0/2627311979 wait complete. 2024-03-26T06:17:51.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.456+0000 7fdca7200640 1 Processor -- start 2024-03-26T06:17:51.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.456+0000 7fdca7200640 1 -- start start 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca7200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca8071850 0x7fdca80cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8143eb0 0x7fdca81f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca7200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca815dec0 0x7fdca813bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca7200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca806d860 con 0x7fdca8143eb0 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca7200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca806d580 con 0x7fdca8071850 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca7200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80adbc0 con 0x7fdca815dec0 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8143eb0 0x7fdca81f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8143eb0 0x7fdca81f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47158/0 (socket says 172.21.15.63:47158) 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca5400640 1 -- 172.21.15.63:0/2287253789 learned_addr learned my addr 172.21.15.63:0/2287253789 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca5400640 1 -- 172.21.15.63:0/2287253789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca815dec0 msgr2=0x7fdca813bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca5e00640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca8071850 0x7fdca80cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca5400640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca815dec0 0x7fdca813bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.457+0000 7fdca5400640 1 -- 172.21.15.63:0/2287253789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca8071850 msgr2=0x7fdca80cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.458+0000 7fdca5400640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca8071850 0x7fdca80cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.458+0000 7fdca5400640 1 -- 172.21.15.63:0/2287253789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80cd9d0 con 0x7fdca8143eb0 2024-03-26T06:17:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.458+0000 7fdca5400640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8143eb0 0x7fdca81f7ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdc90000c00 tx=0x7fdc900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.458+0000 7fdc9e000640 1 -- 172.21.15.63:0/2287253789 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90041020 con 0x7fdca8143eb0 2024-03-26T06:17:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.458+0000 7fdc9e000640 1 -- 172.21.15.63:0/2287253789 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9003c890 con 0x7fdca8143eb0 2024-03-26T06:17:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.458+0000 7fdc9e000640 1 -- 172.21.15.63:0/2287253789 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90037040 con 0x7fdca8143eb0 2024-03-26T06:17:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.458+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca81f8020 con 0x7fdca8143eb0 2024-03-26T06:17:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.458+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca80cc6d0 con 0x7fdca8143eb0 2024-03-26T06:17:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.460+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca804f0c0 con 0x7fdca8143eb0 2024-03-26T06:17:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.460+0000 7fdc9e000640 1 -- 172.21.15.63:0/2287253789 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fdc90044020 con 0x7fdca8143eb0 2024-03-26T06:17:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.461+0000 7fdc9e000640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc8406bbd0 0x7fdc8406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.461+0000 7fdc9e000640 1 -- 172.21.15.63:0/2287253789 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fdc900ac930 con 0x7fdca8143eb0 2024-03-26T06:17:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.462+0000 7fdca5e00640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc8406bbd0 0x7fdc8406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.462+0000 7fdca5e00640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc8406bbd0 0x7fdc8406e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdc98005880 tx=0x7fdc98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:51.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.468+0000 7fdc9e000640 1 -- 172.21.15.63:0/2287253789 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fdc9004b030 con 0x7fdca8143eb0 2024-03-26T06:17:51.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.669+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdca806e6b0 con 0x7fdca8143eb0 2024-03-26T06:17:51.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.670+0000 7fdc9e000640 1 -- 172.21.15.63:0/2287253789 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc9003ae20 con 0x7fdca8143eb0 2024-03-26T06:17:51.671 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc8406bbd0 msgr2=0x7fdc8406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc8406bbd0 0x7fdc8406e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdc98005880 tx=0x7fdc98009040 comp rx=0 tx=0).stop 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8143eb0 msgr2=0x7fdca81f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8143eb0 0x7fdca81f7ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdc90000c00 tx=0x7fdc900046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 shutdown_connections 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fdc8406bbd0 0x7fdc8406e090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca815dec0 0x7fdca813bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdca8143eb0 0x7fdca81f7ae0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 --2- 172.21.15.63:0/2287253789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca8071850 0x7fdca80cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 >> 172.21.15.63:0/2287253789 conn(0x7fdca80670b0 msgr2=0x7fdca815d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 shutdown_connections 2024-03-26T06:17:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.673+0000 7fdca7200640 1 -- 172.21.15.63:0/2287253789 wait complete. 2024-03-26T06:17:51.692 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:51.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.904+0000 7fc426a00640 1 Processor -- start 2024-03-26T06:17:51.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.904+0000 7fc426a00640 1 -- start start 2024-03-26T06:17:51.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.906+0000 7fc426a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc420145100 0x7fc42006ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.906+0000 7fc426a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42015bf80 con 0x7fc420071a60 2024-03-26T06:17:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.906+0000 7fc426a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42006e2f0 con 0x7fc42006ef70 2024-03-26T06:17:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.906+0000 7fc426a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4200a86e0 con 0x7fc420145100 2024-03-26T06:17:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.906+0000 7fc424a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc420071a60 0x7fc4200cc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42398/0 (socket says 172.21.15.63:42398) 2024-03-26T06:17:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.906+0000 7fc424a00640 1 -- 172.21.15.63:0/3169600358 learned_addr learned my addr 172.21.15.63:0/3169600358 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41fe00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc420145100 0x7fc42006ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189366089 0 0) 0x7fc42015bf80 con 0x7fc420071a60 2024-03-26T06:17:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc404003520 con 0x7fc420071a60 2024-03-26T06:17:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193389319 0 0) 0x7fc404003520 con 0x7fc420071a60 2024-03-26T06:17:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc420145100 msgr2=0x7fc42006ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc420145100 0x7fc42006ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 >> v1:172.21.15.204:6789/0 conn(0x7fc42006ef70 legacy=0x7fc420071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42006d770 con 0x7fc420071a60 2024-03-26T06:17:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fc418001a10 con 0x7fc420071a60 2024-03-26T06:17:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 >> v1:172.21.15.63:6789/0 conn(0x7fc420071a60 legacy=0x7fc4200cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4040039e0 0x7fc404003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.907+0000 7fc41ea00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc404004800 0x7fc404004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41ea00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc420145100 0x7fc4040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40400ba70 con 0x7fc4040039e0 2024-03-26T06:17:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40400bbf0 con 0x7fc404004800 2024-03-26T06:17:51.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40400bdf0 con 0x7fc420145100 2024-03-26T06:17:51.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41fe00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4040039e0 0x7fc404003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc424a00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc420145100 0x7fc4040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41fe00640 1 -- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc420145100 msgr2=0x7fc4040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:51.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41fe00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc420145100 0x7fc4040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41fe00640 1 -- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc404004800 msgr2=0x7fc404004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:51.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41fe00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc404004800 0x7fc404004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc41fe00640 1 -- 172.21.15.63:0/3169600358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404003520 con 0x7fc4040039e0 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.908+0000 7fc424a00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc420145100 0x7fc4040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.909+0000 7fc41fe00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4040039e0 0x7fc404003e00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc410009a90 tx=0x7fc404005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93eaed0bf9384e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.910+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410039070 con 0x7fc4040039e0 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.910+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41002c680 con 0x7fc4040039e0 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.910+0000 7fc41ea00640 1 -- 172.21.15.63:0/3169600358 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410009690 con 0x7fc4040039e0 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.910+0000 7fc426a00640 1 -- 172.21.15.63:0/3169600358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4040039e0 msgr2=0x7fc404003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.910+0000 7fc426a00640 1 --2- 172.21.15.63:0/3169600358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4040039e0 0x7fc404003e00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc410009a90 tx=0x7fc404005830 comp rx=0 tx=0).stop 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.910+0000 7fc424a00640 1 -- 172.21.15.63:0/3169600358 reap_dead start 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.911+0000 7fc426a00640 1 -- 172.21.15.63:0/3169600358 shutdown_connections 2024-03-26T06:17:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.911+0000 7fc426a00640 1 -- 172.21.15.63:0/3169600358 >> 172.21.15.63:0/3169600358 conn(0x7fc42006ac90 msgr2=0x7fc42006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:51.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.911+0000 7fc426a00640 1 -- 172.21.15.63:0/3169600358 shutdown_connections 2024-03-26T06:17:51.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.911+0000 7fc426a00640 1 -- 172.21.15.63:0/3169600358 wait complete. 2024-03-26T06:17:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.912+0000 7fc426a00640 1 Processor -- start 2024-03-26T06:17:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.913+0000 7fc426a00640 1 -- start start 2024-03-26T06:17:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc426a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4040039e0 0x7fc4200ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc426a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4200aca80 0x7fc4201f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc426a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4201f71f0 0x7fc42015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc426a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42006e010 con 0x7fc4201f71f0 2024-03-26T06:17:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc426a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42006dd30 con 0x7fc4040039e0 2024-03-26T06:17:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc426a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4201454e0 con 0x7fc4200aca80 2024-03-26T06:17:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc424a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4201f71f0 0x7fc42015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc424a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4201f71f0 0x7fc42015a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47186/0 (socket says 172.21.15.63:47186) 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc424a00640 1 -- 172.21.15.63:0/3107076863 learned_addr learned my addr 172.21.15.63:0/3107076863 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc41fe00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4040039e0 0x7fc4200ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc41f400640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4200aca80 0x7fc4201f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc424a00640 1 -- 172.21.15.63:0/3107076863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4200aca80 msgr2=0x7fc4201f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc424a00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4200aca80 0x7fc4201f6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc424a00640 1 -- 172.21.15.63:0/3107076863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4040039e0 msgr2=0x7fc4200ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc424a00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4040039e0 0x7fc4200ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.914+0000 7fc424a00640 1 -- 172.21.15.63:0/3107076863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4201e6ea0 con 0x7fc4201f71f0 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.915+0000 7fc41f400640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4200aca80 0x7fc4201f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.915+0000 7fc424a00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4201f71f0 0x7fc42015a9e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc4201605b0 tx=0x7fc41800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.915+0000 7fc417e00640 1 -- 172.21.15.63:0/3107076863 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc418004d60 con 0x7fc4201f71f0 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.915+0000 7fc417e00640 1 -- 172.21.15.63:0/3107076863 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41800bb20 con 0x7fc4201f71f0 2024-03-26T06:17:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.915+0000 7fc417e00640 1 -- 172.21.15.63:0/3107076863 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc418007110 con 0x7fc4201f71f0 2024-03-26T06:17:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.915+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42015ed00 con 0x7fc4201f71f0 2024-03-26T06:17:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.915+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4201e7140 con 0x7fc4201f71f0 2024-03-26T06:17:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.917+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc420074730 con 0x7fc4201f71f0 2024-03-26T06:17:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.918+0000 7fc417e00640 1 -- 172.21.15.63:0/3107076863 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc41801b020 con 0x7fc4201f71f0 2024-03-26T06:17:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.918+0000 7fc417e00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc40006bbd0 0x7fc40006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.918+0000 7fc417e00640 1 -- 172.21.15.63:0/3107076863 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc41808afb0 con 0x7fc4201f71f0 2024-03-26T06:17:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.919+0000 7fc41fe00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc40006bbd0 0x7fc40006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.920+0000 7fc41fe00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc40006bbd0 0x7fc40006e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc410036000 tx=0x7fc410030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:51.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:51.923+0000 7fc417e00640 1 -- 172.21.15.63:0/3107076863 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc418059730 con 0x7fc4201f71f0 2024-03-26T06:17:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.124+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4201e90a0 con 0x7fc4201f71f0 2024-03-26T06:17:52.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.126+0000 7fc417e00640 1 -- 172.21.15.63:0/3107076863 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7fc418059030 con 0x7fc4201f71f0 2024-03-26T06:17:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:52.128 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc40006bbd0 msgr2=0x7fc40006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc40006bbd0 0x7fc40006e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc410036000 tx=0x7fc410030000 comp rx=0 tx=0).stop 2024-03-26T06:17:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4201f71f0 msgr2=0x7fc42015a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4201f71f0 0x7fc42015a9e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc4201605b0 tx=0x7fc41800b4a0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 shutdown_connections 2024-03-26T06:17:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc40006bbd0 0x7fc40006e090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4201f71f0 0x7fc42015a9e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4200aca80 0x7fc4201f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 --2- 172.21.15.63:0/3107076863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4040039e0 0x7fc4200ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 >> 172.21.15.63:0/3107076863 conn(0x7fc42006ac90 msgr2=0x7fc4201e5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:52.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 shutdown_connections 2024-03-26T06:17:52.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.129+0000 7fc426a00640 1 -- 172.21.15.63:0/3107076863 wait complete. 2024-03-26T06:17:52.148 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:17:52.149 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:17:52.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.369+0000 7f3583e00640 1 Processor -- start 2024-03-26T06:17:52.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.369+0000 7f3583e00640 1 -- start start 2024-03-26T06:17:52.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.371+0000 7f3583e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f358413e650 0x7f358406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.371+0000 7f3583e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358415f410 con 0x7f358406d270 2024-03-26T06:17:52.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.371+0000 7f3583e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358415f6f0 con 0x7f3584071850 2024-03-26T06:17:52.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.371+0000 7f3583e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358415f9d0 con 0x7f358413e650 2024-03-26T06:17:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.371+0000 7f3582a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f358413e650 0x7f358406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.371+0000 7f3582a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f358413e650 0x7f358406daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47200/0 (socket says 172.21.15.63:47200) 2024-03-26T06:17:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.371+0000 7f357be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f358406d270 0x7f3584071140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42406/0 (socket says 172.21.15.63:42406) 2024-03-26T06:17:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.371+0000 7f3582a00640 1 -- 172.21.15.63:0/2285660992 learned_addr learned my addr 172.21.15.63:0/2285660992 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.372+0000 7f3582a00640 1 -- 172.21.15.63:0/2285660992 >> v1:172.21.15.204:6789/0 conn(0x7f3584071850 legacy=0x7f3584140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.372+0000 7f3582a00640 1 -- 172.21.15.63:0/2285660992 >> v1:172.21.15.63:6789/0 conn(0x7f358406d270 legacy=0x7f3584071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.372+0000 7f3582a00640 1 -- 172.21.15.63:0/2285660992 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358415fcb0 con 0x7f358413e650 2024-03-26T06:17:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.372+0000 7f3582000640 1 -- 172.21.15.63:0/2285660992 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465118370 0 0) 0x7f358415f410 con 0x7f358406d270 2024-03-26T06:17:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.374+0000 7f3582a00640 1 --2- 172.21.15.63:0/2285660992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 0x7f358406daf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f35740098a0 tx=0x7f357402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c10c6583258fd86 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:52.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.374+0000 7f3582000640 1 -- 172.21.15.63:0/2285660992 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357402f840 con 0x7f358413e650 2024-03-26T06:17:52.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.374+0000 7f3582000640 1 -- 172.21.15.63:0/2285660992 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357402f9e0 con 0x7f358413e650 2024-03-26T06:17:52.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.374+0000 7f3582000640 1 -- 172.21.15.63:0/2285660992 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357402fdb0 con 0x7f358413e650 2024-03-26T06:17:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.375+0000 7f3583e00640 1 -- 172.21.15.63:0/2285660992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 msgr2=0x7f358406daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.375+0000 7f3583e00640 1 --2- 172.21.15.63:0/2285660992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 0x7f358406daf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f35740098a0 tx=0x7f357402ba20 comp rx=0 tx=0).stop 2024-03-26T06:17:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.375+0000 7f3583e00640 1 -- 172.21.15.63:0/2285660992 shutdown_connections 2024-03-26T06:17:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.375+0000 7f3583e00640 1 --2- 172.21.15.63:0/2285660992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 0x7f358406daf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.375+0000 7f3583e00640 1 -- 172.21.15.63:0/2285660992 >> 172.21.15.63:0/2285660992 conn(0x7f35840670b0 msgr2=0x7f35840b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.375+0000 7f3583e00640 1 -- 172.21.15.63:0/2285660992 shutdown_connections 2024-03-26T06:17:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.375+0000 7f3583e00640 1 -- 172.21.15.63:0/2285660992 wait complete. 2024-03-26T06:17:52.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.376+0000 7f3583e00640 1 Processor -- start 2024-03-26T06:17:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.377+0000 7f3583e00640 1 -- start start 2024-03-26T06:17:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f358406d270 0x7f3584158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3584071850 0x7f3584132ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 0x7f358415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358413eca0 con 0x7f358413e650 2024-03-26T06:17:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358406e030 con 0x7f3584071850 2024-03-26T06:17:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358413ee20 con 0x7f358406d270 2024-03-26T06:17:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 0x7f358415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 0x7f358415dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47210/0 (socket says 172.21.15.63:47210) 2024-03-26T06:17:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583400640 1 -- 172.21.15.63:0/809793867 learned_addr learned my addr 172.21.15.63:0/809793867 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583400640 1 -- 172.21.15.63:0/809793867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f358406d270 msgr2=0x7f3584158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f357be00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3584071850 0x7f3584132ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583400640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f358406d270 0x7f3584158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583400640 1 -- 172.21.15.63:0/809793867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3584071850 msgr2=0x7f3584132ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583400640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3584071850 0x7f3584132ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f3583400640 1 -- 172.21.15.63:0/809793867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3584133020 con 0x7f358413e650 2024-03-26T06:17:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.378+0000 7f357be00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3584071850 0x7f3584132ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.379+0000 7f3583400640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 0x7f358415dc40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c7a0 tx=0x7f357c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:52.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.379+0000 7f357aa00640 1 -- 172.21.15.63:0/809793867 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c003b70 con 0x7f358413e650 2024-03-26T06:17:52.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.379+0000 7f357aa00640 1 -- 172.21.15.63:0/809793867 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c003d30 con 0x7f358413e650 2024-03-26T06:17:52.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.379+0000 7f357aa00640 1 -- 172.21.15.63:0/809793867 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c00aa90 con 0x7f358413e650 2024-03-26T06:17:52.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.379+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3584157700 con 0x7f358413e650 2024-03-26T06:17:52.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.379+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35840b3b70 con 0x7f358413e650 2024-03-26T06:17:52.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.380+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358404f0c0 con 0x7f358413e650 2024-03-26T06:17:52.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.381+0000 7f357aa00640 1 -- 172.21.15.63:0/809793867 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f357c00ac30 con 0x7f358413e650 2024-03-26T06:17:52.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.382+0000 7f357aa00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f356006bbd0 0x7f356006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.382+0000 7f357aa00640 1 -- 172.21.15.63:0/809793867 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f357c08adb0 con 0x7f358413e650 2024-03-26T06:17:52.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.382+0000 7f3582a00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f356006bbd0 0x7f356006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.383+0000 7f3582a00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f356006bbd0 0x7f356006e090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3574036000 tx=0x7f3574039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:52.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.386+0000 7f357aa00640 1 -- 172.21.15.63:0/809793867 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f357c0594a0 con 0x7f358413e650 2024-03-26T06:17:52.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.590+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3584140240 con 0x7f358413e650 2024-03-26T06:17:52.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.590+0000 7f357aa00640 1 -- 172.21.15.63:0/809793867 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f357c058da0 con 0x7f358413e650 2024-03-26T06:17:52.592 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:17:52.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f356006bbd0 msgr2=0x7f356006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f356006bbd0 0x7f356006e090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3574036000 tx=0x7f3574039040 comp rx=0 tx=0).stop 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 msgr2=0x7f358415dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 0x7f358415dc40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c7a0 tx=0x7f357c00cc60 comp rx=0 tx=0).stop 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 shutdown_connections 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f356006bbd0 0x7f356006e090 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f358413e650 0x7f358415dc40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3584071850 0x7f3584132ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 --2- 172.21.15.63:0/809793867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f358406d270 0x7f3584158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 >> 172.21.15.63:0/809793867 conn(0x7f35840670b0 msgr2=0x7f35840b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 shutdown_connections 2024-03-26T06:17:52.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.593+0000 7f3583e00640 1 -- 172.21.15.63:0/809793867 wait complete. 2024-03-26T06:17:52.614 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:17:52.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.840+0000 7fb5fcc00640 1 Processor -- start 2024-03-26T06:17:52.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.841+0000 7fb5fcc00640 1 -- start start 2024-03-26T06:17:52.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.842+0000 7fb5fcc00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb5f8150c50 0x7fb5f80719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.842+0000 7fb5fcc00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f815e1c0 0x7fb5f80b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.842+0000 7fb5fcc00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f815a280 con 0x7fb5f8071f10 2024-03-26T06:17:52.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.842+0000 7fb5fcc00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f8072370 con 0x7fb5f8150c50 2024-03-26T06:17:52.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.843+0000 7fb5fcc00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f815e650 con 0x7fb5f815e1c0 2024-03-26T06:17:52.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.843+0000 7fb5f7400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb5f8150c50 0x7fb5f80719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.843+0000 7fb5f7e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f815e1c0 0x7fb5f80b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.843+0000 7fb5f6a00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fb5f8071f10 0x7fb5f815dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:42222/0 (socket says 172.21.15.63:42222) 2024-03-26T06:17:52.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.843+0000 7fb5f6a00640 1 -- 172.21.15.63:0/1630545935 learned_addr learned my addr 172.21.15.63:0/1630545935 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:52.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.844+0000 7fb5f7e00640 1 -- 172.21.15.63:0/1630545935 >> v2:172.21.15.204:3300/0 conn(0x7fb5f8150c50 msgr2=0x7fb5f80719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:52.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.844+0000 7fb5f7e00640 1 --2- 172.21.15.63:0/1630545935 >> v2:172.21.15.204:3300/0 conn(0x7fb5f8150c50 0x7fb5f80719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.844+0000 7fb5f7e00640 1 -- 172.21.15.63:0/1630545935 >> v1:172.21.15.204:6789/0 conn(0x7fb5f8071f10 legacy=0x7fb5f815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.844+0000 7fb5f7e00640 1 -- 172.21.15.63:0/1630545935 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f815a540 con 0x7fb5f815e1c0 2024-03-26T06:17:52.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.844+0000 7fb5f7400640 1 --2- 172.21.15.63:0/1630545935 >> v2:172.21.15.204:3300/0 conn(0x7fb5f8150c50 0x7fb5f80719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:17:52.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.845+0000 7fb5f7e00640 1 --2- 172.21.15.63:0/1630545935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f815e1c0 0x7fb5f80b24a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009d90 tx=0x7fb5f002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b59dc4f63b6bb30 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:52.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.846+0000 7fb5f6000640 1 -- 172.21.15.63:0/1630545935 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0039070 con 0x7fb5f815e1c0 2024-03-26T06:17:52.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.846+0000 7fb5f6000640 1 -- 172.21.15.63:0/1630545935 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f002cbd0 con 0x7fb5f815e1c0 2024-03-26T06:17:52.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.846+0000 7fb5f6000640 1 -- 172.21.15.63:0/1630545935 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0034440 con 0x7fb5f815e1c0 2024-03-26T06:17:52.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.846+0000 7fb5fcc00640 1 -- 172.21.15.63:0/1630545935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f815e1c0 msgr2=0x7fb5f80b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.846+0000 7fb5fcc00640 1 --2- 172.21.15.63:0/1630545935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f815e1c0 0x7fb5f80b24a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009d90 tx=0x7fb5f002be20 comp rx=0 tx=0).stop 2024-03-26T06:17:52.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.847+0000 7fb5fcc00640 1 -- 172.21.15.63:0/1630545935 shutdown_connections 2024-03-26T06:17:52.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.847+0000 7fb5fcc00640 1 --2- 172.21.15.63:0/1630545935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f815e1c0 0x7fb5f80b24a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.847+0000 7fb5fcc00640 1 --2- 172.21.15.63:0/1630545935 >> v2:172.21.15.204:3300/0 conn(0x7fb5f8150c50 0x7fb5f80719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.847+0000 7fb5fcc00640 1 -- 172.21.15.63:0/1630545935 >> 172.21.15.63:0/1630545935 conn(0x7fb5f80670b0 msgr2=0x7fb5f80b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:52.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.847+0000 7fb5fcc00640 1 -- 172.21.15.63:0/1630545935 shutdown_connections 2024-03-26T06:17:52.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.847+0000 7fb5fcc00640 1 -- 172.21.15.63:0/1630545935 wait complete. 2024-03-26T06:17:52.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.849+0000 7fb5fcc00640 1 Processor -- start 2024-03-26T06:17:52.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.849+0000 7fb5fcc00640 1 -- start start 2024-03-26T06:17:52.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5fcc00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f8071f10 0x7fb5f81f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5fcc00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5f8150c50 0x7fb5f81f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5fcc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5f815e1c0 0x7fb5f80cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5fcc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f815ade0 con 0x7fb5f815e1c0 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5fcc00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f815ab00 con 0x7fb5f8150c50 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5fcc00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8151030 con 0x7fb5f8071f10 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5f815e1c0 0x7fb5f80cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5f815e1c0 0x7fb5f80cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47212/0 (socket says 172.21.15.63:47212) 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5f7e00640 1 -- 172.21.15.63:0/2176310362 learned_addr learned my addr 172.21.15.63:0/2176310362 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5f7400640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f8071f10 0x7fb5f81f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.850+0000 7fb5f6a00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5f8150c50 0x7fb5f81f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5f7e00640 1 -- 172.21.15.63:0/2176310362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f8071f10 msgr2=0x7fb5f81f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5f7e00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f8071f10 0x7fb5f81f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5f7e00640 1 -- 172.21.15.63:0/2176310362 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5f8150c50 msgr2=0x7fb5f81f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5f7e00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5f8150c50 0x7fb5f81f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5f7e00640 1 -- 172.21.15.63:0/2176310362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80afe70 con 0x7fb5f815e1c0 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5f6a00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5f8150c50 0x7fb5f81f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5f7e00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5f815e1c0 0x7fb5f80cdd30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009eb0 tx=0x7fb5f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5ef400640 1 -- 172.21.15.63:0/2176310362 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0044020 con 0x7fb5f815e1c0 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5ef400640 1 -- 172.21.15.63:0/2176310362 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f003f470 con 0x7fb5f815e1c0 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f80b0150 con 0x7fb5f815e1c0 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5ef400640 1 -- 172.21.15.63:0/2176310362 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0039040 con 0x7fb5f815e1c0 2024-03-26T06:17:52.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.851+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80acbc0 con 0x7fb5f815e1c0 2024-03-26T06:17:52.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.853+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f804f0c0 con 0x7fb5f815e1c0 2024-03-26T06:17:52.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.854+0000 7fb5ef400640 1 -- 172.21.15.63:0/2176310362 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb5f0005d10 con 0x7fb5f815e1c0 2024-03-26T06:17:52.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.854+0000 7fb5ef400640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb5d806bbd0 0x7fb5d806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:52.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.855+0000 7fb5ef400640 1 -- 172.21.15.63:0/2176310362 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb5f00ad7d0 con 0x7fb5f815e1c0 2024-03-26T06:17:52.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.855+0000 7fb5f7400640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb5d806bbd0 0x7fb5d806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:52.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.856+0000 7fb5f7400640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb5d806bbd0 0x7fb5d806e090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb5f814dca0 tx=0x7fb5e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:52.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:52.860+0000 7fb5ef400640 1 -- 172.21.15.63:0/2176310362 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb5f004e070 con 0x7fb5f815e1c0 2024-03-26T06:17:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.061+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5f80ae990 con 0x7fb5f815e1c0 2024-03-26T06:17:53.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.062+0000 7fb5ef400640 1 -- 172.21.15.63:0/2176310362 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5f007bf50 con 0x7fb5f815e1c0 2024-03-26T06:17:53.063 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb5d806bbd0 msgr2=0x7fb5d806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb5d806bbd0 0x7fb5d806e090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb5f814dca0 tx=0x7fb5e8008040 comp rx=0 tx=0).stop 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5f815e1c0 msgr2=0x7fb5f80cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5f815e1c0 0x7fb5f80cdd30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009eb0 tx=0x7fb5f0004a40 comp rx=0 tx=0).stop 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 shutdown_connections 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb5d806bbd0 0x7fb5d806e090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5f815e1c0 0x7fb5f80cdd30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5f8150c50 0x7fb5f81f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 --2- 172.21.15.63:0/2176310362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5f8071f10 0x7fb5f81f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.064+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 >> 172.21.15.63:0/2176310362 conn(0x7fb5f80670b0 msgr2=0x7fb5f814f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:53.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.065+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 shutdown_connections 2024-03-26T06:17:53.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.065+0000 7fb5fcc00640 1 -- 172.21.15.63:0/2176310362 wait complete. 2024-03-26T06:17:53.086 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:17:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.315+0000 7fa1ffe00640 1 Processor -- start 2024-03-26T06:17:53.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.315+0000 7fa1ffe00640 1 -- start start 2024-03-26T06:17:53.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.317+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20006d270 0x7fa200071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.317+0000 7fa1ffe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa20013eca0 0x7fa200071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.317+0000 7fa1ffe00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20015f410 con 0x7fa20013e650 2024-03-26T06:17:53.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.317+0000 7fa1ffe00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20015f6f0 con 0x7fa20013eca0 2024-03-26T06:17:53.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.317+0000 7fa1ffe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20015f9d0 con 0x7fa20006d270 2024-03-26T06:17:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.317+0000 7fa1ff400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa20013eca0 0x7fa200071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.317+0000 7fa1ff400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa20013eca0 0x7fa200071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47220/0 (socket says 172.21.15.63:47220) 2024-03-26T06:17:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.317+0000 7fa1ff400640 1 -- 172.21.15.63:0/2740326072 learned_addr learned my addr 172.21.15.63:0/2740326072 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.318+0000 7fa1f7e00640 1 --2- 172.21.15.63:0/2740326072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20006d270 0x7fa200071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.318+0000 7fa1ff400640 1 -- 172.21.15.63:0/2740326072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20006d270 msgr2=0x7fa200071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.318+0000 7fa1ff400640 1 --2- 172.21.15.63:0/2740326072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20006d270 0x7fa200071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.318+0000 7fa1ff400640 1 -- 172.21.15.63:0/2740326072 >> v1:172.21.15.204:6789/0 conn(0x7fa20013e650 legacy=0x7fa20006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.318+0000 7fa1ff400640 1 -- 172.21.15.63:0/2740326072 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20015fcb0 con 0x7fa20013eca0 2024-03-26T06:17:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.318+0000 7fa1f7e00640 1 --2- 172.21.15.63:0/2740326072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20006d270 0x7fa200071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.319+0000 7fa1ff400640 1 --2- 172.21.15.63:0/2740326072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013eca0 0x7fa200071680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009e50 tx=0x7fa1f802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538218f43661b06f server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.320+0000 7fa1fe000640 1 -- 172.21.15.63:0/2740326072 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f802cb90 con 0x7fa20013eca0 2024-03-26T06:17:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.320+0000 7fa1fe000640 1 -- 172.21.15.63:0/2740326072 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f802cd30 con 0x7fa20013eca0 2024-03-26T06:17:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.320+0000 7fa1fe000640 1 -- 172.21.15.63:0/2740326072 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8034610 con 0x7fa20013eca0 2024-03-26T06:17:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.320+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2740326072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013eca0 msgr2=0x7fa200071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.320+0000 7fa1ffe00640 1 --2- 172.21.15.63:0/2740326072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013eca0 0x7fa200071680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009e50 tx=0x7fa1f802bff0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.321+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2740326072 shutdown_connections 2024-03-26T06:17:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.321+0000 7fa1ffe00640 1 --2- 172.21.15.63:0/2740326072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013eca0 0x7fa200071680 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.321+0000 7fa1ffe00640 1 --2- 172.21.15.63:0/2740326072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20006d270 0x7fa200071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.321+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2740326072 >> 172.21.15.63:0/2740326072 conn(0x7fa2000670b0 msgr2=0x7fa2000b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.321+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2740326072 shutdown_connections 2024-03-26T06:17:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.321+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2740326072 wait complete. 2024-03-26T06:17:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.322+0000 7fa1ffe00640 1 Processor -- start 2024-03-26T06:17:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.323+0000 7fa1ffe00640 1 -- start start 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa20006d270 0x7fa20013d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013e650 0x7fa200158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20013eca0 0x7fa20013ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1ffe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200140eb0 con 0x7fa20013e650 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1ffe00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200140d30 con 0x7fa20006d270 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1ffe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa200141030 con 0x7fa20013eca0 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013e650 0x7fa200158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013e650 0x7fa200158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47224/0 (socket says 172.21.15.63:47224) 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1f7e00640 1 -- 172.21.15.63:0/2189097355 learned_addr learned my addr 172.21.15.63:0/2189097355 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1ff400640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20013eca0 0x7fa20013ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1f7e00640 1 -- 172.21.15.63:0/2189097355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20013eca0 msgr2=0x7fa20013ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1fea00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa20006d270 0x7fa20013d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1f7e00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20013eca0 0x7fa20013ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1f7e00640 1 -- 172.21.15.63:0/2189097355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa20006d270 msgr2=0x7fa20013d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1f7e00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa20006d270 0x7fa20013d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.324+0000 7fa1f7e00640 1 -- 172.21.15.63:0/2189097355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2001e5ba0 con 0x7fa20013e650 2024-03-26T06:17:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.325+0000 7fa1f7e00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013e650 0x7fa200158be0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800c7f0 tx=0x7fa1e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.325+0000 7fa1f6a00640 1 -- 172.21.15.63:0/2189097355 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8015070 con 0x7fa20013e650 2024-03-26T06:17:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.325+0000 7fa1f6a00640 1 -- 172.21.15.63:0/2189097355 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e8007a30 con 0x7fa20013e650 2024-03-26T06:17:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.325+0000 7fa1f6a00640 1 -- 172.21.15.63:0/2189097355 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8007e00 con 0x7fa20013e650 2024-03-26T06:17:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.325+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2001e5e80 con 0x7fa20013e650 2024-03-26T06:17:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.325+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2001e6440 con 0x7fa20013e650 2024-03-26T06:17:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.326+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20004f0c0 con 0x7fa20013e650 2024-03-26T06:17:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.327+0000 7fa1f6a00640 1 -- 172.21.15.63:0/2189097355 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa1e8018070 con 0x7fa20013e650 2024-03-26T06:17:53.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.328+0000 7fa1f6a00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa1dc06bbd0 0x7fa1dc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.328+0000 7fa1f6a00640 1 -- 172.21.15.63:0/2189097355 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa1e808ae50 con 0x7fa20013e650 2024-03-26T06:17:53.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.329+0000 7fa1fea00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa1dc06bbd0 0x7fa1dc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.329+0000 7fa1fea00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa1dc06bbd0 0x7fa1dc06e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2000cbd00 tx=0x7fa1f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:53.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.333+0000 7fa1f6a00640 1 -- 172.21.15.63:0/2189097355 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa1e8059530 con 0x7fa20013e650 2024-03-26T06:17:53.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.537+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2001e6610 con 0x7fa20013e650 2024-03-26T06:17:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.538+0000 7fa1f6a00640 1 -- 172.21.15.63:0/2189097355 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa1e8058e30 con 0x7fa20013e650 2024-03-26T06:17:53.539 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:17:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.540+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa1dc06bbd0 msgr2=0x7fa1dc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.540+0000 7fa1ffe00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa1dc06bbd0 0x7fa1dc06e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2000cbd00 tx=0x7fa1f0009040 comp rx=0 tx=0).stop 2024-03-26T06:17:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.540+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013e650 msgr2=0x7fa200158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.540+0000 7fa1ffe00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013e650 0x7fa200158be0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800c7f0 tx=0x7fa1e800cbf0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.541+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 shutdown_connections 2024-03-26T06:17:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.541+0000 7fa1ffe00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa1dc06bbd0 0x7fa1dc06e090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.541+0000 7fa1ffe00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa20013eca0 0x7fa20013ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.541+0000 7fa1ffe00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa20013e650 0x7fa200158be0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.541+0000 7fa1ffe00640 1 --2- 172.21.15.63:0/2189097355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa20006d270 0x7fa20013d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.541+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 >> 172.21.15.63:0/2189097355 conn(0x7fa2000670b0 msgr2=0x7fa20006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:53.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.541+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 shutdown_connections 2024-03-26T06:17:53.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.541+0000 7fa1ffe00640 1 -- 172.21.15.63:0/2189097355 wait complete. 2024-03-26T06:17:53.563 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:17:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.779+0000 7f8d4fe00640 1 Processor -- start 2024-03-26T06:17:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.779+0000 7f8d4fe00640 1 -- start start 2024-03-26T06:17:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.780+0000 7f8d4fe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d480cfd60 0x7f8d480b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.780+0000 7f8d4fe00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8d48071a00 0x7f8d480ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.780+0000 7f8d4fe00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d480d0140 con 0x7f8d48144c70 2024-03-26T06:17:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.780+0000 7f8d4fe00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d480b4b10 con 0x7f8d480cfd60 2024-03-26T06:17:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.780+0000 7f8d4fe00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d480b3530 con 0x7f8d48071a00 2024-03-26T06:17:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4d400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d480cfd60 0x7f8d480b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4d400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d480cfd60 0x7f8d480b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47234/0 (socket says 172.21.15.63:47234) 2024-03-26T06:17:53.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4d400640 1 -- 172.21.15.63:0/2152359447 learned_addr learned my addr 172.21.15.63:0/2152359447 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:53.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4ca00640 1 --1- 172.21.15.63:0/2152359447 >> v1:172.21.15.63:6789/0 conn(0x7f8d48144c70 0x7f8d480712f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42410/0 (socket says 172.21.15.63:42410) 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4d400640 1 -- 172.21.15.63:0/2152359447 >> v2:172.21.15.204:3300/0 conn(0x7f8d48071a00 msgr2=0x7f8d480ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4de00640 1 --2- 172.21.15.63:0/2152359447 >> v2:172.21.15.204:3300/0 conn(0x7f8d48071a00 0x7f8d480ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4d400640 1 --2- 172.21.15.63:0/2152359447 >> v2:172.21.15.204:3300/0 conn(0x7f8d48071a00 0x7f8d480ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4d400640 1 -- 172.21.15.63:0/2152359447 >> v1:172.21.15.63:6789/0 conn(0x7f8d48144c70 legacy=0x7f8d480712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d47e00640 1 -- 172.21.15.63:0/2152359447 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396459260 0 0) 0x7f8d480d0140 con 0x7f8d48144c70 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4d400640 1 -- 172.21.15.63:0/2152359447 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d480b3810 con 0x7f8d480cfd60 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.781+0000 7f8d4de00640 1 --2- 172.21.15.63:0/2152359447 >> v2:172.21.15.204:3300/0 conn(0x7f8d48071a00 0x7f8d480ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.783+0000 7f8d4d400640 1 --2- 172.21.15.63:0/2152359447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d480cfd60 0x7f8d480b45d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8d480af220 tx=0x7f8d3c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10adbdf7baa5405 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.783+0000 7f8d47e00640 1 -- 172.21.15.63:0/2152359447 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c034070 con 0x7f8d480cfd60 2024-03-26T06:17:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.783+0000 7f8d47e00640 1 -- 172.21.15.63:0/2152359447 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c030860 con 0x7f8d480cfd60 2024-03-26T06:17:53.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.783+0000 7f8d47e00640 1 -- 172.21.15.63:0/2152359447 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c030c30 con 0x7f8d480cfd60 2024-03-26T06:17:53.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.784+0000 7f8d4fe00640 1 -- 172.21.15.63:0/2152359447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d480cfd60 msgr2=0x7f8d480b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.784+0000 7f8d4fe00640 1 --2- 172.21.15.63:0/2152359447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d480cfd60 0x7f8d480b45d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8d480af220 tx=0x7f8d3c02b9a0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.784+0000 7f8d4fe00640 1 -- 172.21.15.63:0/2152359447 shutdown_connections 2024-03-26T06:17:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.784+0000 7f8d4fe00640 1 --2- 172.21.15.63:0/2152359447 >> v2:172.21.15.204:3300/0 conn(0x7f8d48071a00 0x7f8d480ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.784+0000 7f8d4fe00640 1 --2- 172.21.15.63:0/2152359447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d480cfd60 0x7f8d480b45d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.784+0000 7f8d4fe00640 1 -- 172.21.15.63:0/2152359447 >> 172.21.15.63:0/2152359447 conn(0x7f8d4806ac90 msgr2=0x7f8d4806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.784+0000 7f8d4fe00640 1 -- 172.21.15.63:0/2152359447 shutdown_connections 2024-03-26T06:17:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.784+0000 7f8d4fe00640 1 -- 172.21.15.63:0/2152359447 wait complete. 2024-03-26T06:17:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.785+0000 7f8d4fe00640 1 Processor -- start 2024-03-26T06:17:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.786+0000 7f8d4fe00640 1 -- start start 2024-03-26T06:17:53.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.786+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d48071a00 0x7f8d4815ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d480cfd60 0x7f8d4815f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d48144c70 0x7f8d4815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4fe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480b40b0 con 0x7f8d48144c70 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4fe00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480b3dd0 con 0x7f8d48071a00 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4fe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480b31c0 con 0x7f8d480cfd60 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d48144c70 0x7f8d4815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d48144c70 0x7f8d4815fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47250/0 (socket says 172.21.15.63:47250) 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4de00640 1 -- 172.21.15.63:0/80386613 learned_addr learned my addr 172.21.15.63:0/80386613 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4ca00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d480cfd60 0x7f8d4815f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4d400640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d48071a00 0x7f8d4815ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4de00640 1 -- 172.21.15.63:0/80386613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d480cfd60 msgr2=0x7f8d4815f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4de00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d480cfd60 0x7f8d4815f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4de00640 1 -- 172.21.15.63:0/80386613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d48071a00 msgr2=0x7f8d4815ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4de00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d48071a00 0x7f8d4815ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.787+0000 7f8d4de00640 1 -- 172.21.15.63:0/80386613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4815b2b0 con 0x7f8d48144c70 2024-03-26T06:17:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.788+0000 7f8d4de00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d48144c70 0x7f8d4815fb40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000cd80 tx=0x7f8d4000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.788+0000 7f8d45600640 1 -- 172.21.15.63:0/80386613 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000f680 con 0x7f8d48144c70 2024-03-26T06:17:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.788+0000 7f8d45600640 1 -- 172.21.15.63:0/80386613 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4000f840 con 0x7f8d48144c70 2024-03-26T06:17:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.788+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d480ad530 con 0x7f8d48144c70 2024-03-26T06:17:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.788+0000 7f8d45600640 1 -- 172.21.15.63:0/80386613 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000fc30 con 0x7f8d48144c70 2024-03-26T06:17:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.788+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d480adaf0 con 0x7f8d48144c70 2024-03-26T06:17:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.789+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d48074730 con 0x7f8d48144c70 2024-03-26T06:17:53.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.790+0000 7f8d45600640 1 -- 172.21.15.63:0/80386613 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8d400213f0 con 0x7f8d48144c70 2024-03-26T06:17:53.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.791+0000 7f8d45600640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d2806bbd0 0x7f8d2806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:53.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.791+0000 7f8d45600640 1 -- 172.21.15.63:0/80386613 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8d4008bcf0 con 0x7f8d48144c70 2024-03-26T06:17:53.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.792+0000 7f8d4d400640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d2806bbd0 0x7f8d2806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:53.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.792+0000 7f8d4d400640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d2806bbd0 0x7f8d2806e090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c036000 tx=0x7f8d3c03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:53.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:53.796+0000 7f8d45600640 1 -- 172.21.15.63:0/80386613 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8d40014030 con 0x7f8d48144c70 2024-03-26T06:17:54.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.001+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8d480b48f0 con 0x7f8d48144c70 2024-03-26T06:17:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.002+0000 7f8d45600640 1 -- 172.21.15.63:0/80386613 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8d4005a340 con 0x7f8d48144c70 2024-03-26T06:17:54.003 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d2806bbd0 msgr2=0x7f8d2806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d2806bbd0 0x7f8d2806e090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c036000 tx=0x7f8d3c03b040 comp rx=0 tx=0).stop 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d48144c70 msgr2=0x7f8d4815fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d48144c70 0x7f8d4815fb40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000cd80 tx=0x7f8d4000a650 comp rx=0 tx=0).stop 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 shutdown_connections 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d2806bbd0 0x7f8d2806e090 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d48144c70 0x7f8d4815fb40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d480cfd60 0x7f8d4815f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 --2- 172.21.15.63:0/80386613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d48071a00 0x7f8d4815ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 >> 172.21.15.63:0/80386613 conn(0x7f8d4806ac90 msgr2=0x7f8d480712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.005+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 shutdown_connections 2024-03-26T06:17:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.006+0000 7f8d4fe00640 1 -- 172.21.15.63:0/80386613 wait complete. 2024-03-26T06:17:54.026 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.245+0000 7f2e48e00640 1 Processor -- start 2024-03-26T06:17:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.245+0000 7f2e48e00640 1 -- start start 2024-03-26T06:17:54.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.247+0000 7f2e48e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e440b4c50 0x7f2e440ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.247+0000 7f2e48e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b5030 0x7f2e4415f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.247+0000 7f2e48e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e440cc070 con 0x7f2e4415f880 2024-03-26T06:17:54.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.247+0000 7f2e48e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4415fde0 con 0x7f2e440b4c50 2024-03-26T06:17:54.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.247+0000 7f2e48e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e441600c0 con 0x7f2e440b5030 2024-03-26T06:17:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.247+0000 7f2e43400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e440b4c50 0x7f2e440ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.247+0000 7f2e43e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2e4415f880 0x7f2e44144b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42420/0 (socket says 172.21.15.63:42420) 2024-03-26T06:17:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.247+0000 7f2e43e00640 1 -- 172.21.15.63:0/3667660363 learned_addr learned my addr 172.21.15.63:0/3667660363 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.248+0000 7f2e42a00640 1 --2- 172.21.15.63:0/3667660363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b5030 0x7f2e4415f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.248+0000 7f2e43400640 1 -- 172.21.15.63:0/3667660363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b5030 msgr2=0x7f2e4415f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.248+0000 7f2e43400640 1 --2- 172.21.15.63:0/3667660363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b5030 0x7f2e4415f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.248+0000 7f2e43400640 1 -- 172.21.15.63:0/3667660363 >> v1:172.21.15.63:6789/0 conn(0x7f2e4415f880 legacy=0x7f2e44144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.248+0000 7f2e43400640 1 -- 172.21.15.63:0/3667660363 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e440cc310 con 0x7f2e440b4c50 2024-03-26T06:17:54.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.248+0000 7f2e42000640 1 -- 172.21.15.63:0/3667660363 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496434031 0 0) 0x7f2e440cc070 con 0x7f2e4415f880 2024-03-26T06:17:54.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.249+0000 7f2e43400640 1 --2- 172.21.15.63:0/3667660363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e440b4c50 0x7f2e440ccaf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e340097a0 tx=0x7f2e3402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bea0c0b55d2c2b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:54.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e42000640 1 -- 172.21.15.63:0/3667660363 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34034070 con 0x7f2e440b4c50 2024-03-26T06:17:54.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e42000640 1 -- 172.21.15.63:0/3667660363 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34030610 con 0x7f2e440b4c50 2024-03-26T06:17:54.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e42000640 1 -- 172.21.15.63:0/3667660363 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340309e0 con 0x7f2e440b4c50 2024-03-26T06:17:54.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e48e00640 1 -- 172.21.15.63:0/3667660363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e440b4c50 msgr2=0x7f2e440ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e48e00640 1 --2- 172.21.15.63:0/3667660363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e440b4c50 0x7f2e440ccaf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e340097a0 tx=0x7f2e3402b960 comp rx=0 tx=0).stop 2024-03-26T06:17:54.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e48e00640 1 -- 172.21.15.63:0/3667660363 shutdown_connections 2024-03-26T06:17:54.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e48e00640 1 --2- 172.21.15.63:0/3667660363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b5030 0x7f2e4415f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e48e00640 1 --2- 172.21.15.63:0/3667660363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e440b4c50 0x7f2e440ccaf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e48e00640 1 -- 172.21.15.63:0/3667660363 >> 172.21.15.63:0/3667660363 conn(0x7f2e440b13d0 msgr2=0x7f2e440b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:54.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.250+0000 7f2e48e00640 1 -- 172.21.15.63:0/3667660363 shutdown_connections 2024-03-26T06:17:54.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.251+0000 7f2e48e00640 1 -- 172.21.15.63:0/3667660363 wait complete. 2024-03-26T06:17:54.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.252+0000 7f2e48e00640 1 Processor -- start 2024-03-26T06:17:54.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.252+0000 7f2e48e00640 1 -- start start 2024-03-26T06:17:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.253+0000 7f2e48e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b4c50 0x7f2e440cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.253+0000 7f2e48e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e440b5030 0x7f2e440c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.253+0000 7f2e48e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e4415f880 0x7f2e440c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.253+0000 7f2e48e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e44145260 con 0x7f2e4415f880 2024-03-26T06:17:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.253+0000 7f2e48e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4406eb70 con 0x7f2e440b5030 2024-03-26T06:17:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.253+0000 7f2e48e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e441453e0 con 0x7f2e440b4c50 2024-03-26T06:17:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.254+0000 7f2e43e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e4415f880 0x7f2e440c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.254+0000 7f2e43e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e4415f880 0x7f2e440c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47264/0 (socket says 172.21.15.63:47264) 2024-03-26T06:17:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.254+0000 7f2e43e00640 1 -- 172.21.15.63:0/4289234090 learned_addr learned my addr 172.21.15.63:0/4289234090 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.254+0000 7f2e43400640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b4c50 0x7f2e440cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.254+0000 7f2e43e00640 1 -- 172.21.15.63:0/4289234090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b4c50 msgr2=0x7f2e440cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.254+0000 7f2e43e00640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b4c50 0x7f2e440cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.254+0000 7f2e43e00640 1 -- 172.21.15.63:0/4289234090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e440b5030 msgr2=0x7f2e440c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.254+0000 7f2e43e00640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e440b5030 0x7f2e440c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.254+0000 7f2e43e00640 1 -- 172.21.15.63:0/4289234090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e440c56f0 con 0x7f2e4415f880 2024-03-26T06:17:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.255+0000 7f2e43e00640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e4415f880 0x7f2e440c77d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00caf0 tx=0x7f2e3c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.255+0000 7f2e3b400640 1 -- 172.21.15.63:0/4289234090 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00abd0 con 0x7f2e4415f880 2024-03-26T06:17:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.255+0000 7f2e3b400640 1 -- 172.21.15.63:0/4289234090 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c00ad70 con 0x7f2e4415f880 2024-03-26T06:17:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.255+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e440c59d0 con 0x7f2e4415f880 2024-03-26T06:17:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.255+0000 7f2e3b400640 1 -- 172.21.15.63:0/4289234090 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c012640 con 0x7f2e4415f880 2024-03-26T06:17:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.255+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e440c5f90 con 0x7f2e4415f880 2024-03-26T06:17:54.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.256+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4404f050 con 0x7f2e4415f880 2024-03-26T06:17:54.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.257+0000 7f2e3b400640 1 -- 172.21.15.63:0/4289234090 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2e3c0127e0 con 0x7f2e4415f880 2024-03-26T06:17:54.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.258+0000 7f2e3b400640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2e2406bbd0 0x7f2e2406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.258+0000 7f2e3b400640 1 -- 172.21.15.63:0/4289234090 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2e3c08b530 con 0x7f2e4415f880 2024-03-26T06:17:54.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.258+0000 7f2e43400640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2e2406bbd0 0x7f2e2406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.259+0000 7f2e43400640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2e2406bbd0 0x7f2e2406e090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2e34036000 tx=0x7f2e34008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:54.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.263+0000 7f2e3b400640 1 -- 172.21.15.63:0/4289234090 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2e3c059b80 con 0x7f2e4415f880 2024-03-26T06:17:54.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.466+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e4406e400 con 0x7f2e4415f880 2024-03-26T06:17:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.468+0000 7f2e3b400640 1 -- 172.21.15.63:0/4289234090 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7f2e3c059480 con 0x7f2e4415f880 2024-03-26T06:17:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:54.470 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2e2406bbd0 msgr2=0x7f2e2406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2e2406bbd0 0x7f2e2406e090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2e34036000 tx=0x7f2e34008030 comp rx=0 tx=0).stop 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e4415f880 msgr2=0x7f2e440c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e4415f880 0x7f2e440c77d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00caf0 tx=0x7f2e3c002190 comp rx=0 tx=0).stop 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 shutdown_connections 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2e2406bbd0 0x7f2e2406e090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e4415f880 0x7f2e440c77d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e440b5030 0x7f2e440c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 --2- 172.21.15.63:0/4289234090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e440b4c50 0x7f2e440cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.471+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 >> 172.21.15.63:0/4289234090 conn(0x7f2e440b13d0 msgr2=0x7f2e440cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.472+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 shutdown_connections 2024-03-26T06:17:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.472+0000 7f2e48e00640 1 -- 172.21.15.63:0/4289234090 wait complete. 2024-03-26T06:17:54.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:17:54.494 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:17:54.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.718+0000 7fa27e400640 1 Processor -- start 2024-03-26T06:17:54.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.718+0000 7fa27e400640 1 -- start start 2024-03-26T06:17:54.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa27e400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa278071850 0x7fa27806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa27e400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa27815dec0 0x7fa27815e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa27e400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27815e8b0 con 0x7fa278143eb0 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa27e400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa278144290 con 0x7fa278071850 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa27e400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27815ee60 con 0x7fa27815dec0 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa277e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa278071850 0x7fa27806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa277e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa278071850 0x7fa27806dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47274/0 (socket says 172.21.15.63:47274) 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa277e00640 1 -- 172.21.15.63:0/2795407821 learned_addr learned my addr 172.21.15.63:0/2795407821 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa27d000640 1 --1- 172.21.15.63:0/2795407821 >> v1:172.21.15.63:6789/0 conn(0x7fa278143eb0 0x7fa278071140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42424/0 (socket says 172.21.15.63:42424) 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa27da00640 1 --2- 172.21.15.63:0/2795407821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa27815dec0 0x7fa27815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.720+0000 7fa277e00640 1 -- 172.21.15.63:0/2795407821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa27815dec0 msgr2=0x7fa27815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.721+0000 7fa277e00640 1 --2- 172.21.15.63:0/2795407821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa27815dec0 0x7fa27815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.721+0000 7fa277e00640 1 -- 172.21.15.63:0/2795407821 >> v1:172.21.15.63:6789/0 conn(0x7fa278143eb0 legacy=0x7fa278071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.721+0000 7fa277e00640 1 -- 172.21.15.63:0/2795407821 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27815eb80 con 0x7fa278071850 2024-03-26T06:17:54.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.721+0000 7fa27da00640 1 --2- 172.21.15.63:0/2795407821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa27815dec0 0x7fa27815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.722+0000 7fa277e00640 1 --2- 172.21.15.63:0/2795407821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278071850 0x7fa27806dd80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa264009870 tx=0x7fa26402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab6d4da87c8235f server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.722+0000 7fa277400640 1 -- 172.21.15.63:0/2795407821 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264035020 con 0x7fa278071850 2024-03-26T06:17:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.722+0000 7fa277400640 1 -- 172.21.15.63:0/2795407821 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264031640 con 0x7fa278071850 2024-03-26T06:17:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.722+0000 7fa277400640 1 -- 172.21.15.63:0/2795407821 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26402d040 con 0x7fa278071850 2024-03-26T06:17:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.723+0000 7fa27e400640 1 -- 172.21.15.63:0/2795407821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278071850 msgr2=0x7fa27806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.723+0000 7fa27e400640 1 --2- 172.21.15.63:0/2795407821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278071850 0x7fa27806dd80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa264009870 tx=0x7fa26402b8f0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.723+0000 7fa27e400640 1 -- 172.21.15.63:0/2795407821 shutdown_connections 2024-03-26T06:17:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.723+0000 7fa27e400640 1 --2- 172.21.15.63:0/2795407821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278071850 0x7fa27806dd80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.723+0000 7fa27e400640 1 --2- 172.21.15.63:0/2795407821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa27815dec0 0x7fa27815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.723+0000 7fa27e400640 1 -- 172.21.15.63:0/2795407821 >> 172.21.15.63:0/2795407821 conn(0x7fa2780670b0 msgr2=0x7fa2780b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:54.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.723+0000 7fa27e400640 1 -- 172.21.15.63:0/2795407821 shutdown_connections 2024-03-26T06:17:54.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.723+0000 7fa27e400640 1 -- 172.21.15.63:0/2795407821 wait complete. 2024-03-26T06:17:54.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.724+0000 7fa27e400640 1 Processor -- start 2024-03-26T06:17:54.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.725+0000 7fa27e400640 1 -- start start 2024-03-26T06:17:54.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.725+0000 7fa27e400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa278071850 0x7fa27815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.725+0000 7fa27e400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278143eb0 0x7fa2780aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.725+0000 7fa27e400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa27815dec0 0x7fa2780cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.725+0000 7fa27e400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27806d860 con 0x7fa278143eb0 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.725+0000 7fa27e400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27806d580 con 0x7fa27815dec0 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.725+0000 7fa27e400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780adbc0 con 0x7fa278071850 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa277e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278143eb0 0x7fa2780aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa277e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278143eb0 0x7fa2780aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47282/0 (socket says 172.21.15.63:47282) 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa277e00640 1 -- 172.21.15.63:0/1545305267 learned_addr learned my addr 172.21.15.63:0/1545305267 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa27d000640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa278071850 0x7fa27815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa27da00640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa27815dec0 0x7fa2780cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa277e00640 1 -- 172.21.15.63:0/1545305267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa278071850 msgr2=0x7fa27815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa277e00640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa278071850 0x7fa27815b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa277e00640 1 -- 172.21.15.63:0/1545305267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa27815dec0 msgr2=0x7fa2780cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa277e00640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa27815dec0 0x7fa2780cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa277e00640 1 -- 172.21.15.63:0/1545305267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780ccfe0 con 0x7fa278143eb0 2024-03-26T06:17:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.726+0000 7fa27da00640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa27815dec0 0x7fa2780cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:54.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.727+0000 7fa277e00640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278143eb0 0x7fa2780aff40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa264000c00 tx=0x7fa2640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:54.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.727+0000 7fa274c00640 1 -- 172.21.15.63:0/1545305267 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264040070 con 0x7fa278143eb0 2024-03-26T06:17:54.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.727+0000 7fa274c00640 1 -- 172.21.15.63:0/1545305267 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264039bf0 con 0x7fa278143eb0 2024-03-26T06:17:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.727+0000 7fa274c00640 1 -- 172.21.15.63:0/1545305267 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264035040 con 0x7fa278143eb0 2024-03-26T06:17:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.727+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2780cd2c0 con 0x7fa278143eb0 2024-03-26T06:17:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.727+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2780cd880 con 0x7fa278143eb0 2024-03-26T06:17:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.728+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27804f0c0 con 0x7fa278143eb0 2024-03-26T06:17:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.729+0000 7fa274c00640 1 -- 172.21.15.63:0/1545305267 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa26404b060 con 0x7fa278143eb0 2024-03-26T06:17:54.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.730+0000 7fa274c00640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa25806bbd0 0x7fa25806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:54.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.730+0000 7fa274c00640 1 -- 172.21.15.63:0/1545305267 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa2640aca10 con 0x7fa278143eb0 2024-03-26T06:17:54.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.730+0000 7fa27d000640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa25806bbd0 0x7fa25806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:54.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.731+0000 7fa27d000640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa25806bbd0 0x7fa25806e090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa26c000f60 tx=0x7fa26c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:54.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.734+0000 7fa274c00640 1 -- 172.21.15.63:0/1545305267 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa26402f300 con 0x7fa278143eb0 2024-03-26T06:17:54.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.938+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2780b0eb0 con 0x7fa278143eb0 2024-03-26T06:17:54.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.939+0000 7fa274c00640 1 -- 172.21.15.63:0/1545305267 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa26407b060 con 0x7fa278143eb0 2024-03-26T06:17:54.941 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:17:54.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa25806bbd0 msgr2=0x7fa25806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa25806bbd0 0x7fa25806e090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa26c000f60 tx=0x7fa26c009040 comp rx=0 tx=0).stop 2024-03-26T06:17:54.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278143eb0 msgr2=0x7fa2780aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:54.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278143eb0 0x7fa2780aff40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa264000c00 tx=0x7fa2640046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 shutdown_connections 2024-03-26T06:17:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa25806bbd0 0x7fa25806e090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa27815dec0 0x7fa2780cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa278143eb0 0x7fa2780aff40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 --2- 172.21.15.63:0/1545305267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa278071850 0x7fa27815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 >> 172.21.15.63:0/1545305267 conn(0x7fa2780670b0 msgr2=0x7fa27813acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:54.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 shutdown_connections 2024-03-26T06:17:54.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:54.942+0000 7fa27e400640 1 -- 172.21.15.63:0/1545305267 wait complete. 2024-03-26T06:17:54.963 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:17:55.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.178+0000 7f5c8a000640 1 Processor -- start 2024-03-26T06:17:55.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.178+0000 7f5c8a000640 1 -- start start 2024-03-26T06:17:55.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.180+0000 7f5c8a000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5c8413e650 0x7f5c8406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.180+0000 7f5c8a000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5c8406d270 0x7f5c84071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.180+0000 7f5c8a000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8415f410 con 0x7f5c8413eca0 2024-03-26T06:17:55.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.180+0000 7f5c8a000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8415f6f0 con 0x7f5c8413e650 2024-03-26T06:17:55.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.180+0000 7f5c8a000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8415f9d0 con 0x7f5c8406d270 2024-03-26T06:17:55.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.180+0000 7f5c88c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5c8413e650 0x7f5c8406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.180+0000 7f5c88c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5c8413e650 0x7f5c8406daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47284/0 (socket says 172.21.15.63:47284) 2024-03-26T06:17:55.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.180+0000 7f5c88c00640 1 -- 172.21.15.63:0/1669959837 learned_addr learned my addr 172.21.15.63:0/1669959837 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:55.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.181+0000 7f5c83e00640 1 --2- 172.21.15.63:0/1669959837 >> v2:172.21.15.204:3300/0 conn(0x7f5c8406d270 0x7f5c84071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.181+0000 7f5c88c00640 1 -- 172.21.15.63:0/1669959837 >> v2:172.21.15.204:3300/0 conn(0x7f5c8406d270 msgr2=0x7f5c84071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:55.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.181+0000 7f5c88c00640 1 --2- 172.21.15.63:0/1669959837 >> v2:172.21.15.204:3300/0 conn(0x7f5c8406d270 0x7f5c84071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.181+0000 7f5c88c00640 1 -- 172.21.15.63:0/1669959837 >> v1:172.21.15.63:6789/0 conn(0x7f5c8413eca0 legacy=0x7f5c8406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.181+0000 7f5c88c00640 1 -- 172.21.15.63:0/1669959837 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8415fcb0 con 0x7f5c8413e650 2024-03-26T06:17:55.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.181+0000 7f5c83e00640 1 --2- 172.21.15.63:0/1669959837 >> v2:172.21.15.204:3300/0 conn(0x7f5c8406d270 0x7f5c84071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:55.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.182+0000 7f5c88c00640 1 --2- 172.21.15.63:0/1669959837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 0x7f5c8406daf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009870 tx=0x7f5c7802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1067a3fdc718dcf server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:55.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.182+0000 7f5c83400640 1 -- 172.21.15.63:0/1669959837 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78034070 con 0x7f5c8413e650 2024-03-26T06:17:55.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.182+0000 7f5c83400640 1 -- 172.21.15.63:0/1669959837 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c78030850 con 0x7f5c8413e650 2024-03-26T06:17:55.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.182+0000 7f5c83400640 1 -- 172.21.15.63:0/1669959837 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78030c20 con 0x7f5c8413e650 2024-03-26T06:17:55.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.183+0000 7f5c8a000640 1 -- 172.21.15.63:0/1669959837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 msgr2=0x7f5c8406daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.183+0000 7f5c8a000640 1 --2- 172.21.15.63:0/1669959837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 0x7f5c8406daf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009870 tx=0x7f5c7802b990 comp rx=0 tx=0).stop 2024-03-26T06:17:55.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.183+0000 7f5c8a000640 1 -- 172.21.15.63:0/1669959837 shutdown_connections 2024-03-26T06:17:55.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.183+0000 7f5c8a000640 1 --2- 172.21.15.63:0/1669959837 >> v2:172.21.15.204:3300/0 conn(0x7f5c8406d270 0x7f5c84071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.183+0000 7f5c8a000640 1 --2- 172.21.15.63:0/1669959837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 0x7f5c8406daf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.183+0000 7f5c8a000640 1 -- 172.21.15.63:0/1669959837 >> 172.21.15.63:0/1669959837 conn(0x7f5c840670b0 msgr2=0x7f5c840b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:55.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.183+0000 7f5c8a000640 1 -- 172.21.15.63:0/1669959837 shutdown_connections 2024-03-26T06:17:55.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.183+0000 7f5c8a000640 1 -- 172.21.15.63:0/1669959837 wait complete. 2024-03-26T06:17:55.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.185+0000 7f5c8a000640 1 Processor -- start 2024-03-26T06:17:55.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.185+0000 7f5c8a000640 1 -- start start 2024-03-26T06:17:55.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.186+0000 7f5c8a000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c8406d270 0x7f5c84130bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.186+0000 7f5c8a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 0x7f5c841f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.186+0000 7f5c8a000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8413eca0 0x7f5c841e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.186+0000 7f5c8a000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84071680 con 0x7f5c8413e650 2024-03-26T06:17:55.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.186+0000 7f5c8a000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8406e030 con 0x7f5c8406d270 2024-03-26T06:17:55.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.186+0000 7f5c8a000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84071800 con 0x7f5c8413eca0 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c83e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 0x7f5c841f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c83e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 0x7f5c841f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47292/0 (socket says 172.21.15.63:47292) 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c83e00640 1 -- 172.21.15.63:0/1050173397 learned_addr learned my addr 172.21.15.63:0/1050173397 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c88c00640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c8406d270 0x7f5c84130bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c89600640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8413eca0 0x7f5c841e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c83e00640 1 -- 172.21.15.63:0/1050173397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8413eca0 msgr2=0x7f5c841e59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c83e00640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8413eca0 0x7f5c841e59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c83e00640 1 -- 172.21.15.63:0/1050173397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c8406d270 msgr2=0x7f5c84130bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c83e00640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c8406d270 0x7f5c84130bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c83e00640 1 -- 172.21.15.63:0/1050173397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c841e6470 con 0x7f5c8413e650 2024-03-26T06:17:55.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.187+0000 7f5c83e00640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 0x7f5c841f36f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400c7f0 tx=0x7f5c7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:55.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.188+0000 7f5c80c00640 1 -- 172.21.15.63:0/1050173397 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74015070 con 0x7f5c8413e650 2024-03-26T06:17:55.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.188+0000 7f5c80c00640 1 -- 172.21.15.63:0/1050173397 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74007a30 con 0x7f5c8413e650 2024-03-26T06:17:55.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.188+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c841e6750 con 0x7f5c8413e650 2024-03-26T06:17:55.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.188+0000 7f5c80c00640 1 -- 172.21.15.63:0/1050173397 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74007e00 con 0x7f5c8413e650 2024-03-26T06:17:55.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.188+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c841e6d10 con 0x7f5c8413e650 2024-03-26T06:17:55.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.189+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8404f0c0 con 0x7f5c8413e650 2024-03-26T06:17:55.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.190+0000 7f5c80c00640 1 -- 172.21.15.63:0/1050173397 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5c74018070 con 0x7f5c8413e650 2024-03-26T06:17:55.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.191+0000 7f5c80c00640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5c6806bbd0 0x7f5c6806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.191+0000 7f5c80c00640 1 -- 172.21.15.63:0/1050173397 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5c7408adb0 con 0x7f5c8413e650 2024-03-26T06:17:55.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.191+0000 7f5c88c00640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5c6806bbd0 0x7f5c6806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.192+0000 7f5c88c00640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5c6806bbd0 0x7f5c6806e090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5c78036000 tx=0x7f5c7803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:55.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.196+0000 7f5c80c00640 1 -- 172.21.15.63:0/1050173397 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f5c7408f070 con 0x7f5c8413e650 2024-03-26T06:17:55.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.399+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c8406e2a0 con 0x7f5c8413e650 2024-03-26T06:17:55.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.399+0000 7f5c80c00640 1 -- 172.21.15.63:0/1050173397 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c74059490 con 0x7f5c8413e650 2024-03-26T06:17:55.401 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:55.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5c6806bbd0 msgr2=0x7f5c6806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5c6806bbd0 0x7f5c6806e090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5c78036000 tx=0x7f5c7803b040 comp rx=0 tx=0).stop 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 msgr2=0x7f5c841f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 0x7f5c841f36f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400c7f0 tx=0x7f5c7400ccb0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 shutdown_connections 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5c6806bbd0 0x7f5c6806e090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8413eca0 0x7f5c841e59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c8413e650 0x7f5c841f36f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 --2- 172.21.15.63:0/1050173397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c8406d270 0x7f5c84130bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.402+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 >> 172.21.15.63:0/1050173397 conn(0x7f5c840670b0 msgr2=0x7f5c840b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.403+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 shutdown_connections 2024-03-26T06:17:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.403+0000 7f5c8a000640 1 -- 172.21.15.63:0/1050173397 wait complete. 2024-03-26T06:17:55.422 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:17:55.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.648+0000 7f7115a00640 1 Processor -- start 2024-03-26T06:17:55.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.648+0000 7f7115a00640 1 -- start start 2024-03-26T06:17:55.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.650+0000 7f7115a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f711006d270 0x7f7110071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.650+0000 7f7115a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f711013eca0 0x7f7110071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.650+0000 7f7115a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711015f410 con 0x7f711013e650 2024-03-26T06:17:55.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.650+0000 7f7115a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711015f6f0 con 0x7f711006d270 2024-03-26T06:17:55.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.650+0000 7f7115a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711015f9d0 con 0x7f711013eca0 2024-03-26T06:17:55.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.650+0000 7f7107e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f711006d270 0x7f7110071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.650+0000 7f710fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f711013e650 0x7f711006daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42440/0 (socket says 172.21.15.63:42440) 2024-03-26T06:17:55.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.650+0000 7f710fe00640 1 -- 172.21.15.63:0/1003462024 learned_addr learned my addr 172.21.15.63:0/1003462024 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:55.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.651+0000 7f7115000640 1 --2- 172.21.15.63:0/1003462024 >> v2:172.21.15.204:3300/0 conn(0x7f711013eca0 0x7f7110071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.651+0000 7f7107e00640 1 -- 172.21.15.63:0/1003462024 >> v2:172.21.15.204:3300/0 conn(0x7f711013eca0 msgr2=0x7f7110071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:55.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.651+0000 7f7107e00640 1 --2- 172.21.15.63:0/1003462024 >> v2:172.21.15.204:3300/0 conn(0x7f711013eca0 0x7f7110071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.651+0000 7f7107e00640 1 -- 172.21.15.63:0/1003462024 >> v1:172.21.15.63:6789/0 conn(0x7f711013e650 legacy=0x7f711006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.651+0000 7f7107e00640 1 -- 172.21.15.63:0/1003462024 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711015fcb0 con 0x7f711006d270 2024-03-26T06:17:55.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.651+0000 7f7115000640 1 --2- 172.21.15.63:0/1003462024 >> v2:172.21.15.204:3300/0 conn(0x7f711013eca0 0x7f7110071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:55.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.651+0000 7f710f400640 1 -- 172.21.15.63:0/1003462024 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635619425 0 0) 0x7f711015f410 con 0x7f711013e650 2024-03-26T06:17:55.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.652+0000 7f7107e00640 1 --2- 172.21.15.63:0/1003462024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 0x7f7110071140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f70f80097a0 tx=0x7f70f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37162b17c47678be server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:55.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.652+0000 7f710f400640 1 -- 172.21.15.63:0/1003462024 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8035020 con 0x7f711006d270 2024-03-26T06:17:55.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.652+0000 7f710f400640 1 -- 172.21.15.63:0/1003462024 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f8031830 con 0x7f711006d270 2024-03-26T06:17:55.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.652+0000 7f710f400640 1 -- 172.21.15.63:0/1003462024 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8031c00 con 0x7f711006d270 2024-03-26T06:17:55.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.653+0000 7f7115a00640 1 -- 172.21.15.63:0/1003462024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 msgr2=0x7f7110071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.653+0000 7f7115a00640 1 --2- 172.21.15.63:0/1003462024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 0x7f7110071140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f70f80097a0 tx=0x7f70f802b8d0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.653+0000 7f7115a00640 1 -- 172.21.15.63:0/1003462024 shutdown_connections 2024-03-26T06:17:55.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.653+0000 7f7115a00640 1 --2- 172.21.15.63:0/1003462024 >> v2:172.21.15.204:3300/0 conn(0x7f711013eca0 0x7f7110071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.653+0000 7f7115a00640 1 --2- 172.21.15.63:0/1003462024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 0x7f7110071140 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.653+0000 7f7115a00640 1 -- 172.21.15.63:0/1003462024 >> 172.21.15.63:0/1003462024 conn(0x7f71100670b0 msgr2=0x7f71100b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:55.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.653+0000 7f7115a00640 1 -- 172.21.15.63:0/1003462024 shutdown_connections 2024-03-26T06:17:55.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.653+0000 7f7115a00640 1 -- 172.21.15.63:0/1003462024 wait complete. 2024-03-26T06:17:55.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.655+0000 7f7115a00640 1 Processor -- start 2024-03-26T06:17:55.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.655+0000 7f7115a00640 1 -- start start 2024-03-26T06:17:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.656+0000 7f7115a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 0x7f711013dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.656+0000 7f7115a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711013e650 0x7f71100b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.656+0000 7f7115a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711013eca0 0x7f71100b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.656+0000 7f7115a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7110140eb0 con 0x7f711006d270 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.656+0000 7f7115a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7110140d30 con 0x7f711013e650 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.656+0000 7f7115a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7110141030 con 0x7f711013eca0 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f710fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 0x7f711013dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f710fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 0x7f711013dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47312/0 (socket says 172.21.15.63:47312) 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f710fe00640 1 -- 172.21.15.63:0/428197177 learned_addr learned my addr 172.21.15.63:0/428197177 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f7115000640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711013eca0 0x7f71100b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f7107e00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711013e650 0x7f71100b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f710fe00640 1 -- 172.21.15.63:0/428197177 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711013eca0 msgr2=0x7f71100b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f710fe00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711013eca0 0x7f71100b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f710fe00640 1 -- 172.21.15.63:0/428197177 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711013e650 msgr2=0x7f71100b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f710fe00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711013e650 0x7f71100b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f710fe00640 1 -- 172.21.15.63:0/428197177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100cd200 con 0x7f711006d270 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f7107e00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711013e650 0x7f71100b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.657+0000 7f710fe00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 0x7f711013dc30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f710000c500 tx=0x7f710000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.658+0000 7f710cc00640 1 -- 172.21.15.63:0/428197177 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100018070 con 0x7f711006d270 2024-03-26T06:17:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.658+0000 7f710cc00640 1 -- 172.21.15.63:0/428197177 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100007580 con 0x7f711006d270 2024-03-26T06:17:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.658+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71100cd4e0 con 0x7f711006d270 2024-03-26T06:17:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.658+0000 7f710cc00640 1 -- 172.21.15.63:0/428197177 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100004a20 con 0x7f711006d270 2024-03-26T06:17:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.658+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71100cdaa0 con 0x7f711006d270 2024-03-26T06:17:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.659+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711004f0c0 con 0x7f711006d270 2024-03-26T06:17:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.660+0000 7f710cc00640 1 -- 172.21.15.63:0/428197177 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f710001b070 con 0x7f711006d270 2024-03-26T06:17:55.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.661+0000 7f710cc00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70ec06bbd0 0x7f70ec06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:55.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.661+0000 7f710cc00640 1 -- 172.21.15.63:0/428197177 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f710008a1c0 con 0x7f711006d270 2024-03-26T06:17:55.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.662+0000 7f7107e00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70ec06bbd0 0x7f70ec06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:55.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.662+0000 7f7107e00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70ec06bbd0 0x7f70ec06e090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f70f8036000 tx=0x7f70f8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:55.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.666+0000 7f710cc00640 1 -- 172.21.15.63:0/428197177 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f71000588a0 con 0x7f711006d270 2024-03-26T06:17:55.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.868+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f711006e2a0 con 0x7f711006d270 2024-03-26T06:17:55.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.869+0000 7f710cc00640 1 -- 172.21.15.63:0/428197177 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71000581a0 con 0x7f711006d270 2024-03-26T06:17:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:17:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70ec06bbd0 msgr2=0x7f70ec06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70ec06bbd0 0x7f70ec06e090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f70f8036000 tx=0x7f70f8008030 comp rx=0 tx=0).stop 2024-03-26T06:17:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 msgr2=0x7f711013dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 0x7f711013dc30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f710000c500 tx=0x7f710000c9c0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 shutdown_connections 2024-03-26T06:17:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f70ec06bbd0 0x7f70ec06e090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711013eca0 0x7f71100b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711013e650 0x7f71100b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 --2- 172.21.15.63:0/428197177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f711006d270 0x7f711013dc30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:55.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.871+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 >> 172.21.15.63:0/428197177 conn(0x7f71100670b0 msgr2=0x7f71100b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:55.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.872+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 shutdown_connections 2024-03-26T06:17:55.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:55.872+0000 7f7115a00640 1 -- 172.21.15.63:0/428197177 wait complete. 2024-03-26T06:17:55.892 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:17:56.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.121+0000 7fc2df400640 1 Processor -- start 2024-03-26T06:17:56.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.121+0000 7fc2df400640 1 -- start start 2024-03-26T06:17:56.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.122+0000 7fc2df400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d80cfd60 0x7fc2d80b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.123+0000 7fc2df400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d80d0140 con 0x7fc2d8071a00 2024-03-26T06:17:56.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.123+0000 7fc2df400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d80b4b10 con 0x7fc2d8144c70 2024-03-26T06:17:56.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.123+0000 7fc2df400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80b3530 con 0x7fc2d80cfd60 2024-03-26T06:17:56.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.123+0000 7fc2dd400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc2d8071a00 0x7fc2d80ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42450/0 (socket says 172.21.15.63:42450) 2024-03-26T06:17:56.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.123+0000 7fc2dd400640 1 -- 172.21.15.63:0/4017638002 learned_addr learned my addr 172.21.15.63:0/4017638002 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.123+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125113316 0 0) 0x7fc2d80d0140 con 0x7fc2d8071a00 2024-03-26T06:17:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.123+0000 7fc2dca00640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d80cfd60 0x7fc2d80b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.123+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2c0003520 con 0x7fc2d8071a00 2024-03-26T06:17:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3405330887 0 0) 0x7fc2c0003520 con 0x7fc2d8071a00 2024-03-26T06:17:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d80cfd60 msgr2=0x7fc2d80b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d80cfd60 0x7fc2d80b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 >> v1:172.21.15.204:6789/0 conn(0x7fc2d8144c70 legacy=0x7fc2d80712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80b3810 con 0x7fc2d8071a00 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fc2d0001a10 con 0x7fc2d8071a00 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 >> v1:172.21.15.63:6789/0 conn(0x7fc2d8071a00 legacy=0x7fc2d80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2c00039e0 0x7fc2c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c0004800 0x7fc2c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2c0005210 0x7fc2c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80b3530 con 0x7fc2c0004800 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c000c0c0 con 0x7fc2c00039e0 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c000c2c0 con 0x7fc2c0005210 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2dca00640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d80cfd60 0x7fc2d80b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.124+0000 7fc2d7e00640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c0004800 0x7fc2c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.125+0000 7fc2dd400640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2c0005210 0x7fc2c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.125+0000 7fc2dca00640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2c00039e0 0x7fc2c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.125+0000 7fc2d7e00640 1 -- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2c0005210 msgr2=0x7fc2c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.125+0000 7fc2d7e00640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2c0005210 0x7fc2c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.125+0000 7fc2d7e00640 1 -- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2c00039e0 msgr2=0x7fc2c0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.125+0000 7fc2d7e00640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2c00039e0 0x7fc2c0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.125+0000 7fc2d7e00640 1 -- 172.21.15.63:0/4017638002 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c0003520 con 0x7fc2c0004800 2024-03-26T06:17:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.126+0000 7fc2d7e00640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c0004800 0x7fc2c0004c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8001750 tx=0x7fc2c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8819f4bc1fbf497e server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.126+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8001370 con 0x7fc2c0004800 2024-03-26T06:17:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.126+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c80052d0 con 0x7fc2c0004800 2024-03-26T06:17:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.126+0000 7fc2d7400640 1 -- 172.21.15.63:0/4017638002 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8003830 con 0x7fc2c0004800 2024-03-26T06:17:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.127+0000 7fc2df400640 1 -- 172.21.15.63:0/4017638002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c0004800 msgr2=0x7fc2c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.127+0000 7fc2df400640 1 --2- 172.21.15.63:0/4017638002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c0004800 0x7fc2c0004c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8001750 tx=0x7fc2c0005830 comp rx=0 tx=0).stop 2024-03-26T06:17:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.127+0000 7fc2dd400640 1 -- 172.21.15.63:0/4017638002 reap_dead start 2024-03-26T06:17:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.127+0000 7fc2df400640 1 -- 172.21.15.63:0/4017638002 shutdown_connections 2024-03-26T06:17:56.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.127+0000 7fc2df400640 1 -- 172.21.15.63:0/4017638002 >> 172.21.15.63:0/4017638002 conn(0x7fc2d806ac90 msgr2=0x7fc2d806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:56.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.127+0000 7fc2df400640 1 -- 172.21.15.63:0/4017638002 shutdown_connections 2024-03-26T06:17:56.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.127+0000 7fc2df400640 1 -- 172.21.15.63:0/4017638002 wait complete. 2024-03-26T06:17:56.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.129+0000 7fc2df400640 1 Processor -- start 2024-03-26T06:17:56.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.129+0000 7fc2df400640 1 -- start start 2024-03-26T06:17:56.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2df400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2c0004800 0x7fc2d80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2df400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d815f990 0x7fc2d81e7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2df400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d80ab3e0 0x7fc2d80ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2df400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80b40b0 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2df400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80b3dd0 con 0x7fc2c0004800 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2df400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80b31c0 con 0x7fc2d815f990 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2dd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d80ab3e0 0x7fc2d80ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2dd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d80ab3e0 0x7fc2d80ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47336/0 (socket says 172.21.15.63:47336) 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2dd400640 1 -- 172.21.15.63:0/4121830675 learned_addr learned my addr 172.21.15.63:0/4121830675 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.130+0000 7fc2d7e00640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d815f990 0x7fc2d81e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2dd400640 1 -- 172.21.15.63:0/4121830675 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d815f990 msgr2=0x7fc2d81e7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2dd400640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d815f990 0x7fc2d81e7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2dd400640 1 -- 172.21.15.63:0/4121830675 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2c0004800 msgr2=0x7fc2d80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2dca00640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2c0004800 0x7fc2d80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2dd400640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2c0004800 0x7fc2d80ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2dd400640 1 -- 172.21.15.63:0/4121830675 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80abdd0 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2dd400640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d80ab3e0 0x7fc2d80ab890 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8067520 tx=0x7fc2d000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:56.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2d4c00640 1 -- 172.21.15.63:0/4121830675 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000ec10 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2d4c00640 1 -- 172.21.15.63:0/4121830675 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d0018070 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2d4c00640 1 -- 172.21.15.63:0/4121830675 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0013420 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d80adbb0 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.131+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d80ae170 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.133+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d8074730 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.134+0000 7fc2d4c00640 1 -- 172.21.15.63:0/4121830675 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc2d00135c0 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.134+0000 7fc2d4c00640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2bc06bc00 0x7fc2bc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.135+0000 7fc2d4c00640 1 -- 172.21.15.63:0/4121830675 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc2d008b280 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.135+0000 7fc2dca00640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2bc06bc00 0x7fc2bc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.135+0000 7fc2dca00640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2bc06bc00 0x7fc2bc06e0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc006fd0 tx=0x7fc2cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:56.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.139+0000 7fc2d4c00640 1 -- 172.21.15.63:0/4121830675 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc2d0059960 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.344+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc2d80b2a40 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.345+0000 7fc2d4c00640 1 -- 172.21.15.63:0/4121830675 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc2d0059260 con 0x7fc2d80ab3e0 2024-03-26T06:17:56.346 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:56.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2bc06bc00 msgr2=0x7fc2bc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2bc06bc00 0x7fc2bc06e0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc006fd0 tx=0x7fc2cc008040 comp rx=0 tx=0).stop 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d80ab3e0 msgr2=0x7fc2d80ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d80ab3e0 0x7fc2d80ab890 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8067520 tx=0x7fc2d000e530 comp rx=0 tx=0).stop 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 shutdown_connections 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc2bc06bc00 0x7fc2bc06e0c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d80ab3e0 0x7fc2d80ab890 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2d815f990 0x7fc2d81e7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 --2- 172.21.15.63:0/4121830675 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2c0004800 0x7fc2d80ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.348+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 >> 172.21.15.63:0/4121830675 conn(0x7fc2d806ac90 msgr2=0x7fc2d80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.349+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 shutdown_connections 2024-03-26T06:17:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.349+0000 7fc2df400640 1 -- 172.21.15.63:0/4121830675 wait complete. 2024-03-26T06:17:56.368 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:56.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.585+0000 7f10c9800640 1 Processor -- start 2024-03-26T06:17:56.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.586+0000 7f10c9800640 1 -- start start 2024-03-26T06:17:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.587+0000 7f10c9800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c40d1c10 0x7f10c40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.587+0000 7f10c9800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f10c40d3250 0x7f10c40cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.587+0000 7f10c9800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c40d21b0 con 0x7f10c415d9a0 2024-03-26T06:17:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.588+0000 7f10c9800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c40d2490 con 0x7f10c40d3250 2024-03-26T06:17:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.588+0000 7f10c9800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40d2770 con 0x7f10c40d1c10 2024-03-26T06:17:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.588+0000 7f10c3e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f10c415d9a0 0x7f10c40b9280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42454/0 (socket says 172.21.15.63:42454) 2024-03-26T06:17:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.588+0000 7f10c3e00640 1 -- 172.21.15.63:0/2113218728 learned_addr learned my addr 172.21.15.63:0/2113218728 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:56.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.588+0000 7f10c3400640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c40d1c10 0x7f10c40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.588+0000 7f10c8e00640 1 --2- 172.21.15.63:0/2113218728 >> v2:172.21.15.204:3300/0 conn(0x7f10c40d3250 0x7f10c40cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942902339 0 0) 0x7f10c40d21b0 con 0x7f10c415d9a0 2024-03-26T06:17:56.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a8003520 con 0x7f10c415d9a0 2024-03-26T06:17:56.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1327772563 0 0) 0x7f10a8003520 con 0x7f10c415d9a0 2024-03-26T06:17:56.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c40d1c10 msgr2=0x7f10c40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c40d1c10 0x7f10c40ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 >> v2:172.21.15.204:3300/0 conn(0x7f10c40d3250 msgr2=0x7f10c40cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 --2- 172.21.15.63:0/2113218728 >> v2:172.21.15.204:3300/0 conn(0x7f10c40d3250 0x7f10c40cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c40d2a50 con 0x7f10c415d9a0 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f10b4001670 con 0x7f10c415d9a0 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 >> v1:172.21.15.63:6789/0 conn(0x7f10c415d9a0 legacy=0x7f10c40b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a80039b0 0x7f10a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10a8004800 0x7f10a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c40d1c10 0x7f10a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40d2490 con 0x7f10a8004800 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40d2770 con 0x7f10a80039b0 2024-03-26T06:17:56.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a800b9f0 con 0x7f10c40d1c10 2024-03-26T06:17:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.589+0000 7f10c3400640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10a8004800 0x7f10a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.590+0000 7f10c8e00640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c40d1c10 0x7f10a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.590+0000 7f10c3e00640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a80039b0 0x7f10a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.590+0000 7f10c3400640 1 -- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c40d1c10 msgr2=0x7f10a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.590+0000 7f10c3400640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c40d1c10 0x7f10a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.590+0000 7f10c3400640 1 -- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a80039b0 msgr2=0x7f10a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.590+0000 7f10c3400640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a80039b0 0x7f10a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.590+0000 7f10c3400640 1 -- 172.21.15.63:0/2113218728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8003520 con 0x7f10a8004800 2024-03-26T06:17:56.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.591+0000 7f10c3400640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10a8004800 0x7f10a8004c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009ac0 tx=0x7f10a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1d148f4bf0d347 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:56.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.591+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac039070 con 0x7f10a8004800 2024-03-26T06:17:56.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.591+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac02c6b0 con 0x7f10a8004800 2024-03-26T06:17:56.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.591+0000 7f10c2a00640 1 -- 172.21.15.63:0/2113218728 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac009690 con 0x7f10a8004800 2024-03-26T06:17:56.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.592+0000 7f10c9800640 1 -- 172.21.15.63:0/2113218728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10a8004800 msgr2=0x7f10a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.592+0000 7f10c9800640 1 --2- 172.21.15.63:0/2113218728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10a8004800 0x7f10a8004c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009ac0 tx=0x7f10a8005830 comp rx=0 tx=0).stop 2024-03-26T06:17:56.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.592+0000 7f10c8e00640 1 -- 172.21.15.63:0/2113218728 reap_dead start 2024-03-26T06:17:56.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.592+0000 7f10c9800640 1 -- 172.21.15.63:0/2113218728 shutdown_connections 2024-03-26T06:17:56.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.592+0000 7f10c9800640 1 -- 172.21.15.63:0/2113218728 >> 172.21.15.63:0/2113218728 conn(0x7f10c406bfa0 msgr2=0x7f10c406c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:56.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.592+0000 7f10c9800640 1 -- 172.21.15.63:0/2113218728 shutdown_connections 2024-03-26T06:17:56.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.592+0000 7f10c9800640 1 -- 172.21.15.63:0/2113218728 wait complete. 2024-03-26T06:17:56.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.594+0000 7f10c9800640 1 Processor -- start 2024-03-26T06:17:56.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.594+0000 7f10c9800640 1 -- start start 2024-03-26T06:17:56.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.595+0000 7f10c9800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a8004800 0x7f10c415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.595+0000 7f10c9800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c41f7920 0x7f10c40b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.595+0000 7f10c9800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10c40b36c0 0x7f10c4156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.595+0000 7f10c9800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40ce510 con 0x7f10c40b36c0 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.595+0000 7f10c9800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c415dd80 con 0x7f10a8004800 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.595+0000 7f10c9800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40ce690 con 0x7f10c41f7920 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.595+0000 7f10c8e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10c40b36c0 0x7f10c4156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.595+0000 7f10c8e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10c40b36c0 0x7f10c4156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47350/0 (socket says 172.21.15.63:47350) 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.595+0000 7f10c8e00640 1 -- 172.21.15.63:0/2755146503 learned_addr learned my addr 172.21.15.63:0/2755146503 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c3e00640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a8004800 0x7f10c415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c3400640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c41f7920 0x7f10c40b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c8e00640 1 -- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c41f7920 msgr2=0x7f10c40b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c8e00640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c41f7920 0x7f10c40b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c8e00640 1 -- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a8004800 msgr2=0x7f10c415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c8e00640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a8004800 0x7f10c415fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c8e00640 1 -- 172.21.15.63:0/2755146503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c40b3b60 con 0x7f10c40b36c0 2024-03-26T06:17:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c3400640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c41f7920 0x7f10c40b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c3e00640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a8004800 0x7f10c415fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10c8e00640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10c40b36c0 0x7f10c4156860 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10c4067a90 tx=0x7f10bc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10bbe00640 1 -- 172.21.15.63:0/2755146503 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc011e10 con 0x7f10c40b36c0 2024-03-26T06:17:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10bbe00640 1 -- 172.21.15.63:0/2755146503 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc01b070 con 0x7f10c40b36c0 2024-03-26T06:17:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.596+0000 7f10bbe00640 1 -- 172.21.15.63:0/2755146503 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc003990 con 0x7f10c40b36c0 2024-03-26T06:17:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.597+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c40b3e40 con 0x7f10c40b36c0 2024-03-26T06:17:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.597+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c41f4800 con 0x7f10c40b36c0 2024-03-26T06:17:56.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.598+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c404f050 con 0x7f10c40b36c0 2024-03-26T06:17:56.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.599+0000 7f10bbe00640 1 -- 172.21.15.63:0/2755146503 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f10bc005d10 con 0x7f10c40b36c0 2024-03-26T06:17:56.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.600+0000 7f10bbe00640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f10a006bbd0 0x7f10a006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:56.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.600+0000 7f10bbe00640 1 -- 172.21.15.63:0/2755146503 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f10bc08b4c0 con 0x7f10c40b36c0 2024-03-26T06:17:56.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.600+0000 7f10c3e00640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f10a006bbd0 0x7f10a006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:56.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.601+0000 7f10c3e00640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f10a006bbd0 0x7f10a006e090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000f60 tx=0x7f10b4000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:56.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.604+0000 7f10bbe00640 1 -- 172.21.15.63:0/2755146503 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f10bc025020 con 0x7f10c40b36c0 2024-03-26T06:17:56.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.806+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10c40cf470 con 0x7f10c40b36c0 2024-03-26T06:17:56.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.810+0000 7f10bbe00640 1 -- 172.21.15.63:0/2755146503 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7f10bc059c40 con 0x7f10c40b36c0 2024-03-26T06:17:56.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:56.811 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.812+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f10a006bbd0 msgr2=0x7f10a006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.812+0000 7f10c9800640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f10a006bbd0 0x7f10a006e090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000f60 tx=0x7f10b4000ed0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.812+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10c40b36c0 msgr2=0x7f10c4156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.812+0000 7f10c9800640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10c40b36c0 0x7f10c4156860 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10c4067a90 tx=0x7f10bc0115a0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.812+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 shutdown_connections 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.812+0000 7f10c9800640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f10a006bbd0 0x7f10a006e090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.812+0000 7f10c9800640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10c40b36c0 0x7f10c4156860 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.813+0000 7f10c9800640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10c41f7920 0x7f10c40b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.813+0000 7f10c9800640 1 --2- 172.21.15.63:0/2755146503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10a8004800 0x7f10c415fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.813+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 >> 172.21.15.63:0/2755146503 conn(0x7f10c406bfa0 msgr2=0x7f10c415eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:56.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.813+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 shutdown_connections 2024-03-26T06:17:56.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:56.813+0000 7f10c9800640 1 -- 172.21.15.63:0/2755146503 wait complete. 2024-03-26T06:17:56.832 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:17:56.833 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:17:57.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.050+0000 7faf18a00640 1 Processor -- start 2024-03-26T06:17:57.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.050+0000 7faf18a00640 1 -- start start 2024-03-26T06:17:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.051+0000 7faf18a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf140b95b0 0x7faf140b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.051+0000 7faf18a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 0x7faf140d1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.051+0000 7faf18a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf140b7460 con 0x7faf1415dad0 2024-03-26T06:17:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.051+0000 7faf18a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf140b8070 con 0x7faf140b95b0 2024-03-26T06:17:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.051+0000 7faf18a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf140b7740 con 0x7faf140b8a40 2024-03-26T06:17:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf12a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf140b95b0 0x7faf140b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf12a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf140b95b0 0x7faf140b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47352/0 (socket says 172.21.15.63:47352) 2024-03-26T06:17:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf12a00640 1 -- 172.21.15.63:0/2788474197 learned_addr learned my addr 172.21.15.63:0/2788474197 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf13400640 1 --1- 172.21.15.63:0/2788474197 >> v1:172.21.15.63:6789/0 conn(0x7faf1415dad0 0x7faf140b6980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42466/0 (socket says 172.21.15.63:42466) 2024-03-26T06:17:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf13e00640 1 --2- 172.21.15.63:0/2788474197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 0x7faf140d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf12a00640 1 -- 172.21.15.63:0/2788474197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 msgr2=0x7faf140d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf12a00640 1 --2- 172.21.15.63:0/2788474197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 0x7faf140d1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf12a00640 1 -- 172.21.15.63:0/2788474197 >> v1:172.21.15.63:6789/0 conn(0x7faf1415dad0 legacy=0x7faf140b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf12a00640 1 -- 172.21.15.63:0/2788474197 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf140b7a20 con 0x7faf140b95b0 2024-03-26T06:17:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf12000640 1 -- 172.21.15.63:0/2788474197 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076651098 0 0) 0x7faf140b7460 con 0x7faf1415dad0 2024-03-26T06:17:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.052+0000 7faf13e00640 1 --2- 172.21.15.63:0/2788474197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 0x7faf140d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.053+0000 7faf12a00640 1 --2- 172.21.15.63:0/2788474197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 0x7faf140b8500 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faefc009870 tx=0x7faefc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af864ec37723903f server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.054+0000 7faf12000640 1 -- 172.21.15.63:0/2788474197 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc034070 con 0x7faf140b95b0 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.054+0000 7faf12000640 1 -- 172.21.15.63:0/2788474197 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc030840 con 0x7faf140b95b0 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.054+0000 7faf12000640 1 -- 172.21.15.63:0/2788474197 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc030c10 con 0x7faf140b95b0 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.054+0000 7faf18a00640 1 -- 172.21.15.63:0/2788474197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 msgr2=0x7faf140b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.054+0000 7faf18a00640 1 --2- 172.21.15.63:0/2788474197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 0x7faf140b8500 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faefc009870 tx=0x7faefc02b980 comp rx=0 tx=0).stop 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.054+0000 7faf18a00640 1 -- 172.21.15.63:0/2788474197 shutdown_connections 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.054+0000 7faf18a00640 1 --2- 172.21.15.63:0/2788474197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 0x7faf140b8500 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.054+0000 7faf18a00640 1 --2- 172.21.15.63:0/2788474197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 0x7faf140d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.054+0000 7faf18a00640 1 -- 172.21.15.63:0/2788474197 >> 172.21.15.63:0/2788474197 conn(0x7faf140727e0 msgr2=0x7faf14072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.055+0000 7faf18a00640 1 -- 172.21.15.63:0/2788474197 shutdown_connections 2024-03-26T06:17:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.055+0000 7faf18a00640 1 -- 172.21.15.63:0/2788474197 wait complete. 2024-03-26T06:17:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.056+0000 7faf18a00640 1 Processor -- start 2024-03-26T06:17:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.057+0000 7faf18a00640 1 -- start start 2024-03-26T06:17:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.057+0000 7faf18a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 0x7faf1414be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.057+0000 7faf18a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 0x7faf141f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.057+0000 7faf18a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf1415dad0 0x7faf140c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.057+0000 7faf18a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140b7210 con 0x7faf140b95b0 2024-03-26T06:17:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.057+0000 7faf18a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140b7090 con 0x7faf1415dad0 2024-03-26T06:17:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.057+0000 7faf18a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf140d1dd0 con 0x7faf140b8a40 2024-03-26T06:17:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf12a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 0x7faf141f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf12a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 0x7faf141f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47356/0 (socket says 172.21.15.63:47356) 2024-03-26T06:17:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf12a00640 1 -- 172.21.15.63:0/1551861284 learned_addr learned my addr 172.21.15.63:0/1551861284 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf13400640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 0x7faf1414be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf13e00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf1415dad0 0x7faf140c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf12a00640 1 -- 172.21.15.63:0/1551861284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 msgr2=0x7faf1414be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf12a00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 0x7faf1414be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf12a00640 1 -- 172.21.15.63:0/1551861284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf1415dad0 msgr2=0x7faf140c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf12a00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf1415dad0 0x7faf140c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf12a00640 1 -- 172.21.15.63:0/1551861284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1415bf10 con 0x7faf140b95b0 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.058+0000 7faf13e00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf1415dad0 0x7faf140c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.059+0000 7faf12a00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 0x7faf141f3c60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faefc02b9c0 tx=0x7faefc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.059+0000 7faf0b400640 1 -- 172.21.15.63:0/1551861284 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc048070 con 0x7faf140b95b0 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.059+0000 7faf0b400640 1 -- 172.21.15.63:0/1551861284 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc030640 con 0x7faf140b95b0 2024-03-26T06:17:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.059+0000 7faf0b400640 1 -- 172.21.15.63:0/1551861284 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc034040 con 0x7faf140b95b0 2024-03-26T06:17:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.059+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf140c7480 con 0x7faf140b95b0 2024-03-26T06:17:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.059+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf140c7a40 con 0x7faf140b95b0 2024-03-26T06:17:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.060+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1404f0c0 con 0x7faf140b95b0 2024-03-26T06:17:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.061+0000 7faf0b400640 1 -- 172.21.15.63:0/1551861284 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7faefc037070 con 0x7faf140b95b0 2024-03-26T06:17:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.062+0000 7faf0b400640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faef006bbd0 0x7faef006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.062+0000 7faf0b400640 1 -- 172.21.15.63:0/1551861284 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7faefc0acd70 con 0x7faf140b95b0 2024-03-26T06:17:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.062+0000 7faf13400640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faef006bbd0 0x7faef006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.063+0000 7faf13400640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faef006bbd0 0x7faef006e090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faf04007ed0 tx=0x7faf04007e60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.066+0000 7faf0b400640 1 -- 172.21.15.63:0/1551861284 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7faf1415bf10 con 0x7faf140b95b0 2024-03-26T06:17:57.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.266+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf1406b020 con 0x7faf140b95b0 2024-03-26T06:17:57.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.267+0000 7faf0b400640 1 -- 172.21.15.63:0/1551861284 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7faefc030810 con 0x7faf140b95b0 2024-03-26T06:17:57.268 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:17:57.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.269+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faef006bbd0 msgr2=0x7faef006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.269+0000 7faf18a00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faef006bbd0 0x7faef006e090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faf04007ed0 tx=0x7faf04007e60 comp rx=0 tx=0).stop 2024-03-26T06:17:57.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.269+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 msgr2=0x7faf141f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.269+0000 7faf18a00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 0x7faf141f3c60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faefc02b9c0 tx=0x7faefc004730 comp rx=0 tx=0).stop 2024-03-26T06:17:57.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.270+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 shutdown_connections 2024-03-26T06:17:57.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.270+0000 7faf18a00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faef006bbd0 0x7faef006e090 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.270+0000 7faf18a00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf1415dad0 0x7faf140c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.270+0000 7faf18a00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf140b95b0 0x7faf141f3c60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.270+0000 7faf18a00640 1 --2- 172.21.15.63:0/1551861284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf140b8a40 0x7faf1414be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.270+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 >> 172.21.15.63:0/1551861284 conn(0x7faf140727e0 msgr2=0x7faf1415e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.270+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 shutdown_connections 2024-03-26T06:17:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.270+0000 7faf18a00640 1 -- 172.21.15.63:0/1551861284 wait complete. 2024-03-26T06:17:57.289 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:17:57.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.510+0000 7f792a800640 1 Processor -- start 2024-03-26T06:17:57.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.510+0000 7f792a800640 1 -- start start 2024-03-26T06:17:57.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.512+0000 7f792a800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7924150c50 0x7f792415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.512+0000 7f792a800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f792415dff0 0x7f792406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.512+0000 7f792a800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f792406d6b0 0x7f792406db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.512+0000 7f792a800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792415a280 con 0x7f792415dff0 2024-03-26T06:17:57.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.512+0000 7f792a800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792415a540 con 0x7f7924150c50 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.512+0000 7f792a800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792415a820 con 0x7f792406d6b0 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.512+0000 7f7928a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f792415dff0 0x7f792406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.513+0000 7f7928a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f792415dff0 0x7f792406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47360/0 (socket says 172.21.15.63:47360) 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.513+0000 7f7928a00640 1 -- 172.21.15.63:0/1008734035 learned_addr learned my addr 172.21.15.63:0/1008734035 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.513+0000 7f7929e00640 1 --2- 172.21.15.63:0/1008734035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f792406d6b0 0x7f792406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.513+0000 7f7929400640 1 --2- 172.21.15.63:0/1008734035 >> v2:172.21.15.204:3300/0 conn(0x7f7924150c50 0x7f792415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.513+0000 7f7928a00640 1 -- 172.21.15.63:0/1008734035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f792406d6b0 msgr2=0x7f792406db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.513+0000 7f7928a00640 1 --2- 172.21.15.63:0/1008734035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f792406d6b0 0x7f792406db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.513+0000 7f7928a00640 1 -- 172.21.15.63:0/1008734035 >> v2:172.21.15.204:3300/0 conn(0x7f7924150c50 msgr2=0x7f792415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.513+0000 7f7928a00640 1 --2- 172.21.15.63:0/1008734035 >> v2:172.21.15.204:3300/0 conn(0x7f7924150c50 0x7f792415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.513+0000 7f7928a00640 1 -- 172.21.15.63:0/1008734035 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792415ab00 con 0x7f792415dff0 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.514+0000 7f7928a00640 1 --2- 172.21.15.63:0/1008734035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f792415dff0 0x7f792406d170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f792406e810 tx=0x7f791402da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9634737b4243f9d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.514+0000 7f7923e00640 1 -- 172.21.15.63:0/1008734035 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914031820 con 0x7f792415dff0 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f7923e00640 1 -- 172.21.15.63:0/1008734035 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79140319c0 con 0x7f792415dff0 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f7923e00640 1 -- 172.21.15.63:0/1008734035 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914031d90 con 0x7f792415dff0 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f792a800640 1 -- 172.21.15.63:0/1008734035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f792415dff0 msgr2=0x7f792406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f792a800640 1 --2- 172.21.15.63:0/1008734035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f792415dff0 0x7f792406d170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f792406e810 tx=0x7f791402da00 comp rx=0 tx=0).stop 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f792a800640 1 -- 172.21.15.63:0/1008734035 shutdown_connections 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f792a800640 1 --2- 172.21.15.63:0/1008734035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f792406d6b0 0x7f792406db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f792a800640 1 --2- 172.21.15.63:0/1008734035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f792415dff0 0x7f792406d170 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f792a800640 1 --2- 172.21.15.63:0/1008734035 >> v2:172.21.15.204:3300/0 conn(0x7f7924150c50 0x7f792415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f792a800640 1 -- 172.21.15.63:0/1008734035 >> 172.21.15.63:0/1008734035 conn(0x7f79240670b0 msgr2=0x7f79240b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:57.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f792a800640 1 -- 172.21.15.63:0/1008734035 shutdown_connections 2024-03-26T06:17:57.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.515+0000 7f792a800640 1 -- 172.21.15.63:0/1008734035 wait complete. 2024-03-26T06:17:57.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.517+0000 7f792a800640 1 Processor -- start 2024-03-26T06:17:57.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.517+0000 7f792a800640 1 -- start start 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.518+0000 7f792a800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f792406d6b0 0x7f79240b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.518+0000 7f792a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924150c50 0x7f79240af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.518+0000 7f792a800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f792415dff0 0x7f792414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.518+0000 7f792a800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240cda50 con 0x7f7924150c50 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.518+0000 7f792a800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7924151030 con 0x7f792406d6b0 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.518+0000 7f792a800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79240cdbd0 con 0x7f792415dff0 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.519+0000 7f7928a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924150c50 0x7f79240af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.519+0000 7f7928a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924150c50 0x7f79240af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47376/0 (socket says 172.21.15.63:47376) 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.519+0000 7f7928a00640 1 -- 172.21.15.63:0/2129528523 learned_addr learned my addr 172.21.15.63:0/2129528523 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.519+0000 7f7928a00640 1 -- 172.21.15.63:0/2129528523 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f792415dff0 msgr2=0x7f792414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.519+0000 7f7928a00640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f792415dff0 0x7f792414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.519+0000 7f7928a00640 1 -- 172.21.15.63:0/2129528523 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f792406d6b0 msgr2=0x7f79240b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.519+0000 7f7928a00640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f792406d6b0 0x7f79240b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.519+0000 7f7928a00640 1 -- 172.21.15.63:0/2129528523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79240b1190 con 0x7f7924150c50 2024-03-26T06:17:57.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.519+0000 7f7928a00640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924150c50 0x7f79240af9c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7914000c00 tx=0x7f79140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:57.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.520+0000 7f7921600640 1 -- 172.21.15.63:0/2129528523 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791403abd0 con 0x7f7924150c50 2024-03-26T06:17:57.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.520+0000 7f7921600640 1 -- 172.21.15.63:0/2129528523 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791403ad90 con 0x7f7924150c50 2024-03-26T06:17:57.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.520+0000 7f7921600640 1 -- 172.21.15.63:0/2129528523 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914044630 con 0x7f7924150c50 2024-03-26T06:17:57.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.520+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79240b1470 con 0x7f7924150c50 2024-03-26T06:17:57.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.520+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79240af1e0 con 0x7f7924150c50 2024-03-26T06:17:57.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.521+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7924072320 con 0x7f7924150c50 2024-03-26T06:17:57.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.522+0000 7f7921600640 1 -- 172.21.15.63:0/2129528523 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f79140447d0 con 0x7f7924150c50 2024-03-26T06:17:57.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.523+0000 7f7921600640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f790806bbd0 0x7f790806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.523+0000 7f7921600640 1 -- 172.21.15.63:0/2129528523 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f79140acff0 con 0x7f7924150c50 2024-03-26T06:17:57.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.523+0000 7f7929400640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f790806bbd0 0x7f790806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.524+0000 7f7929400640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f790806bbd0 0x7f790806e090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7918009870 tx=0x7f7918008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:57.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.527+0000 7f7921600640 1 -- 172.21.15.63:0/2129528523 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7924072320 con 0x7f7924150c50 2024-03-26T06:17:57.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.729+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f792404f0c0 con 0x7f7924150c50 2024-03-26T06:17:57.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.730+0000 7f7921600640 1 -- 172.21.15.63:0/2129528523 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f791403f070 con 0x7f7924150c50 2024-03-26T06:17:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:57.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.732+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f790806bbd0 msgr2=0x7f790806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.732+0000 7f792a800640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f790806bbd0 0x7f790806e090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7918009870 tx=0x7f7918008040 comp rx=0 tx=0).stop 2024-03-26T06:17:57.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.732+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924150c50 msgr2=0x7f79240af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.732+0000 7f792a800640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924150c50 0x7f79240af9c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7914000c00 tx=0x7f79140046c0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.733+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 shutdown_connections 2024-03-26T06:17:57.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.733+0000 7f792a800640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f790806bbd0 0x7f790806e090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.733+0000 7f792a800640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f792415dff0 0x7f792414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.733+0000 7f792a800640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924150c50 0x7f79240af9c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.733+0000 7f792a800640 1 --2- 172.21.15.63:0/2129528523 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f792406d6b0 0x7f79240b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.733+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 >> 172.21.15.63:0/2129528523 conn(0x7f79240670b0 msgr2=0x7f79240cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:57.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.733+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 shutdown_connections 2024-03-26T06:17:57.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.733+0000 7f792a800640 1 -- 172.21.15.63:0/2129528523 wait complete. 2024-03-26T06:17:57.754 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:17:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.979+0000 7f2f93e00640 1 Processor -- start 2024-03-26T06:17:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.979+0000 7f2f93e00640 1 -- start start 2024-03-26T06:17:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.981+0000 7f2f93e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2f8c0cfd60 0x7f2f8c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.981+0000 7f2f93e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c0d0140 con 0x7f2f8c071a00 2024-03-26T06:17:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.981+0000 7f2f93e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c0b4b10 con 0x7f2f8c144c70 2024-03-26T06:17:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.981+0000 7f2f93e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b3530 con 0x7f2f8c0cfd60 2024-03-26T06:17:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.981+0000 7f2f91400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2f8c0cfd60 0x7f2f8c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.981+0000 7f2f91e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2f8c071a00 0x7f2f8c0ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42472/0 (socket says 172.21.15.63:42472) 2024-03-26T06:17:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.981+0000 7f2f91e00640 1 -- 172.21.15.63:0/1310294171 learned_addr learned my addr 172.21.15.63:0/1310294171 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.982+0000 7f2f91400640 1 -- 172.21.15.63:0/1310294171 >> v1:172.21.15.204:6789/0 conn(0x7f2f8c144c70 legacy=0x7f2f8c0712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.982+0000 7f2f91400640 1 -- 172.21.15.63:0/1310294171 >> v1:172.21.15.63:6789/0 conn(0x7f2f8c071a00 legacy=0x7f2f8c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.982+0000 7f2f91400640 1 -- 172.21.15.63:0/1310294171 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0b3810 con 0x7f2f8c0cfd60 2024-03-26T06:17:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.982+0000 7f2f8be00640 1 -- 172.21.15.63:0/1310294171 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775226602 0 0) 0x7f2f8c0d0140 con 0x7f2f8c071a00 2024-03-26T06:17:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.983+0000 7f2f91400640 1 --2- 172.21.15.63:0/1310294171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c0cfd60 0x7f2f8c0b45d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2f800097a0 tx=0x7f2f8002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babf2384ca702031 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.984+0000 7f2f8be00640 1 -- 172.21.15.63:0/1310294171 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80034070 con 0x7f2f8c0cfd60 2024-03-26T06:17:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.984+0000 7f2f8be00640 1 -- 172.21.15.63:0/1310294171 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80030610 con 0x7f2f8c0cfd60 2024-03-26T06:17:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.984+0000 7f2f8be00640 1 -- 172.21.15.63:0/1310294171 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800309e0 con 0x7f2f8c0cfd60 2024-03-26T06:17:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.984+0000 7f2f93e00640 1 -- 172.21.15.63:0/1310294171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c0cfd60 msgr2=0x7f2f8c0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.984+0000 7f2f93e00640 1 --2- 172.21.15.63:0/1310294171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c0cfd60 0x7f2f8c0b45d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2f800097a0 tx=0x7f2f8002b960 comp rx=0 tx=0).stop 2024-03-26T06:17:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.984+0000 7f2f93e00640 1 -- 172.21.15.63:0/1310294171 shutdown_connections 2024-03-26T06:17:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.984+0000 7f2f93e00640 1 --2- 172.21.15.63:0/1310294171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c0cfd60 0x7f2f8c0b45d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.984+0000 7f2f93e00640 1 -- 172.21.15.63:0/1310294171 >> 172.21.15.63:0/1310294171 conn(0x7f2f8c06ac90 msgr2=0x7f2f8c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.984+0000 7f2f93e00640 1 -- 172.21.15.63:0/1310294171 shutdown_connections 2024-03-26T06:17:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.985+0000 7f2f93e00640 1 -- 172.21.15.63:0/1310294171 wait complete. 2024-03-26T06:17:57.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.986+0000 7f2f93e00640 1 Processor -- start 2024-03-26T06:17:57.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.987+0000 7f2f93e00640 1 -- start start 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f8c071a00 0x7f2f8c1f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f8c0cfd60 0x7f2f8c1ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c144c70 0x7f2f8c15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f93e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b40b0 con 0x7f2f8c144c70 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f93e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b3dd0 con 0x7f2f8c071a00 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f93e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b31c0 con 0x7f2f8c0cfd60 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f91e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c144c70 0x7f2f8c15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f91e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c144c70 0x7f2f8c15cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47394/0 (socket says 172.21.15.63:47394) 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f91e00640 1 -- 172.21.15.63:0/3731292190 learned_addr learned my addr 172.21.15.63:0/3731292190 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f90a00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f8c0cfd60 0x7f2f8c1ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.988+0000 7f2f91400640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f8c071a00 0x7f2f8c1f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f91e00640 1 -- 172.21.15.63:0/3731292190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f8c0cfd60 msgr2=0x7f2f8c1ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f91e00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f8c0cfd60 0x7f2f8c1ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f91e00640 1 -- 172.21.15.63:0/3731292190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f8c071a00 msgr2=0x7f2f8c1f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f91e00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f8c071a00 0x7f2f8c1f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f91e00640 1 -- 172.21.15.63:0/3731292190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0acaf0 con 0x7f2f8c144c70 2024-03-26T06:17:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f91e00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c144c70 0x7f2f8c15cf30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400caf0 tx=0x7f2f8400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:57.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f89600640 1 -- 172.21.15.63:0/3731292190 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400aca0 con 0x7f2f8c144c70 2024-03-26T06:17:57.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f89600640 1 -- 172.21.15.63:0/3731292190 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8400ae40 con 0x7f2f8c144c70 2024-03-26T06:17:57.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c0acdd0 con 0x7f2f8c144c70 2024-03-26T06:17:57.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f89600640 1 -- 172.21.15.63:0/3731292190 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84012620 con 0x7f2f8c144c70 2024-03-26T06:17:57.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.989+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c0ad390 con 0x7f2f8c144c70 2024-03-26T06:17:57.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.991+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c074730 con 0x7f2f8c144c70 2024-03-26T06:17:57.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.992+0000 7f2f89600640 1 -- 172.21.15.63:0/3731292190 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2f84012880 con 0x7f2f8c144c70 2024-03-26T06:17:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.993+0000 7f2f89600640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f6c06bbd0 0x7f2f6c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.993+0000 7f2f89600640 1 -- 172.21.15.63:0/3731292190 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2f8408b590 con 0x7f2f8c144c70 2024-03-26T06:17:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.993+0000 7f2f91400640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f6c06bbd0 0x7f2f6c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.994+0000 7f2f91400640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f6c06bbd0 0x7f2f6c06e090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f80036000 tx=0x7f2f8003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:57.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:57.998+0000 7f2f89600640 1 -- 172.21.15.63:0/3731292190 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2f84059c70 con 0x7f2f8c144c70 2024-03-26T06:17:58.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.198+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f8c15f1d0 con 0x7f2f8c144c70 2024-03-26T06:17:58.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.200+0000 7f2f89600640 1 -- 172.21.15.63:0/3731292190 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f84059570 con 0x7f2f8c144c70 2024-03-26T06:17:58.201 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:17:58.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.202+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f6c06bbd0 msgr2=0x7f2f6c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.202+0000 7f2f93e00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f6c06bbd0 0x7f2f6c06e090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f80036000 tx=0x7f2f8003b040 comp rx=0 tx=0).stop 2024-03-26T06:17:58.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.202+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c144c70 msgr2=0x7f2f8c15cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.202+0000 7f2f93e00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c144c70 0x7f2f8c15cf30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400caf0 tx=0x7f2f8400a060 comp rx=0 tx=0).stop 2024-03-26T06:17:58.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.203+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 shutdown_connections 2024-03-26T06:17:58.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.203+0000 7f2f93e00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f6c06bbd0 0x7f2f6c06e090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.203+0000 7f2f93e00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f8c144c70 0x7f2f8c15cf30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.203+0000 7f2f93e00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f8c0cfd60 0x7f2f8c1ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.203+0000 7f2f93e00640 1 --2- 172.21.15.63:0/3731292190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f8c071a00 0x7f2f8c1f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.203+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 >> 172.21.15.63:0/3731292190 conn(0x7f2f8c06ac90 msgr2=0x7f2f8c0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:58.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.203+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 shutdown_connections 2024-03-26T06:17:58.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.203+0000 7f2f93e00640 1 -- 172.21.15.63:0/3731292190 wait complete. 2024-03-26T06:17:58.224 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:17:58.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.440+0000 7fa847200640 1 Processor -- start 2024-03-26T06:17:58.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.441+0000 7fa847200640 1 -- start start 2024-03-26T06:17:58.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.442+0000 7fa847200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8480d3840 0x7fa8480d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.442+0000 7fa847200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa8480b9320 0x7fa8480b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.442+0000 7fa847200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480d4160 con 0x7fa84815dca0 2024-03-26T06:17:58.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.442+0000 7fa847200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480d2070 con 0x7fa8480b9320 2024-03-26T06:17:58.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.442+0000 7fa847200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480d22d0 con 0x7fa8480d3840 2024-03-26T06:17:58.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.443+0000 7fa845400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa84815dca0 0x7fa8480d1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42482/0 (socket says 172.21.15.63:42482) 2024-03-26T06:17:58.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.443+0000 7fa845400640 1 -- 172.21.15.63:0/3375334352 learned_addr learned my addr 172.21.15.63:0/3375334352 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:58.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.443+0000 7fa845e00640 1 --2- 172.21.15.63:0/3375334352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8480d3840 0x7fa8480d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.443+0000 7fa846800640 1 --2- 172.21.15.63:0/3375334352 >> v2:172.21.15.204:3300/0 conn(0x7fa8480b9320 0x7fa8480b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.443+0000 7fa844a00640 1 -- 172.21.15.63:0/3375334352 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493500295 0 0) 0x7fa8480d4160 con 0x7fa84815dca0 2024-03-26T06:17:58.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.443+0000 7fa844a00640 1 -- 172.21.15.63:0/3375334352 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa828003520 con 0x7fa84815dca0 2024-03-26T06:17:58.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.444+0000 7fa845e00640 1 -- 172.21.15.63:0/3375334352 >> v2:172.21.15.204:3300/0 conn(0x7fa8480b9320 msgr2=0x7fa8480b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:58.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.444+0000 7fa845e00640 1 --2- 172.21.15.63:0/3375334352 >> v2:172.21.15.204:3300/0 conn(0x7fa8480b9320 0x7fa8480b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.444+0000 7fa844a00640 1 -- 172.21.15.63:0/3375334352 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3662789539 0 0) 0x7fa828003520 con 0x7fa84815dca0 2024-03-26T06:17:58.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.444+0000 7fa845e00640 1 -- 172.21.15.63:0/3375334352 >> v1:172.21.15.63:6789/0 conn(0x7fa84815dca0 legacy=0x7fa8480d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.444+0000 7fa845e00640 1 -- 172.21.15.63:0/3375334352 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480d25b0 con 0x7fa8480d3840 2024-03-26T06:17:58.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.445+0000 7fa845e00640 1 --2- 172.21.15.63:0/3375334352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8480d3840 0x7fa8480d3c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa8380097a0 tx=0x7fa83802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ac234ed1d393241 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:58.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.446+0000 7fa844a00640 1 -- 172.21.15.63:0/3375334352 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838037070 con 0x7fa8480d3840 2024-03-26T06:17:58.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.446+0000 7fa844a00640 1 -- 172.21.15.63:0/3375334352 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838030510 con 0x7fa8480d3840 2024-03-26T06:17:58.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.446+0000 7fa844a00640 1 -- 172.21.15.63:0/3375334352 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830001670 con 0x7fa8480d3840 2024-03-26T06:17:58.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.446+0000 7fa847200640 1 -- 172.21.15.63:0/3375334352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8480d3840 msgr2=0x7fa8480d3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.447+0000 7fa847200640 1 --2- 172.21.15.63:0/3375334352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8480d3840 0x7fa8480d3c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa8380097a0 tx=0x7fa83802b790 comp rx=0 tx=0).stop 2024-03-26T06:17:58.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.447+0000 7fa847200640 1 -- 172.21.15.63:0/3375334352 shutdown_connections 2024-03-26T06:17:58.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.447+0000 7fa847200640 1 --2- 172.21.15.63:0/3375334352 >> v2:172.21.15.204:3300/0 conn(0x7fa8480b9320 0x7fa8480b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.447+0000 7fa847200640 1 --2- 172.21.15.63:0/3375334352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8480d3840 0x7fa8480d3c20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.447+0000 7fa847200640 1 -- 172.21.15.63:0/3375334352 >> 172.21.15.63:0/3375334352 conn(0x7fa84806c570 msgr2=0x7fa84806c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:58.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.447+0000 7fa847200640 1 -- 172.21.15.63:0/3375334352 shutdown_connections 2024-03-26T06:17:58.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.447+0000 7fa847200640 1 -- 172.21.15.63:0/3375334352 wait complete. 2024-03-26T06:17:58.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.449+0000 7fa847200640 1 Processor -- start 2024-03-26T06:17:58.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.449+0000 7fa847200640 1 -- start start 2024-03-26T06:17:58.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa847200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8480b9320 0x7fa848151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa847200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8480d3840 0x7fa8481f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa847200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa84815dca0 0x7fa8480c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa847200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480d2e50 con 0x7fa8480d3840 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa847200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480d2b70 con 0x7fa8480b9320 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa847200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480d3370 con 0x7fa84815dca0 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa845400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8480d3840 0x7fa8481f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa845400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8480d3840 0x7fa8481f37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47396/0 (socket says 172.21.15.63:47396) 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa845400640 1 -- 172.21.15.63:0/3996103992 learned_addr learned my addr 172.21.15.63:0/3996103992 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa846800640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa84815dca0 0x7fa8480c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.450+0000 7fa845e00640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8480b9320 0x7fa848151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa845400640 1 -- 172.21.15.63:0/3996103992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa84815dca0 msgr2=0x7fa8480c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa845400640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa84815dca0 0x7fa8480c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa845400640 1 -- 172.21.15.63:0/3996103992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8480b9320 msgr2=0x7fa848151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa845400640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8480b9320 0x7fa848151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa845400640 1 -- 172.21.15.63:0/3996103992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480cbb80 con 0x7fa8480d3840 2024-03-26T06:17:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa845400640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8480d3840 0x7fa8481f37c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa83000c700 tx=0x7fa83000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa83e000640 1 -- 172.21.15.63:0/3996103992 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830017070 con 0x7fa8480d3840 2024-03-26T06:17:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa83e000640 1 -- 172.21.15.63:0/3996103992 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa830005ad0 con 0x7fa8480d3840 2024-03-26T06:17:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa83e000640 1 -- 172.21.15.63:0/3996103992 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830007070 con 0x7fa8480d3840 2024-03-26T06:17:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8480cbe40 con 0x7fa8480d3840 2024-03-26T06:17:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.451+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8480cc400 con 0x7fa8480d3840 2024-03-26T06:17:58.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.453+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84804f0c0 con 0x7fa8480d3840 2024-03-26T06:17:58.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.454+0000 7fa83e000640 1 -- 172.21.15.63:0/3996103992 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa83001a070 con 0x7fa8480d3840 2024-03-26T06:17:58.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.454+0000 7fa83e000640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa82406bbd0 0x7fa82406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.455+0000 7fa83e000640 1 -- 172.21.15.63:0/3996103992 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa83008a2b0 con 0x7fa8480d3840 2024-03-26T06:17:58.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.455+0000 7fa845e00640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa82406bbd0 0x7fa82406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.456+0000 7fa845e00640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa82406bbd0 0x7fa82406e090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa838034000 tx=0x7fa83802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:58.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.459+0000 7fa83e000640 1 -- 172.21.15.63:0/3996103992 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa830058a30 con 0x7fa8480d3840 2024-03-26T06:17:58.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.662+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa8481551d0 con 0x7fa8480d3840 2024-03-26T06:17:58.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.663+0000 7fa83e000640 1 -- 172.21.15.63:0/3996103992 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa830058330 con 0x7fa8480d3840 2024-03-26T06:17:58.664 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:17:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa82406bbd0 msgr2=0x7fa82406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa82406bbd0 0x7fa82406e090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa838034000 tx=0x7fa83802f000 comp rx=0 tx=0).stop 2024-03-26T06:17:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8480d3840 msgr2=0x7fa8481f37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8480d3840 0x7fa8481f37c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa83000c700 tx=0x7fa83000cbc0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 shutdown_connections 2024-03-26T06:17:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa82406bbd0 0x7fa82406e090 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa84815dca0 0x7fa8480c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8480d3840 0x7fa8481f37c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 --2- 172.21.15.63:0/3996103992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8480b9320 0x7fa848151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.665+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 >> 172.21.15.63:0/3996103992 conn(0x7fa84806c570 msgr2=0x7fa8480ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.666+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 shutdown_connections 2024-03-26T06:17:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.666+0000 7fa847200640 1 -- 172.21.15.63:0/3996103992 wait complete. 2024-03-26T06:17:58.722 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-26T06:17:58.723 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:17:58.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.951+0000 7f8d56a00640 1 Processor -- start 2024-03-26T06:17:58.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.951+0000 7f8d56a00640 1 -- start start 2024-03-26T06:17:58.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.952+0000 7f8d56a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d500b5030 0x7f8d500ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.952+0000 7f8d56a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8d50144b50 0x7f8d50144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.952+0000 7f8d56a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500cc070 con 0x7f8d500b4c50 2024-03-26T06:17:58.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.952+0000 7f8d56a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5015fde0 con 0x7f8d500b5030 2024-03-26T06:17:58.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.952+0000 7f8d56a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d501600c0 con 0x7f8d50144b50 2024-03-26T06:17:58.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.952+0000 7f8d54c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d500b5030 0x7f8d500ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d54c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d500b5030 0x7f8d500ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47402/0 (socket says 172.21.15.63:47402) 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d54c00640 1 -- 172.21.15.63:0/3865504703 learned_addr learned my addr 172.21.15.63:0/3865504703 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d55600640 1 --1- 172.21.15.63:0/3865504703 >> v1:172.21.15.63:6789/0 conn(0x7f8d500b4c50 0x7f8d5015f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42492/0 (socket says 172.21.15.63:42492) 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d54c00640 1 -- 172.21.15.63:0/3865504703 >> v2:172.21.15.204:3300/0 conn(0x7f8d50144b50 msgr2=0x7f8d50144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d56000640 1 --2- 172.21.15.63:0/3865504703 >> v2:172.21.15.204:3300/0 conn(0x7f8d50144b50 0x7f8d50144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d54c00640 1 --2- 172.21.15.63:0/3865504703 >> v2:172.21.15.204:3300/0 conn(0x7f8d50144b50 0x7f8d50144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d54c00640 1 -- 172.21.15.63:0/3865504703 >> v1:172.21.15.63:6789/0 conn(0x7f8d500b4c50 legacy=0x7f8d5015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d4fe00640 1 -- 172.21.15.63:0/3865504703 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209319706 0 0) 0x7f8d500cc070 con 0x7f8d500b4c50 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d54c00640 1 -- 172.21.15.63:0/3865504703 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500cc310 con 0x7f8d500b5030 2024-03-26T06:17:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.953+0000 7f8d56000640 1 --2- 172.21.15.63:0/3865504703 >> v2:172.21.15.204:3300/0 conn(0x7f8d50144b50 0x7f8d50144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:17:58.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.954+0000 7f8d54c00640 1 --2- 172.21.15.63:0/3865504703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500b5030 0x7f8d500ccaf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009870 tx=0x7f8d3c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6010bd9856070d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:58.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.954+0000 7f8d4fe00640 1 -- 172.21.15.63:0/3865504703 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c02f840 con 0x7f8d500b5030 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d4fe00640 1 -- 172.21.15.63:0/3865504703 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c02f9e0 con 0x7f8d500b5030 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d4fe00640 1 -- 172.21.15.63:0/3865504703 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c02fdb0 con 0x7f8d500b5030 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d56a00640 1 -- 172.21.15.63:0/3865504703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500b5030 msgr2=0x7f8d500ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d56a00640 1 --2- 172.21.15.63:0/3865504703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500b5030 0x7f8d500ccaf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009870 tx=0x7f8d3c02ba20 comp rx=0 tx=0).stop 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d56a00640 1 -- 172.21.15.63:0/3865504703 shutdown_connections 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d56a00640 1 --2- 172.21.15.63:0/3865504703 >> v2:172.21.15.204:3300/0 conn(0x7f8d50144b50 0x7f8d50144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d56a00640 1 --2- 172.21.15.63:0/3865504703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500b5030 0x7f8d500ccaf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d56a00640 1 -- 172.21.15.63:0/3865504703 >> 172.21.15.63:0/3865504703 conn(0x7f8d500b13d0 msgr2=0x7f8d500b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d56a00640 1 -- 172.21.15.63:0/3865504703 shutdown_connections 2024-03-26T06:17:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.955+0000 7f8d56a00640 1 -- 172.21.15.63:0/3865504703 wait complete. 2024-03-26T06:17:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.957+0000 7f8d56a00640 1 Processor -- start 2024-03-26T06:17:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.957+0000 7f8d56a00640 1 -- start start 2024-03-26T06:17:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.958+0000 7f8d56a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d500b4c50 0x7f8d500acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.958+0000 7f8d56a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d500b5030 0x7f8d50141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.958+0000 7f8d56a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d50144b50 0x7f8d501f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.958+0000 7f8d56a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5015fa50 con 0x7f8d50144b50 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.958+0000 7f8d56a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5006eb70 con 0x7f8d500b5030 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.958+0000 7f8d56a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5006d280 con 0x7f8d500b4c50 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.958+0000 7f8d56000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d50144b50 0x7f8d501f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.958+0000 7f8d56000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d50144b50 0x7f8d501f20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47408/0 (socket says 172.21.15.63:47408) 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.958+0000 7f8d56000640 1 -- 172.21.15.63:0/1456005 learned_addr learned my addr 172.21.15.63:0/1456005 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d55600640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d500b4c50 0x7f8d500acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d54c00640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d500b5030 0x7f8d50141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d56000640 1 -- 172.21.15.63:0/1456005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d500b4c50 msgr2=0x7f8d500acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d56000640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d500b4c50 0x7f8d500acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d56000640 1 -- 172.21.15.63:0/1456005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d500b5030 msgr2=0x7f8d50141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d56000640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d500b5030 0x7f8d50141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d56000640 1 -- 172.21.15.63:0/1456005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d501f25f0 con 0x7f8d50144b50 2024-03-26T06:17:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d56000640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d50144b50 0x7f8d501f20b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800cd80 tx=0x7f8d4800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d4d600640 1 -- 172.21.15.63:0/1456005 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800f680 con 0x7f8d50144b50 2024-03-26T06:17:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.959+0000 7f8d4d600640 1 -- 172.21.15.63:0/1456005 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4800f840 con 0x7f8d50144b50 2024-03-26T06:17:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.960+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d500ad190 con 0x7f8d50144b50 2024-03-26T06:17:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.960+0000 7f8d4d600640 1 -- 172.21.15.63:0/1456005 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800fc30 con 0x7f8d50144b50 2024-03-26T06:17:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.960+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d500ad750 con 0x7f8d50144b50 2024-03-26T06:17:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.961+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5004f050 con 0x7f8d50144b50 2024-03-26T06:17:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.962+0000 7f8d4d600640 1 -- 172.21.15.63:0/1456005 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8d480213f0 con 0x7f8d50144b50 2024-03-26T06:17:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.963+0000 7f8d4d600640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d3006bbd0 0x7f8d3006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.963+0000 7f8d4d600640 1 -- 172.21.15.63:0/1456005 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8d4808bcb0 con 0x7f8d50144b50 2024-03-26T06:17:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.963+0000 7f8d55600640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d3006bbd0 0x7f8d3006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.964+0000 7f8d55600640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d3006bbd0 0x7f8d3006e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d44000f60 tx=0x7f8d44007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:58.967+0000 7f8d4d600640 1 -- 172.21.15.63:0/1456005 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8d501f25f0 con 0x7f8d50144b50 2024-03-26T06:17:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.174+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d5006e400 con 0x7f8d50144b50 2024-03-26T06:17:59.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.176+0000 7f8d4d600640 1 -- 172.21.15.63:0/1456005 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7f8d48014030 con 0x7f8d50144b50 2024-03-26T06:17:59.178 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:17:59.178 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:17:59.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d3006bbd0 msgr2=0x7f8d3006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d3006bbd0 0x7f8d3006e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d44000f60 tx=0x7f8d44007b50 comp rx=0 tx=0).stop 2024-03-26T06:17:59.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d50144b50 msgr2=0x7f8d501f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d50144b50 0x7f8d501f20b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800cd80 tx=0x7f8d4800a650 comp rx=0 tx=0).stop 2024-03-26T06:17:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 shutdown_connections 2024-03-26T06:17:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8d3006bbd0 0x7f8d3006e090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d50144b50 0x7f8d501f20b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d500b5030 0x7f8d50141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 --2- 172.21.15.63:0/1456005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d500b4c50 0x7f8d500acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 >> 172.21.15.63:0/1456005 conn(0x7f8d500b13d0 msgr2=0x7f8d500cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 shutdown_connections 2024-03-26T06:17:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.179+0000 7f8d56a00640 1 -- 172.21.15.63:0/1456005 wait complete. 2024-03-26T06:17:59.200 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:17:59.200 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:17:59.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.425+0000 7fcd1fe00640 1 Processor -- start 2024-03-26T06:17:59.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.425+0000 7fcd1fe00640 1 -- start start 2024-03-26T06:17:59.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.427+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2006d270 0x7fcd20071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.427+0000 7fcd1fe00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcd2013eca0 0x7fcd20071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.427+0000 7fcd1fe00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2015f410 con 0x7fcd2013e650 2024-03-26T06:17:59.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.427+0000 7fcd1fe00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2015f6f0 con 0x7fcd2013eca0 2024-03-26T06:17:59.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.427+0000 7fcd1fe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015f9d0 con 0x7fcd2006d270 2024-03-26T06:17:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.427+0000 7fcd1ea00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcd2013e650 0x7fcd2006daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42508/0 (socket says 172.21.15.63:42508) 2024-03-26T06:17:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.427+0000 7fcd1ea00640 1 -- 172.21.15.63:0/2269589833 learned_addr learned my addr 172.21.15.63:0/2269589833 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1e000640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2006d270 0x7fcd20071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1f400640 1 --2- 172.21.15.63:0/2269589833 >> v2:172.21.15.204:3300/0 conn(0x7fcd2013eca0 0x7fcd20071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324552643 0 0) 0x7fcd2015f410 con 0x7fcd2013e650 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd04003520 con 0x7fcd2013e650 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1614618306 0 0) 0x7fcd04003520 con 0x7fcd2013e650 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2006d270 msgr2=0x7fcd20071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2006d270 0x7fcd20071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 >> v2:172.21.15.204:3300/0 conn(0x7fcd2013eca0 msgr2=0x7fcd20071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 --2- 172.21.15.63:0/2269589833 >> v2:172.21.15.204:3300/0 conn(0x7fcd2013eca0 0x7fcd20071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2015fcb0 con 0x7fcd2013e650 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fcd10001670 con 0x7fcd2013e650 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 >> v1:172.21.15.63:6789/0 conn(0x7fcd2013e650 legacy=0x7fcd2006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd040039b0 0x7fcd04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.428+0000 7fcd1d600640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1d600640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2006d270 0x7fcd040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015f6f0 con 0x7fcd04004800 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015f9d0 con 0x7fcd040039b0 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0400b9f0 con 0x7fcd2006d270 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1e000640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1ea00640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd040039b0 0x7fcd04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1f400640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2006d270 0x7fcd040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1e000640 1 -- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2006d270 msgr2=0x7fcd040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1e000640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd2006d270 0x7fcd040051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1e000640 1 -- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd040039b0 msgr2=0x7fcd04003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1e000640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd040039b0 0x7fcd04003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.429+0000 7fcd1e000640 1 -- 172.21.15.63:0/2269589833 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd04003520 con 0x7fcd04004800 2024-03-26T06:17:59.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.430+0000 7fcd1e000640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd04004c80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009ac0 tx=0x7fcd04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdc620513deed63 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c039070 con 0x7fcd04004800 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c02c6b0 con 0x7fcd04004800 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1d600640 1 -- 172.21.15.63:0/2269589833 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c009690 con 0x7fcd04004800 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1fe00640 1 -- 172.21.15.63:0/2269589833 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 msgr2=0x7fcd04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1fe00640 1 --2- 172.21.15.63:0/2269589833 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd04004c80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009ac0 tx=0x7fcd04005830 comp rx=0 tx=0).stop 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1f400640 1 -- 172.21.15.63:0/2269589833 reap_dead start 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1fe00640 1 -- 172.21.15.63:0/2269589833 shutdown_connections 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1fe00640 1 -- 172.21.15.63:0/2269589833 >> 172.21.15.63:0/2269589833 conn(0x7fcd200670b0 msgr2=0x7fcd200b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1fe00640 1 -- 172.21.15.63:0/2269589833 shutdown_connections 2024-03-26T06:17:59.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.431+0000 7fcd1fe00640 1 -- 172.21.15.63:0/2269589833 wait complete. 2024-03-26T06:17:59.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.433+0000 7fcd1fe00640 1 Processor -- start 2024-03-26T06:17:59.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.433+0000 7fcd1fe00640 1 -- start start 2024-03-26T06:17:59.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.434+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd20154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.434+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd200b36e0 0x7fcd200b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.434+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd20159190 0x7fcd200a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.434+0000 7fcd1fe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200712c0 con 0x7fcd04004800 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.434+0000 7fcd1fe00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20071140 con 0x7fcd200b36e0 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.434+0000 7fcd1fe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20071440 con 0x7fcd20159190 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd20154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd20154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47428/0 (socket says 172.21.15.63:47428) 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1ea00640 1 -- 172.21.15.63:0/1461269914 learned_addr learned my addr 172.21.15.63:0/1461269914 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1f400640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd20159190 0x7fcd200a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1e000640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd200b36e0 0x7fcd200b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1ea00640 1 -- 172.21.15.63:0/1461269914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd20159190 msgr2=0x7fcd200a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1ea00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd20159190 0x7fcd200a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1ea00640 1 -- 172.21.15.63:0/1461269914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd200b36e0 msgr2=0x7fcd200b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1ea00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd200b36e0 0x7fcd200b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1ea00640 1 -- 172.21.15.63:0/1461269914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200b2640 con 0x7fcd04004800 2024-03-26T06:17:59.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.435+0000 7fcd1ea00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd20154fc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000e6d0 tx=0x7fcd1000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:59.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.436+0000 7fcd16a00640 1 -- 172.21.15.63:0/1461269914 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000c660 con 0x7fcd04004800 2024-03-26T06:17:59.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.436+0000 7fcd16a00640 1 -- 172.21.15.63:0/1461269914 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10018070 con 0x7fcd04004800 2024-03-26T06:17:59.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.436+0000 7fcd16a00640 1 -- 172.21.15.63:0/1461269914 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000ca40 con 0x7fcd04004800 2024-03-26T06:17:59.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.436+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd200b2920 con 0x7fcd04004800 2024-03-26T06:17:59.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.436+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd200b2ee0 con 0x7fcd04004800 2024-03-26T06:17:59.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.437+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd200af940 con 0x7fcd04004800 2024-03-26T06:17:59.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.438+0000 7fcd16a00640 1 -- 172.21.15.63:0/1461269914 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fcd1000cbe0 con 0x7fcd04004800 2024-03-26T06:17:59.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.439+0000 7fcd16a00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0006bbd0 0x7fcd0006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.439+0000 7fcd16a00640 1 -- 172.21.15.63:0/1461269914 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcd1008acf0 con 0x7fcd04004800 2024-03-26T06:17:59.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.439+0000 7fcd1e000640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0006bbd0 0x7fcd0006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.440+0000 7fcd1e000640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0006bbd0 0x7fcd0006e090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c036000 tx=0x7fcd0c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:59.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.444+0000 7fcd16a00640 1 -- 172.21.15.63:0/1461269914 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fcd200af940 con 0x7fcd04004800 2024-03-26T06:17:59.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.643+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd2006e2a0 con 0x7fcd04004800 2024-03-26T06:17:59.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.644+0000 7fcd16a00640 1 -- 172.21.15.63:0/1461269914 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd100593d0 con 0x7fcd04004800 2024-03-26T06:17:59.645 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:17:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0006bbd0 msgr2=0x7fcd0006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0006bbd0 0x7fcd0006e090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c036000 tx=0x7fcd0c030000 comp rx=0 tx=0).stop 2024-03-26T06:17:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 msgr2=0x7fcd20154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd20154fc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000e6d0 tx=0x7fcd1000eb90 comp rx=0 tx=0).stop 2024-03-26T06:17:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 shutdown_connections 2024-03-26T06:17:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcd0006bbd0 0x7fcd0006e090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd20159190 0x7fcd200a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd200b36e0 0x7fcd200b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 --2- 172.21.15.63:0/1461269914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd04004800 0x7fcd20154fc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 >> 172.21.15.63:0/1461269914 conn(0x7fcd200670b0 msgr2=0x7fcd200b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 shutdown_connections 2024-03-26T06:17:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.647+0000 7fcd1fe00640 1 -- 172.21.15.63:0/1461269914 wait complete. 2024-03-26T06:17:59.668 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:17:59.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.895+0000 7f2d8d000640 1 Processor -- start 2024-03-26T06:17:59.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.895+0000 7f2d8d000640 1 -- start start 2024-03-26T06:17:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.897+0000 7f2d8d000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2d8815db50 0x7f2d8806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.897+0000 7f2d8d000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d880b27b0 0x7f2d880cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.897+0000 7f2d8d000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d880cf890 con 0x7f2d8815df30 2024-03-26T06:17:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.897+0000 7f2d8d000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d880cfb30 con 0x7f2d8815db50 2024-03-26T06:17:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.897+0000 7f2d8d000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d880cfe10 con 0x7f2d880b27b0 2024-03-26T06:17:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.898+0000 7f2d87e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d880b27b0 0x7f2d880cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.898+0000 7f2d7fe00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f2d8815df30 0x7f2d880d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:42254/0 (socket says 172.21.15.63:42254) 2024-03-26T06:17:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.898+0000 7f2d7fe00640 1 -- 172.21.15.63:0/4100292964 learned_addr learned my addr 172.21.15.63:0/4100292964 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:17:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.898+0000 7f2d87400640 1 --2- 172.21.15.63:0/4100292964 >> v2:172.21.15.204:3300/0 conn(0x7f2d8815db50 0x7f2d8806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.899+0000 7f2d87e00640 1 -- 172.21.15.63:0/4100292964 >> v2:172.21.15.204:3300/0 conn(0x7f2d8815db50 msgr2=0x7f2d8806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:17:59.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.899+0000 7f2d87e00640 1 --2- 172.21.15.63:0/4100292964 >> v2:172.21.15.204:3300/0 conn(0x7f2d8815db50 0x7f2d8806c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.899+0000 7f2d87e00640 1 -- 172.21.15.63:0/4100292964 >> v1:172.21.15.204:6789/0 conn(0x7f2d8815df30 legacy=0x7f2d880d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.899+0000 7f2d87e00640 1 -- 172.21.15.63:0/4100292964 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d880d00f0 con 0x7f2d880b27b0 2024-03-26T06:17:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.900+0000 7f2d87e00640 1 --2- 172.21.15.63:0/4100292964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d880b27b0 0x7f2d880cbbb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009d90 tx=0x7f2d8002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c368cc591cf686c server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d86a00640 1 -- 172.21.15.63:0/4100292964 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80039070 con 0x7f2d880b27b0 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d86a00640 1 -- 172.21.15.63:0/4100292964 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8002cc60 con 0x7f2d880b27b0 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d86a00640 1 -- 172.21.15.63:0/4100292964 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80034660 con 0x7f2d880b27b0 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d8d000640 1 -- 172.21.15.63:0/4100292964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d880b27b0 msgr2=0x7f2d880cbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d8d000640 1 --2- 172.21.15.63:0/4100292964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d880b27b0 0x7f2d880cbbb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009d90 tx=0x7f2d8002beb0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d8d000640 1 -- 172.21.15.63:0/4100292964 shutdown_connections 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d8d000640 1 --2- 172.21.15.63:0/4100292964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d880b27b0 0x7f2d880cbbb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d8d000640 1 --2- 172.21.15.63:0/4100292964 >> v2:172.21.15.204:3300/0 conn(0x7f2d8815db50 0x7f2d8806c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d8d000640 1 -- 172.21.15.63:0/4100292964 >> 172.21.15.63:0/4100292964 conn(0x7f2d880b3050 msgr2=0x7f2d880b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d8d000640 1 -- 172.21.15.63:0/4100292964 shutdown_connections 2024-03-26T06:17:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.901+0000 7f2d8d000640 1 -- 172.21.15.63:0/4100292964 wait complete. 2024-03-26T06:17:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.903+0000 7f2d8d000640 1 Processor -- start 2024-03-26T06:17:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.903+0000 7f2d8d000640 1 -- start start 2024-03-26T06:17:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.904+0000 7f2d8d000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d880b27b0 0x7f2d88158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.904+0000 7f2d8d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d8815db50 0x7f2d88154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.904+0000 7f2d8d000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8815df30 0x7f2d88154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.904+0000 7f2d8d000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8806cf00 con 0x7f2d8815db50 2024-03-26T06:17:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.904+0000 7f2d8d000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d880d1000 con 0x7f2d880b27b0 2024-03-26T06:17:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.904+0000 7f2d8d000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8806d080 con 0x7f2d8815df30 2024-03-26T06:17:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.904+0000 7f2d7fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d8815db50 0x7f2d88154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.904+0000 7f2d7fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d8815db50 0x7f2d88154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47444/0 (socket says 172.21.15.63:47444) 2024-03-26T06:17:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.904+0000 7f2d7fe00640 1 -- 172.21.15.63:0/3486688482 learned_addr learned my addr 172.21.15.63:0/3486688482 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.905+0000 7f2d87400640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d880b27b0 0x7f2d88158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.905+0000 7f2d87e00640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8815df30 0x7f2d88154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.905+0000 7f2d7fe00640 1 -- 172.21.15.63:0/3486688482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8815df30 msgr2=0x7f2d88154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.905+0000 7f2d7fe00640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8815df30 0x7f2d88154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.905+0000 7f2d7fe00640 1 -- 172.21.15.63:0/3486688482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d880b27b0 msgr2=0x7f2d88158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.905+0000 7f2d7fe00640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d880b27b0 0x7f2d88158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.905+0000 7f2d7fe00640 1 -- 172.21.15.63:0/3486688482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d880c5da0 con 0x7f2d8815db50 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.905+0000 7f2d7fe00640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d8815db50 0x7f2d88154870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000c400 tx=0x7f2d7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.905+0000 7f2d7f400640 1 -- 172.21.15.63:0/3486688482 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d70017070 con 0x7f2d8815db50 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.906+0000 7f2d7f400640 1 -- 172.21.15.63:0/3486688482 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d70005ce0 con 0x7f2d8815db50 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.906+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d880c6080 con 0x7f2d8815db50 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.906+0000 7f2d7f400640 1 -- 172.21.15.63:0/3486688482 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d700072f0 con 0x7f2d8815db50 2024-03-26T06:17:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.906+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d880c6640 con 0x7f2d8815db50 2024-03-26T06:17:59.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.907+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d880b71d0 con 0x7f2d8815db50 2024-03-26T06:17:59.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.908+0000 7f2d7f400640 1 -- 172.21.15.63:0/3486688482 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2d7001a070 con 0x7f2d8815db50 2024-03-26T06:17:59.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.909+0000 7f2d7f400640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2d6406bbd0 0x7f2d6406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:17:59.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.909+0000 7f2d7f400640 1 -- 172.21.15.63:0/3486688482 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2d7008a310 con 0x7f2d8815db50 2024-03-26T06:17:59.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.909+0000 7f2d87400640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2d6406bbd0 0x7f2d6406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:17:59.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.910+0000 7f2d87400640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2d6406bbd0 0x7f2d6406e090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009ad0 tx=0x7f2d78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:17:59.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:17:59.913+0000 7f2d7f400640 1 -- 172.21.15.63:0/3486688482 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2d880b71d0 con 0x7f2d8815db50 2024-03-26T06:18:00.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.116+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d8804f0c0 con 0x7f2d8815db50 2024-03-26T06:18:00.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.117+0000 7f2d7f400640 1 -- 172.21.15.63:0/3486688482 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d70058960 con 0x7f2d8815db50 2024-03-26T06:18:00.118 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2d6406bbd0 msgr2=0x7f2d6406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2d6406bbd0 0x7f2d6406e090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009ad0 tx=0x7f2d78008040 comp rx=0 tx=0).stop 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d8815db50 msgr2=0x7f2d88154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d8815db50 0x7f2d88154870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000c400 tx=0x7f2d7000c8c0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 shutdown_connections 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2d6406bbd0 0x7f2d6406e090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8815df30 0x7f2d88154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d8815db50 0x7f2d88154870 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 --2- 172.21.15.63:0/3486688482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d880b27b0 0x7f2d88158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 >> 172.21.15.63:0/3486688482 conn(0x7f2d880b3050 msgr2=0x7f2d880b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 shutdown_connections 2024-03-26T06:18:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.120+0000 7f2d8d000640 1 -- 172.21.15.63:0/3486688482 wait complete. 2024-03-26T06:18:00.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:18:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.363+0000 7fea8b800640 1 Processor -- start 2024-03-26T06:18:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.363+0000 7fea8b800640 1 -- start start 2024-03-26T06:18:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.365+0000 7fea8b800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea840cfd60 0x7fea840b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.365+0000 7fea8b800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fea84071a00 0x7fea840ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.365+0000 7fea8b800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea840d0140 con 0x7fea84144c70 2024-03-26T06:18:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.365+0000 7fea8b800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea840b4b10 con 0x7fea84071a00 2024-03-26T06:18:00.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.365+0000 7fea8b800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea840b3530 con 0x7fea840cfd60 2024-03-26T06:18:00.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.365+0000 7fea7be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fea84144c70 0x7fea840712f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42516/0 (socket says 172.21.15.63:42516) 2024-03-26T06:18:00.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.365+0000 7fea7be00640 1 -- 172.21.15.63:0/1817382948 learned_addr learned my addr 172.21.15.63:0/1817382948 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:00.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea88e00640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea840cfd60 0x7fea840b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea89800640 1 --2- 172.21.15.63:0/1817382948 >> v2:172.21.15.204:3300/0 conn(0x7fea84071a00 0x7fea840ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283505560 0 0) 0x7fea840d0140 con 0x7fea84144c70 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea64003520 con 0x7fea84144c70 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 942006895 0 0) 0x7fea64003520 con 0x7fea84144c70 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea840cfd60 msgr2=0x7fea840b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea840cfd60 0x7fea840b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 >> v2:172.21.15.204:3300/0 conn(0x7fea84071a00 msgr2=0x7fea840ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 --2- 172.21.15.63:0/1817382948 >> v2:172.21.15.204:3300/0 conn(0x7fea84071a00 0x7fea840ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea840b3810 con 0x7fea84144c70 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fea6c001690 con 0x7fea84144c70 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 >> v1:172.21.15.63:6789/0 conn(0x7fea84144c70 legacy=0x7fea840712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.366+0000 7fea83e00640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea640039b0 0x7fea64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea83e00640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea64004800 0x7fea64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea83e00640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea840cfd60 0x7fea640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea840b4b10 con 0x7fea64004800 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea840b3530 con 0x7fea640039b0 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6400b9c0 con 0x7fea840cfd60 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea7be00640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea64004800 0x7fea64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea89800640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea840cfd60 0x7fea640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea7be00640 1 -- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea840cfd60 msgr2=0x7fea640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea7be00640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea840cfd60 0x7fea640051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea7be00640 1 -- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea640039b0 msgr2=0x7fea64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea7be00640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea640039b0 0x7fea64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.367+0000 7fea7be00640 1 -- 172.21.15.63:0/1817382948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64003520 con 0x7fea64004800 2024-03-26T06:18:00.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.368+0000 7fea7be00640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea64004800 0x7fea64004c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fea840d0310 tx=0x7fea64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ef9600a904e7e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:00.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.369+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c007ca0 con 0x7fea64004800 2024-03-26T06:18:00.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.369+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c030070 con 0x7fea64004800 2024-03-26T06:18:00.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.369+0000 7fea83e00640 1 -- 172.21.15.63:0/1817382948 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c005d10 con 0x7fea64004800 2024-03-26T06:18:00.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.369+0000 7fea8b800640 1 -- 172.21.15.63:0/1817382948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea64004800 msgr2=0x7fea64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.369+0000 7fea8b800640 1 --2- 172.21.15.63:0/1817382948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea64004800 0x7fea64004c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fea840d0310 tx=0x7fea64005830 comp rx=0 tx=0).stop 2024-03-26T06:18:00.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.369+0000 7fea89800640 1 -- 172.21.15.63:0/1817382948 reap_dead start 2024-03-26T06:18:00.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.369+0000 7fea8b800640 1 -- 172.21.15.63:0/1817382948 shutdown_connections 2024-03-26T06:18:00.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.369+0000 7fea8b800640 1 -- 172.21.15.63:0/1817382948 >> 172.21.15.63:0/1817382948 conn(0x7fea8406ac90 msgr2=0x7fea8406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:00.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.369+0000 7fea8b800640 1 -- 172.21.15.63:0/1817382948 shutdown_connections 2024-03-26T06:18:00.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.370+0000 7fea8b800640 1 -- 172.21.15.63:0/1817382948 wait complete. 2024-03-26T06:18:00.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.371+0000 7fea8b800640 1 Processor -- start 2024-03-26T06:18:00.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.371+0000 7fea8b800640 1 -- start start 2024-03-26T06:18:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.372+0000 7fea8b800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea64004800 0x7fea841f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.372+0000 7fea8b800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea840ada60 0x7fea840adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.372+0000 7fea8b800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea84130870 0x7fea84130cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.372+0000 7fea8b800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea840b40b0 con 0x7fea84130870 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.372+0000 7fea8b800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea840b3dd0 con 0x7fea840ada60 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.372+0000 7fea8b800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea840b31c0 con 0x7fea64004800 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea89800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea84130870 0x7fea84130cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea89800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea84130870 0x7fea84130cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47452/0 (socket says 172.21.15.63:47452) 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea89800640 1 -- 172.21.15.63:0/3572641359 learned_addr learned my addr 172.21.15.63:0/3572641359 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea88e00640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea64004800 0x7fea841f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea7be00640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea840ada60 0x7fea840adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea89800640 1 -- 172.21.15.63:0/3572641359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea64004800 msgr2=0x7fea841f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea89800640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea64004800 0x7fea841f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea89800640 1 -- 172.21.15.63:0/3572641359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea840ada60 msgr2=0x7fea840adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea89800640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea840ada60 0x7fea840adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea89800640 1 -- 172.21.15.63:0/3572641359 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea841e5420 con 0x7fea84130870 2024-03-26T06:18:00.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea7be00640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea840ada60 0x7fea840adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:00.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.373+0000 7fea89800640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea84130870 0x7fea84130cf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fea84067520 tx=0x7fea7c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:00.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.374+0000 7fea81600640 1 -- 172.21.15.63:0/3572641359 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c01c070 con 0x7fea84130870 2024-03-26T06:18:00.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.374+0000 7fea81600640 1 -- 172.21.15.63:0/3572641359 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c017400 con 0x7fea84130870 2024-03-26T06:18:00.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.374+0000 7fea81600640 1 -- 172.21.15.63:0/3572641359 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0177f0 con 0x7fea84130870 2024-03-26T06:18:00.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.374+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea841e5700 con 0x7fea84130870 2024-03-26T06:18:00.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.374+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea841e5cc0 con 0x7fea84130870 2024-03-26T06:18:00.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.375+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea841e5ec0 con 0x7fea84130870 2024-03-26T06:18:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.376+0000 7fea81600640 1 -- 172.21.15.63:0/3572641359 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fea7c01f070 con 0x7fea84130870 2024-03-26T06:18:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.377+0000 7fea81600640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fea6006bbd0 0x7fea6006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.377+0000 7fea81600640 1 -- 172.21.15.63:0/3572641359 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fea7c08add0 con 0x7fea84130870 2024-03-26T06:18:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.377+0000 7fea88e00640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fea6006bbd0 0x7fea6006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.378+0000 7fea88e00640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fea6006bbd0 0x7fea6006e090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea740047b0 tx=0x7fea74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:00.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.381+0000 7fea81600640 1 -- 172.21.15.63:0/3572641359 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fea841e5ec0 con 0x7fea84130870 2024-03-26T06:18:00.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.585+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea84074730 con 0x7fea84130870 2024-03-26T06:18:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.586+0000 7fea81600640 1 -- 172.21.15.63:0/3572641359 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea7c012070 con 0x7fea84130870 2024-03-26T06:18:00.587 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:18:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.588+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fea6006bbd0 msgr2=0x7fea6006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.588+0000 7fea8b800640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fea6006bbd0 0x7fea6006e090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea740047b0 tx=0x7fea74008040 comp rx=0 tx=0).stop 2024-03-26T06:18:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.588+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea84130870 msgr2=0x7fea84130cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.588+0000 7fea8b800640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea84130870 0x7fea84130cf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fea84067520 tx=0x7fea7c00f4a0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.589+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 shutdown_connections 2024-03-26T06:18:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.589+0000 7fea8b800640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fea6006bbd0 0x7fea6006e090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.589+0000 7fea8b800640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea84130870 0x7fea84130cf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.589+0000 7fea8b800640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea840ada60 0x7fea840adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.589+0000 7fea8b800640 1 --2- 172.21.15.63:0/3572641359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea64004800 0x7fea841f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.589+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 >> 172.21.15.63:0/3572641359 conn(0x7fea8406ac90 msgr2=0x7fea840712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.589+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 shutdown_connections 2024-03-26T06:18:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.589+0000 7fea8b800640 1 -- 172.21.15.63:0/3572641359 wait complete. 2024-03-26T06:18:00.610 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:18:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.842+0000 7fb6af200640 1 Processor -- start 2024-03-26T06:18:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.842+0000 7fb6af200640 1 -- start start 2024-03-26T06:18:00.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.844+0000 7fb6af200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb6b00d3840 0x7fb6b00d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.844+0000 7fb6af200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b015dca0 0x7fb6b00d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.844+0000 7fb6af200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b00d4160 con 0x7fb6b00b9320 2024-03-26T06:18:00.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.844+0000 7fb6af200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b00d22d0 con 0x7fb6b00d3840 2024-03-26T06:18:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.844+0000 7fb6af200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00d25b0 con 0x7fb6b015dca0 2024-03-26T06:18:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.844+0000 7fb6ade00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb6b00d3840 0x7fb6b00d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.844+0000 7fb6ade00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb6b00d3840 0x7fb6b00d3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44624/0 (socket says 172.21.15.63:44624) 2024-03-26T06:18:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.844+0000 7fb6ade00640 1 -- 172.21.15.63:0/2025343973 learned_addr learned my addr 172.21.15.63:0/2025343973 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.845+0000 7fb6a7e00640 1 --2- 172.21.15.63:0/2025343973 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b015dca0 0x7fb6b00d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.845+0000 7fb6ade00640 1 -- 172.21.15.63:0/2025343973 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b015dca0 msgr2=0x7fb6b00d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.845+0000 7fb6ade00640 1 --2- 172.21.15.63:0/2025343973 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b015dca0 0x7fb6b00d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.845+0000 7fb6ade00640 1 -- 172.21.15.63:0/2025343973 >> v1:172.21.15.204:6789/0 conn(0x7fb6b00b9320 legacy=0x7fb6b00b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.845+0000 7fb6ade00640 1 -- 172.21.15.63:0/2025343973 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b00d2890 con 0x7fb6b00d3840 2024-03-26T06:18:00.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.846+0000 7fb6ade00640 1 --2- 172.21.15.63:0/2025343973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00d3840 0x7fb6b00d3c20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009870 tx=0x7fb6a002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e244e908ad8996 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:00.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6ad400640 1 -- 172.21.15.63:0/2025343973 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0035020 con 0x7fb6b00d3840 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6ad400640 1 -- 172.21.15.63:0/2025343973 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a0031640 con 0x7fb6b00d3840 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6ad400640 1 -- 172.21.15.63:0/2025343973 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a002d040 con 0x7fb6b00d3840 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6af200640 1 -- 172.21.15.63:0/2025343973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00d3840 msgr2=0x7fb6b00d3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6af200640 1 --2- 172.21.15.63:0/2025343973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00d3840 0x7fb6b00d3c20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009870 tx=0x7fb6a002b8f0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6af200640 1 -- 172.21.15.63:0/2025343973 shutdown_connections 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6af200640 1 --2- 172.21.15.63:0/2025343973 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b015dca0 0x7fb6b00d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6af200640 1 --2- 172.21.15.63:0/2025343973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00d3840 0x7fb6b00d3c20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6af200640 1 -- 172.21.15.63:0/2025343973 >> 172.21.15.63:0/2025343973 conn(0x7fb6b006c570 msgr2=0x7fb6b006c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6af200640 1 -- 172.21.15.63:0/2025343973 shutdown_connections 2024-03-26T06:18:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.847+0000 7fb6af200640 1 -- 172.21.15.63:0/2025343973 wait complete. 2024-03-26T06:18:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.849+0000 7fb6af200640 1 Processor -- start 2024-03-26T06:18:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.849+0000 7fb6af200640 1 -- start start 2024-03-26T06:18:00.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.850+0000 7fb6af200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00b9320 0x7fb6b0154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.850+0000 7fb6af200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b00d3840 0x7fb6b01e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.850+0000 7fb6af200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6b015dca0 0x7fb6b0154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.850+0000 7fb6af200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00d1ea0 con 0x7fb6b00b9320 2024-03-26T06:18:00.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.850+0000 7fb6af200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00d2e50 con 0x7fb6b015dca0 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.850+0000 7fb6af200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00d2020 con 0x7fb6b00d3840 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6ade00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00b9320 0x7fb6b0154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6ade00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00b9320 0x7fb6b0154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44640/0 (socket says 172.21.15.63:44640) 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6ade00640 1 -- 172.21.15.63:0/1816461337 learned_addr learned my addr 172.21.15.63:0/1816461337 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6a7e00640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b00d3840 0x7fb6b01e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6ade00640 1 -- 172.21.15.63:0/1816461337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b00d3840 msgr2=0x7fb6b01e6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6ade00640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b00d3840 0x7fb6b01e6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6ade00640 1 -- 172.21.15.63:0/1816461337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6b015dca0 msgr2=0x7fb6b0154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6ade00640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6b015dca0 0x7fb6b0154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6ade00640 1 -- 172.21.15.63:0/1816461337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b01e6760 con 0x7fb6b00b9320 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6a7e00640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b00d3840 0x7fb6b01e6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.851+0000 7fb6ade00640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00b9320 0x7fb6b0154980 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0000c00 tx=0x7fb6a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:00.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.852+0000 7fb6a6000640 1 -- 172.21.15.63:0/1816461337 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0040070 con 0x7fb6b00b9320 2024-03-26T06:18:00.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.852+0000 7fb6a6000640 1 -- 172.21.15.63:0/1816461337 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a00399f0 con 0x7fb6b00b9320 2024-03-26T06:18:00.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.852+0000 7fb6a6000640 1 -- 172.21.15.63:0/1816461337 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0035040 con 0x7fb6b00b9320 2024-03-26T06:18:00.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.852+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b01e69e0 con 0x7fb6b00b9320 2024-03-26T06:18:00.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.852+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b01e6fa0 con 0x7fb6b00b9320 2024-03-26T06:18:00.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.853+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b004f0c0 con 0x7fb6b00b9320 2024-03-26T06:18:00.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.854+0000 7fb6a6000640 1 -- 172.21.15.63:0/1816461337 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb6a004b060 con 0x7fb6b00b9320 2024-03-26T06:18:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.855+0000 7fb6a6000640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb68c06bbd0 0x7fb68c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.855+0000 7fb6a6000640 1 -- 172.21.15.63:0/1816461337 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb6a00ac790 con 0x7fb6b00b9320 2024-03-26T06:18:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.855+0000 7fb6a7e00640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb68c06bbd0 0x7fb68c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.856+0000 7fb6a7e00640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb68c06bbd0 0x7fb68c06e090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb6b01e80e0 tx=0x7fb698008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:00.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:00.859+0000 7fb6a6000640 1 -- 172.21.15.63:0/1816461337 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb6b01e6760 con 0x7fb6b00b9320 2024-03-26T06:18:01.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.060+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb6b0160f20 con 0x7fb6b00b9320 2024-03-26T06:18:01.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.061+0000 7fb6a6000640 1 -- 172.21.15.63:0/1816461337 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb6a007af10 con 0x7fb6b00b9320 2024-03-26T06:18:01.062 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb68c06bbd0 msgr2=0x7fb68c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb68c06bbd0 0x7fb68c06e090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb6b01e80e0 tx=0x7fb698008040 comp rx=0 tx=0).stop 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00b9320 msgr2=0x7fb6b0154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00b9320 0x7fb6b0154980 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0000c00 tx=0x7fb6a00046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 shutdown_connections 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb68c06bbd0 0x7fb68c06e090 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6b015dca0 0x7fb6b0154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6b00d3840 0x7fb6b01e6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 --2- 172.21.15.63:0/1816461337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6b00b9320 0x7fb6b0154980 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.063+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 >> 172.21.15.63:0/1816461337 conn(0x7fb6b006c570 msgr2=0x7fb6b00723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:01.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.064+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 shutdown_connections 2024-03-26T06:18:01.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.064+0000 7fb6af200640 1 -- 172.21.15.63:0/1816461337 wait complete. 2024-03-26T06:18:01.083 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-26T06:18:01.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.293+0000 7f2541800640 1 Processor -- start 2024-03-26T06:18:01.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.293+0000 7f2541800640 1 -- start start 2024-03-26T06:18:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.295+0000 7f2541800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f253c06f330 0x7f253c0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.295+0000 7f2541800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f253c0cca00 0x7f253c0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.295+0000 7f2541800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c15a9e0 con 0x7f253c15a600 2024-03-26T06:18:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.295+0000 7f2541800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c15e1c0 con 0x7f253c06f330 2024-03-26T06:18:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.295+0000 7f2541800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c15e4a0 con 0x7f253c0cca00 2024-03-26T06:18:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.295+0000 7f253be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f253c15a600 0x7f253c06ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60568/0 (socket says 172.21.15.63:60568) 2024-03-26T06:18:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.295+0000 7f253be00640 1 -- 172.21.15.63:0/619529779 learned_addr learned my addr 172.21.15.63:0/619529779 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.295+0000 7f253b400640 1 --2- 172.21.15.63:0/619529779 >> v2:172.21.15.63:3300/0 conn(0x7f253c06f330 0x7f253c0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.295+0000 7f2540e00640 1 --2- 172.21.15.63:0/619529779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f253c0cca00 0x7f253c0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.296+0000 7f253aa00640 1 -- 172.21.15.63:0/619529779 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749245345 0 0) 0x7f252c001110 con 0x7f253c15a600 2024-03-26T06:18:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.296+0000 7f253aa00640 1 -- 172.21.15.63:0/619529779 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2520003520 con 0x7f253c15a600 2024-03-26T06:18:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.296+0000 7f253b400640 1 -- 172.21.15.63:0/619529779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f253c0cca00 msgr2=0x7f253c0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.296+0000 7f253b400640 1 --2- 172.21.15.63:0/619529779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f253c0cca00 0x7f253c0b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.296+0000 7f253b400640 1 -- 172.21.15.63:0/619529779 >> v1:172.21.15.63:6789/0 conn(0x7f253c15a600 legacy=0x7f253c06ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.296+0000 7f253b400640 1 -- 172.21.15.63:0/619529779 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c15e780 con 0x7f253c06f330 2024-03-26T06:18:01.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.297+0000 7f253b400640 1 --2- 172.21.15.63:0/619529779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c06f330 0x7f253c0cc4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f25280097a0 tx=0x7f252802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10c624f03e59aa2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:01.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.297+0000 7f253aa00640 1 -- 172.21.15.63:0/619529779 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528035020 con 0x7f253c06f330 2024-03-26T06:18:01.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.297+0000 7f253aa00640 1 -- 172.21.15.63:0/619529779 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2528031830 con 0x7f253c06f330 2024-03-26T06:18:01.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.297+0000 7f253aa00640 1 -- 172.21.15.63:0/619529779 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528031be0 con 0x7f253c06f330 2024-03-26T06:18:01.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.298+0000 7f2541800640 1 -- 172.21.15.63:0/619529779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c06f330 msgr2=0x7f253c0cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:01.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.298+0000 7f2541800640 1 --2- 172.21.15.63:0/619529779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c06f330 0x7f253c0cc4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f25280097a0 tx=0x7f252802b8d0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.298+0000 7f2541800640 1 -- 172.21.15.63:0/619529779 shutdown_connections 2024-03-26T06:18:01.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.298+0000 7f2541800640 1 --2- 172.21.15.63:0/619529779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c06f330 0x7f253c0cc4c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.298+0000 7f2541800640 1 --2- 172.21.15.63:0/619529779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f253c0cca00 0x7f253c0b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.298+0000 7f2541800640 1 -- 172.21.15.63:0/619529779 >> 172.21.15.63:0/619529779 conn(0x7f253c0b13d0 msgr2=0x7f253c0b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:01.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.298+0000 7f2541800640 1 -- 172.21.15.63:0/619529779 shutdown_connections 2024-03-26T06:18:01.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.298+0000 7f2541800640 1 -- 172.21.15.63:0/619529779 wait complete. 2024-03-26T06:18:01.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.300+0000 7f2541800640 1 Processor -- start 2024-03-26T06:18:01.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.300+0000 7f2541800640 1 -- start start 2024-03-26T06:18:01.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.301+0000 7f2541800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f253c06f330 0x7f253c1e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:01.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.301+0000 7f2541800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c0cca00 0x7f253c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:01.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.301+0000 7f2541800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f253c15a600 0x7f253c13d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:01.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.301+0000 7f2541800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c0cce60 con 0x7f253c0cca00 2024-03-26T06:18:01.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.301+0000 7f2541800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c15ed40 con 0x7f253c15a600 2024-03-26T06:18:01.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.301+0000 7f2541800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c0ccfe0 con 0x7f253c06f330 2024-03-26T06:18:01.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.301+0000 7f253b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c0cca00 0x7f253c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.301+0000 7f253b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c0cca00 0x7f253c071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44658/0 (socket says 172.21.15.63:44658) 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.301+0000 7f253b400640 1 -- 172.21.15.63:0/123472997 learned_addr learned my addr 172.21.15.63:0/123472997 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f2540e00640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f253c15a600 0x7f253c13d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f253b400640 1 -- 172.21.15.63:0/123472997 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f253c06f330 msgr2=0x7f253c1e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f253b400640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f253c06f330 0x7f253c1e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f253b400640 1 -- 172.21.15.63:0/123472997 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f253c15a600 msgr2=0x7f253c13d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f253b400640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f253c15a600 0x7f253c13d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f253b400640 1 -- 172.21.15.63:0/123472997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c151f90 con 0x7f253c0cca00 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f2540e00640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f253c15a600 0x7f253c13d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f253b400640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c0cca00 0x7f253c071380 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f25280098c0 tx=0x7f25280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f2533e00640 1 -- 172.21.15.63:0/123472997 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528041070 con 0x7f253c0cca00 2024-03-26T06:18:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f2533e00640 1 -- 172.21.15.63:0/123472997 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252803b900 con 0x7f253c0cca00 2024-03-26T06:18:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.302+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c154140 con 0x7f253c0cca00 2024-03-26T06:18:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.303+0000 7f2533e00640 1 -- 172.21.15.63:0/123472997 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528035040 con 0x7f253c0cca00 2024-03-26T06:18:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.303+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c154700 con 0x7f253c0cca00 2024-03-26T06:18:01.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.304+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c04f050 con 0x7f253c0cca00 2024-03-26T06:18:01.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.305+0000 7f2533e00640 1 -- 172.21.15.63:0/123472997 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f252804c060 con 0x7f253c0cca00 2024-03-26T06:18:01.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.306+0000 7f2533e00640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f251c06bbd0 0x7f251c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:01.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.306+0000 7f2533e00640 1 -- 172.21.15.63:0/123472997 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f25280ac7c0 con 0x7f253c0cca00 2024-03-26T06:18:01.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.306+0000 7f253be00640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f251c06bbd0 0x7f251c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:01.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.307+0000 7f253be00640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f251c06bbd0 0x7f251c06e090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f252c000f60 tx=0x7f252c001110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:01.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.310+0000 7f2533e00640 1 -- 172.21.15.63:0/123472997 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2528031800 con 0x7f253c0cca00 2024-03-26T06:18:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:01.586+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f253c06d840 con 0x7f253c0cca00 2024-03-26T06:18:02.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.049+0000 7f2533e00640 1 -- 172.21.15.63:0/123472997 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v82) v1 ==== 147+0+0 (secure 0 0 0) 0x7f252807ae10 con 0x7f253c0cca00 2024-03-26T06:18:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.053+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f251c06bbd0 msgr2=0x7f251c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.053+0000 7f2541800640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f251c06bbd0 0x7f251c06e090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f252c000f60 tx=0x7f252c001110 comp rx=0 tx=0).stop 2024-03-26T06:18:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.053+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c0cca00 msgr2=0x7f253c071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.053+0000 7f2541800640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c0cca00 0x7f253c071380 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f25280098c0 tx=0x7f25280046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.054+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 shutdown_connections 2024-03-26T06:18:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.054+0000 7f2541800640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f251c06bbd0 0x7f251c06e090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.054+0000 7f2541800640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f253c15a600 0x7f253c13d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.054+0000 7f2541800640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f253c0cca00 0x7f253c071380 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.054+0000 7f2541800640 1 --2- 172.21.15.63:0/123472997 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f253c06f330 0x7f253c1e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.054+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 >> 172.21.15.63:0/123472997 conn(0x7f253c0b13d0 msgr2=0x7f253c073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:02.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.054+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 shutdown_connections 2024-03-26T06:18:02.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.054+0000 7f2541800640 1 -- 172.21.15.63:0/123472997 wait complete. 2024-03-26T06:18:02.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-26T06:18:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.293+0000 7f660b200640 1 Processor -- start 2024-03-26T06:18:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.294+0000 7f660b200640 1 -- start start 2024-03-26T06:18:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.295+0000 7f660b200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f660c0b37c0 0x7f660c071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.295+0000 7f660b200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f660c071680 0x7f660c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.295+0000 7f660b200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c165800 con 0x7f660c15f740 2024-03-26T06:18:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.295+0000 7f660b200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c163170 con 0x7f660c0b37c0 2024-03-26T06:18:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.295+0000 7f660b200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c165ac0 con 0x7f660c071680 2024-03-26T06:18:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.296+0000 7f6603e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f660c0b37c0 0x7f660c071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.296+0000 7f6609e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f660c15f740 0x7f660c06ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60572/0 (socket says 172.21.15.63:60572) 2024-03-26T06:18:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.296+0000 7f6603e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f660c0b37c0 0x7f660c071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44674/0 (socket says 172.21.15.63:44674) 2024-03-26T06:18:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.296+0000 7f6609e00640 1 -- 172.21.15.63:0/1875050802 learned_addr learned my addr 172.21.15.63:0/1875050802 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.296+0000 7f660a800640 1 --2- 172.21.15.63:0/1875050802 >> v2:172.21.15.204:3300/0 conn(0x7f660c071680 0x7f660c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.296+0000 7f6603e00640 1 -- 172.21.15.63:0/1875050802 >> v2:172.21.15.204:3300/0 conn(0x7f660c071680 msgr2=0x7f660c06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.297+0000 7f6603e00640 1 --2- 172.21.15.63:0/1875050802 >> v2:172.21.15.204:3300/0 conn(0x7f660c071680 0x7f660c06d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.297+0000 7f6603e00640 1 -- 172.21.15.63:0/1875050802 >> v1:172.21.15.63:6789/0 conn(0x7f660c15f740 legacy=0x7f660c06ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.297+0000 7f6603e00640 1 -- 172.21.15.63:0/1875050802 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c165da0 con 0x7f660c0b37c0 2024-03-26T06:18:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.297+0000 7f6609400640 1 -- 172.21.15.63:0/1875050802 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281841640 0 0) 0x7f660c165800 con 0x7f660c15f740 2024-03-26T06:18:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.297+0000 7f660a800640 1 --2- 172.21.15.63:0/1875050802 >> v2:172.21.15.204:3300/0 conn(0x7f660c071680 0x7f660c06d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.298+0000 7f6603e00640 1 --2- 172.21.15.63:0/1875050802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c0b37c0 0x7f660c071140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f660c06e680 tx=0x7f65f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33072db2ec768662 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.298+0000 7f6609400640 1 -- 172.21.15.63:0/1875050802 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f40315a0 con 0x7f660c0b37c0 2024-03-26T06:18:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.298+0000 7f6609400640 1 -- 172.21.15.63:0/1875050802 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4037070 con 0x7f660c0b37c0 2024-03-26T06:18:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.298+0000 7f6609400640 1 -- 172.21.15.63:0/1875050802 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4031960 con 0x7f660c0b37c0 2024-03-26T06:18:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.299+0000 7f660b200640 1 -- 172.21.15.63:0/1875050802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c0b37c0 msgr2=0x7f660c071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.299+0000 7f660b200640 1 --2- 172.21.15.63:0/1875050802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c0b37c0 0x7f660c071140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f660c06e680 tx=0x7f65f402b840 comp rx=0 tx=0).stop 2024-03-26T06:18:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.299+0000 7f660b200640 1 -- 172.21.15.63:0/1875050802 shutdown_connections 2024-03-26T06:18:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.299+0000 7f660b200640 1 --2- 172.21.15.63:0/1875050802 >> v2:172.21.15.204:3300/0 conn(0x7f660c071680 0x7f660c06d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.299+0000 7f660b200640 1 --2- 172.21.15.63:0/1875050802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c0b37c0 0x7f660c071140 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.299+0000 7f660b200640 1 -- 172.21.15.63:0/1875050802 >> 172.21.15.63:0/1875050802 conn(0x7f660c0670b0 msgr2=0x7f660c0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.299+0000 7f660b200640 1 -- 172.21.15.63:0/1875050802 shutdown_connections 2024-03-26T06:18:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.299+0000 7f660b200640 1 -- 172.21.15.63:0/1875050802 wait complete. 2024-03-26T06:18:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.301+0000 7f660b200640 1 Processor -- start 2024-03-26T06:18:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.301+0000 7f660b200640 1 -- start start 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f660b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c071680 0x7f660c149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f660b200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f660c0b37c0 0x7f660c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f660b200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660c15f740 0x7f660c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f660b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c166640 con 0x7f660c071680 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f660b200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c166360 con 0x7f660c0b37c0 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f660b200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c15fb20 con 0x7f660c15f740 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f6609e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c071680 0x7f660c149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f6609e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c071680 0x7f660c149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44690/0 (socket says 172.21.15.63:44690) 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f6609e00640 1 -- 172.21.15.63:0/3959172846 learned_addr learned my addr 172.21.15.63:0/3959172846 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.302+0000 7f660a800640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660c15f740 0x7f660c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6603e00640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f660c0b37c0 0x7f660c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6609e00640 1 -- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660c15f740 msgr2=0x7f660c0af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6609e00640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660c15f740 0x7f660c0af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6609e00640 1 -- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f660c0b37c0 msgr2=0x7f660c15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6609e00640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f660c0b37c0 0x7f660c15af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6609e00640 1 -- 172.21.15.63:0/3959172846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c156320 con 0x7f660c071680 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f660a800640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660c15f740 0x7f660c0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6603e00640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f660c0b37c0 0x7f660c15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6609e00640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c071680 0x7f660c149720 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00c460 tx=0x7f65fc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6602000640 1 -- 172.21.15.63:0/3959172846 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc018070 con 0x7f660c071680 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6602000640 1 -- 172.21.15.63:0/3959172846 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc007500 con 0x7f660c071680 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c164240 con 0x7f660c071680 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.303+0000 7f6602000640 1 -- 172.21.15.63:0/3959172846 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc004a20 con 0x7f660c071680 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.304+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c164520 con 0x7f660c071680 2024-03-26T06:18:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.305+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c04f0c0 con 0x7f660c071680 2024-03-26T06:18:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.306+0000 7f6602000640 1 -- 172.21.15.63:0/3959172846 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f65fc01b070 con 0x7f660c071680 2024-03-26T06:18:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.306+0000 7f6602000640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f65e806bc00 0x7f65e806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.307+0000 7f6602000640 1 -- 172.21.15.63:0/3959172846 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f65fc08a090 con 0x7f660c071680 2024-03-26T06:18:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.307+0000 7f6603e00640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f65e806bc00 0x7f65e806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.308+0000 7f6603e00640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f65e806bc00 0x7f65e806e0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f65f4036000 tx=0x7f65f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:02.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.311+0000 7f6602000640 1 -- 172.21.15.63:0/3959172846 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f65fc058770 con 0x7f660c071680 2024-03-26T06:18:02.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.512+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f660c0b0f10 con 0x7f660c071680 2024-03-26T06:18:02.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.519+0000 7f6602000640 1 -- 172.21.15.63:0/3959172846 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f65fc058070 con 0x7f660c071680 2024-03-26T06:18:02.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f65e806bc00 msgr2=0x7f65e806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f65e806bc00 0x7f65e806e0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f65f4036000 tx=0x7f65f4008030 comp rx=0 tx=0).stop 2024-03-26T06:18:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c071680 msgr2=0x7f660c149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c071680 0x7f660c149720 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00c460 tx=0x7f65fc00c920 comp rx=0 tx=0).stop 2024-03-26T06:18:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 shutdown_connections 2024-03-26T06:18:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f65e806bc00 0x7f65e806e0c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660c15f740 0x7f660c0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f660c0b37c0 0x7f660c15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 --2- 172.21.15.63:0/3959172846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f660c071680 0x7f660c149720 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.523+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 >> 172.21.15.63:0/3959172846 conn(0x7f660c0670b0 msgr2=0x7f660c15e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:02.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.524+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 shutdown_connections 2024-03-26T06:18:02.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:02.524+0000 7f660b200640 1 -- 172.21.15.63:0/3959172846 wait complete. 2024-03-26T06:18:02.544 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-26T06:18:02.544 DEBUG:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-26T06:18:02.657 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-26T06:18:02.782 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-26T06:18:02.783 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:18:02.783 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:02.845 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:18:02.845 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:02.903 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:18:02.903 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:02.958 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:03.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.190+0000 7f3cf7e00640 1 Processor -- start 2024-03-26T06:18:03.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.190+0000 7f3cf7e00640 1 -- start start 2024-03-26T06:18:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.192+0000 7f3cf7e00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3cf80b4c50 0x7f3cf80ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.192+0000 7f3cf7e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf80cc070 con 0x7f3cf8144b50 2024-03-26T06:18:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.192+0000 7f3cf7e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf815fde0 con 0x7f3cf80b5030 2024-03-26T06:18:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.192+0000 7f3cf7e00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf81600c0 con 0x7f3cf80b4c50 2024-03-26T06:18:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.192+0000 7f3cf7400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3cf8144b50 0x7f3cf806d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60586/0 (socket says 172.21.15.63:60586) 2024-03-26T06:18:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.192+0000 7f3cf7400640 1 -- 172.21.15.63:0/3920289299 learned_addr learned my addr 172.21.15.63:0/3920289299 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6a00640 1 --2- 172.21.15.63:0/3920289299 >> v2:172.21.15.204:3300/0 conn(0x7f3cf80b4c50 0x7f3cf80ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277612609 0 0) 0x7f3cf80cc070 con 0x7f3cf8144b50 2024-03-26T06:18:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cdc003520 con 0x7f3cf8144b50 2024-03-26T06:18:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3801879910 0 0) 0x7f3cdc003520 con 0x7f3cf8144b50 2024-03-26T06:18:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 >> v2:172.21.15.204:3300/0 conn(0x7f3cf80b4c50 msgr2=0x7f3cf80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 --2- 172.21.15.63:0/3920289299 >> v2:172.21.15.204:3300/0 conn(0x7f3cf80b4c50 0x7f3cf80ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 >> v1:172.21.15.204:6789/0 conn(0x7f3cf80b5030 legacy=0x7f3cf815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80cc310 con 0x7f3cf8144b50 2024-03-26T06:18:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f3cf0001670 con 0x7f3cf8144b50 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 >> v1:172.21.15.63:6789/0 conn(0x7f3cf8144b50 legacy=0x7f3cf806d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cdc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cdc004800 0x7f3cdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cdc005210 0x7f3cdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf81600c0 con 0x7f3cdc003a00 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.193+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc00c150 con 0x7f3cdc005210 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc00c350 con 0x7f3cdc004800 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf6a00640 1 --2- 172.21.15.63:0/3920289299 >> v2:172.21.15.204:3300/0 conn(0x7f3cf80b4c50 0x7f3cf80ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf6a00640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cdc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cee000640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cdc004800 0x7f3cdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf7400640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cdc005210 0x7f3cdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf6a00640 1 -- 172.21.15.63:0/3920289299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cdc004800 msgr2=0x7f3cdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf6a00640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cdc004800 0x7f3cdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf6a00640 1 -- 172.21.15.63:0/3920289299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cdc005210 msgr2=0x7f3cdc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf6a00640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cdc005210 0x7f3cdc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf6a00640 1 -- 172.21.15.63:0/3920289299 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc003520 con 0x7f3cdc003a00 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.194+0000 7f3cf7400640 1 -- 172.21.15.63:0/3920289299 reap_dead start 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.196+0000 7f3cf6a00640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cdc003e20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80073e0 tx=0x7f3cdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8a90c4e8267d20 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.196+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8039070 con 0x7f3cdc003a00 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.196+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce802cd30 con 0x7f3cdc003a00 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.196+0000 7f3cf6000640 1 -- 172.21.15.63:0/3920289299 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8009c70 con 0x7f3cdc003a00 2024-03-26T06:18:03.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.196+0000 7f3cf7e00640 1 -- 172.21.15.63:0/3920289299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 msgr2=0x7f3cdc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.196+0000 7f3cf7e00640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cdc003e20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80073e0 tx=0x7f3cdc005830 comp rx=0 tx=0).stop 2024-03-26T06:18:03.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.197+0000 7f3cf7e00640 1 -- 172.21.15.63:0/3920289299 shutdown_connections 2024-03-26T06:18:03.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.197+0000 7f3cf7e00640 1 --2- 172.21.15.63:0/3920289299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cdc003e20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.197+0000 7f3cf7e00640 1 -- 172.21.15.63:0/3920289299 >> 172.21.15.63:0/3920289299 conn(0x7f3cf80b13d0 msgr2=0x7f3cf80b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:03.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.197+0000 7f3cf7e00640 1 -- 172.21.15.63:0/3920289299 shutdown_connections 2024-03-26T06:18:03.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.197+0000 7f3cf7e00640 1 -- 172.21.15.63:0/3920289299 wait complete. 2024-03-26T06:18:03.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.198+0000 7f3cf7e00640 1 Processor -- start 2024-03-26T06:18:03.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.199+0000 7f3cf7e00640 1 -- start start 2024-03-26T06:18:03.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.199+0000 7f3cf7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cf815ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.199+0000 7f3cf7e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cf80acef0 0x7f3cf80ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.199+0000 7f3cf7e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cf80a9020 0x7f3cf80a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf7e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80ccaf0 con 0x7f3cdc003a00 2024-03-26T06:18:03.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf7e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf806eb70 con 0x7f3cf80a9020 2024-03-26T06:18:03.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf7e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80ccc70 con 0x7f3cf80acef0 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cf815ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cf815ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44708/0 (socket says 172.21.15.63:44708) 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf6a00640 1 -- 172.21.15.63:0/2773502190 learned_addr learned my addr 172.21.15.63:0/2773502190 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cee000640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cf80acef0 0x7f3cf80ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf7400640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cf80a9020 0x7f3cf80a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf6a00640 1 -- 172.21.15.63:0/2773502190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cf80acef0 msgr2=0x7f3cf80ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf6a00640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cf80acef0 0x7f3cf80ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf6a00640 1 -- 172.21.15.63:0/2773502190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cf80a9020 msgr2=0x7f3cf80a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf6a00640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cf80a9020 0x7f3cf80a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf6a00640 1 -- 172.21.15.63:0/2773502190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80a9de0 con 0x7f3cdc003a00 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.200+0000 7f3cf7400640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cf80a9020 0x7f3cf80a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.201+0000 7f3cf6a00640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cf815ae40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ce802c7a0 tx=0x7f3ce8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.201+0000 7f3cef400640 1 -- 172.21.15.63:0/2773502190 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8042020 con 0x7f3cdc003a00 2024-03-26T06:18:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.201+0000 7f3cef400640 1 -- 172.21.15.63:0/2773502190 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce803a040 con 0x7f3cdc003a00 2024-03-26T06:18:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.201+0000 7f3cef400640 1 -- 172.21.15.63:0/2773502190 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8039070 con 0x7f3cdc003a00 2024-03-26T06:18:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.201+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf80aa870 con 0x7f3cdc003a00 2024-03-26T06:18:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.201+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf80aae30 con 0x7f3cdc003a00 2024-03-26T06:18:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.202+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf804f050 con 0x7f3cdc003a00 2024-03-26T06:18:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.203+0000 7f3cef400640 1 -- 172.21.15.63:0/2773502190 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3ce8045020 con 0x7f3cdc003a00 2024-03-26T06:18:03.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.204+0000 7f3cef400640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3cd406bbd0 0x7f3cd406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.205+0000 7f3cef400640 1 -- 172.21.15.63:0/2773502190 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3ce80acd10 con 0x7f3cdc003a00 2024-03-26T06:18:03.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.205+0000 7f3cee000640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3cd406bbd0 0x7f3cd406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.205+0000 7f3cee000640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3cd406bbd0 0x7f3cd406e090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3cf81436a0 tx=0x7f3ce0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:03.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.209+0000 7f3cef400640 1 -- 172.21.15.63:0/2773502190 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f3ce80b2020 con 0x7f3cdc003a00 2024-03-26T06:18:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.410+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cf815f980 con 0x7f3cdc003a00 2024-03-26T06:18:03.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.412+0000 7f3cef400640 1 -- 172.21.15.63:0/2773502190 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7f3ce804c030 con 0x7f3cdc003a00 2024-03-26T06:18:03.414 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:03.414 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:03.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3cd406bbd0 msgr2=0x7f3cd406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3cd406bbd0 0x7f3cd406e090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3cf81436a0 tx=0x7f3ce0009040 comp rx=0 tx=0).stop 2024-03-26T06:18:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 msgr2=0x7f3cf815ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cf815ae40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ce802c7a0 tx=0x7f3ce8004ab0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 shutdown_connections 2024-03-26T06:18:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3cd406bbd0 0x7f3cd406e090 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cf80a9020 0x7f3cf80a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cf80acef0 0x7f3cf80ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 --2- 172.21.15.63:0/2773502190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc003a00 0x7f3cf815ae40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.415+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 >> 172.21.15.63:0/2773502190 conn(0x7f3cf80b13d0 msgr2=0x7f3cf815bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:03.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.416+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 shutdown_connections 2024-03-26T06:18:03.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.416+0000 7f3cf7e00640 1 -- 172.21.15.63:0/2773502190 wait complete. 2024-03-26T06:18:03.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:18:03.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:18:03.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.660+0000 7f9ffdc00640 1 Processor -- start 2024-03-26T06:18:03.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.661+0000 7f9ffdc00640 1 -- start start 2024-03-26T06:18:03.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.662+0000 7f9ffdc00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9ff815f510 0x7f9ff80cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.663+0000 7f9ffdc00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80b77f0 con 0x7f9ff815bbc0 2024-03-26T06:18:03.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.663+0000 7f9ffdc00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff815f9a0 con 0x7f9ff80cc520 2024-03-26T06:18:03.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.663+0000 7f9ffdc00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff80cf8c0 con 0x7f9ff815f510 2024-03-26T06:18:03.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.663+0000 7f9ff6a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9ff815bbc0 0x7f9ff80b70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60598/0 (socket says 172.21.15.63:60598) 2024-03-26T06:18:03.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.663+0000 7f9ff6a00640 1 -- 172.21.15.63:0/3250882009 learned_addr learned my addr 172.21.15.63:0/3250882009 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:03.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.663+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751486251 0 0) 0x7f9ff80b77f0 con 0x7f9ff815bbc0 2024-03-26T06:18:03.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.663+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fdc003520 con 0x7f9ff815bbc0 2024-03-26T06:18:03.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.663+0000 7f9fee000640 1 --2- 172.21.15.63:0/3250882009 >> v2:172.21.15.204:3300/0 conn(0x7f9ff815f510 0x7f9ff80cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2590670382 0 0) 0x7f9fdc003520 con 0x7f9ff815bbc0 2024-03-26T06:18:03.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 >> v2:172.21.15.204:3300/0 conn(0x7f9ff815f510 msgr2=0x7f9ff80cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 --2- 172.21.15.63:0/3250882009 >> v2:172.21.15.204:3300/0 conn(0x7f9ff815f510 0x7f9ff80cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 >> v1:172.21.15.204:6789/0 conn(0x7f9ff80cc520 legacy=0x7f9ff80cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff815fc80 con 0x7f9ff815bbc0 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f9fe8001670 con 0x7f9ff815bbc0 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 >> v1:172.21.15.63:6789/0 conn(0x7f9ff815bbc0 legacy=0x7f9ff80b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fdc0039b0 0x7f9fdc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9fdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fdc0051c0 0x7f9fdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80cf8c0 con 0x7f9fdc004800 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc00c0f0 con 0x7f9fdc0051c0 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc00c2f0 con 0x7f9fdc0039b0 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.664+0000 7f9fee000640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9fdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9ff7400640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fdc0051c0 0x7f9fdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9ff6a00640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fdc0039b0 0x7f9fdc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9fee000640 1 -- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fdc0039b0 msgr2=0x7f9fdc003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9fee000640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fdc0039b0 0x7f9fdc003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9fee000640 1 -- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fdc0051c0 msgr2=0x7f9fdc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9fee000640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fdc0051c0 0x7f9fdc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9fee000640 1 -- 172.21.15.63:0/3250882009 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc003520 con 0x7f9fdc004800 2024-03-26T06:18:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9ff6a00640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fdc0039b0 0x7f9fdc003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9ff7400640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fdc0051c0 0x7f9fdc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.665+0000 7f9ff7400640 1 -- 172.21.15.63:0/3250882009 reap_dead start 2024-03-26T06:18:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.666+0000 7f9fee000640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9fdc004c80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000ba00 tx=0x7f9fdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c69134d7b42a8e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.666+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0036020 con 0x7f9fdc004800 2024-03-26T06:18:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.666+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe0032620 con 0x7f9fdc004800 2024-03-26T06:18:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.666+0000 7f9ff6000640 1 -- 172.21.15.63:0/3250882009 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000b600 con 0x7f9fdc004800 2024-03-26T06:18:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.667+0000 7f9ffdc00640 1 -- 172.21.15.63:0/3250882009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 msgr2=0x7f9fdc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.667+0000 7f9ffdc00640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9fdc004c80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000ba00 tx=0x7f9fdc005830 comp rx=0 tx=0).stop 2024-03-26T06:18:03.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.667+0000 7f9ffdc00640 1 -- 172.21.15.63:0/3250882009 shutdown_connections 2024-03-26T06:18:03.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.667+0000 7f9ffdc00640 1 --2- 172.21.15.63:0/3250882009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9fdc004c80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.667+0000 7f9ffdc00640 1 -- 172.21.15.63:0/3250882009 >> 172.21.15.63:0/3250882009 conn(0x7f9ff8071000 msgr2=0x7f9ff80713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:03.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.667+0000 7f9ffdc00640 1 -- 172.21.15.63:0/3250882009 shutdown_connections 2024-03-26T06:18:03.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.667+0000 7f9ffdc00640 1 -- 172.21.15.63:0/3250882009 wait complete. 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.669+0000 7f9ffdc00640 1 Processor -- start 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.669+0000 7f9ffdc00640 1 -- start start 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ffdc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9ff81f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ffdc00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ff81f1560 0x7f9ff80b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ffdc00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ff80b5a50 0x7f9ff8148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ffdc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff8160240 con 0x7f9fdc004800 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ffdc00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80cc950 con 0x7f9ff80b5a50 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ffdc00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80cbfe0 con 0x7f9ff81f1560 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ff6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9ff81f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ff6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9ff81f1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44724/0 (socket says 172.21.15.63:44724) 2024-03-26T06:18:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ff6a00640 1 -- 172.21.15.63:0/1913943112 learned_addr learned my addr 172.21.15.63:0/1913943112 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9fee000640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ff81f1560 0x7f9ff80b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.670+0000 7f9ff7400640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ff80b5a50 0x7f9ff8148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9ff6a00640 1 -- 172.21.15.63:0/1913943112 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ff81f1560 msgr2=0x7f9ff80b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9ff6a00640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ff81f1560 0x7f9ff80b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9ff6a00640 1 -- 172.21.15.63:0/1913943112 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ff80b5a50 msgr2=0x7f9ff8148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9ff6a00640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ff80b5a50 0x7f9ff8148ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9ff6a00640 1 -- 172.21.15.63:0/1913943112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff81e5440 con 0x7f9fdc004800 2024-03-26T06:18:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9fee000640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ff81f1560 0x7f9ff80b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9ff6a00640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9ff81f1020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800d820 tx=0x7f9fe800dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:03.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9fef400640 1 -- 172.21.15.63:0/1913943112 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8019070 con 0x7f9fdc004800 2024-03-26T06:18:03.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9fef400640 1 -- 172.21.15.63:0/1913943112 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe80074e0 con 0x7f9fdc004800 2024-03-26T06:18:03.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff81e5720 con 0x7f9fdc004800 2024-03-26T06:18:03.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9fef400640 1 -- 172.21.15.63:0/1913943112 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8004a20 con 0x7f9fdc004800 2024-03-26T06:18:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.671+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff81e5ce0 con 0x7f9fdc004800 2024-03-26T06:18:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.672+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff8074730 con 0x7f9fdc004800 2024-03-26T06:18:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.673+0000 7f9fef400640 1 -- 172.21.15.63:0/1913943112 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9fe801c070 con 0x7f9fdc004800 2024-03-26T06:18:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.674+0000 7f9fef400640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9fd406bbd0 0x7f9fd406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.674+0000 7f9fef400640 1 -- 172.21.15.63:0/1913943112 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9fe808a8e0 con 0x7f9fdc004800 2024-03-26T06:18:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.675+0000 7f9fee000640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9fd406bbd0 0x7f9fd406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.676+0000 7f9fee000640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9fd406bbd0 0x7f9fd406e090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0057e0 tx=0x7f9fe0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:03.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.679+0000 7f9fef400640 1 -- 172.21.15.63:0/1913943112 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f9fe8058fc0 con 0x7f9fdc004800 2024-03-26T06:18:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.880+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ff8071f00 con 0x7f9fdc004800 2024-03-26T06:18:03.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.881+0000 7f9fef400640 1 -- 172.21.15.63:0/1913943112 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fe80588c0 con 0x7f9fdc004800 2024-03-26T06:18:03.883 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:18:03.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9fd406bbd0 msgr2=0x7f9fd406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9fd406bbd0 0x7f9fd406e090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0057e0 tx=0x7f9fe0030000 comp rx=0 tx=0).stop 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 msgr2=0x7f9ff81f1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9ff81f1020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800d820 tx=0x7f9fe800dce0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 shutdown_connections 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9fd406bbd0 0x7f9fd406e090 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ff80b5a50 0x7f9ff8148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ff81f1560 0x7f9ff80b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 --2- 172.21.15.63:0/1913943112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fdc004800 0x7f9ff81f1020 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 >> 172.21.15.63:0/1913943112 conn(0x7f9ff8071000 msgr2=0x7f9ff80713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 shutdown_connections 2024-03-26T06:18:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:03.884+0000 7f9ffdc00640 1 -- 172.21.15.63:0/1913943112 wait complete. 2024-03-26T06:18:03.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:18:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.126+0000 7f8cbe200640 1 Processor -- start 2024-03-26T06:18:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.126+0000 7f8cbe200640 1 -- start start 2024-03-26T06:18:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cbe200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cb813e650 0x7f8cb806daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cbe200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 0x7f8cb8071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cbe200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb815f410 con 0x7f8cb813eca0 2024-03-26T06:18:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cbe200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb815f6f0 con 0x7f8cb813e650 2024-03-26T06:18:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cbe200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb815f9d0 con 0x7f8cb806d270 2024-03-26T06:18:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cbce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cb813e650 0x7f8cb806daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cbce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cb813e650 0x7f8cb806daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44738/0 (socket says 172.21.15.63:44738) 2024-03-26T06:18:04.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cbce00640 1 -- 172.21.15.63:0/1264097756 learned_addr learned my addr 172.21.15.63:0/1264097756 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:04.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cbd800640 1 --1- 172.21.15.63:0/1264097756 >> v1:172.21.15.63:6789/0 conn(0x7f8cb813eca0 0x7f8cb806e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60604/0 (socket says 172.21.15.63:60604) 2024-03-26T06:18:04.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.128+0000 7f8cb7e00640 1 --2- 172.21.15.63:0/1264097756 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 0x7f8cb8071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.129+0000 7f8cbce00640 1 -- 172.21.15.63:0/1264097756 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 msgr2=0x7f8cb8071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:04.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.129+0000 7f8cbce00640 1 --2- 172.21.15.63:0/1264097756 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 0x7f8cb8071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.129+0000 7f8cbce00640 1 -- 172.21.15.63:0/1264097756 >> v1:172.21.15.63:6789/0 conn(0x7f8cb813eca0 legacy=0x7f8cb806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.129+0000 7f8cb7400640 1 -- 172.21.15.63:0/1264097756 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310088900 0 0) 0x7f8cb815f410 con 0x7f8cb813eca0 2024-03-26T06:18:04.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.129+0000 7f8cbce00640 1 -- 172.21.15.63:0/1264097756 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb815fcb0 con 0x7f8cb813e650 2024-03-26T06:18:04.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.129+0000 7f8cb7e00640 1 --2- 172.21.15.63:0/1264097756 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 0x7f8cb8071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.130+0000 7f8cbce00640 1 --2- 172.21.15.63:0/1264097756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813e650 0x7f8cb806daf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009870 tx=0x7f8cac02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c431b65ba6b2e2af server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.130+0000 7f8cb7400640 1 -- 172.21.15.63:0/1264097756 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac034070 con 0x7f8cb813e650 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.130+0000 7f8cb7400640 1 -- 172.21.15.63:0/1264097756 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac030840 con 0x7f8cb813e650 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.130+0000 7f8cb7400640 1 -- 172.21.15.63:0/1264097756 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac030c10 con 0x7f8cb813e650 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.131+0000 7f8cbe200640 1 -- 172.21.15.63:0/1264097756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813e650 msgr2=0x7f8cb806daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.131+0000 7f8cbe200640 1 --2- 172.21.15.63:0/1264097756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813e650 0x7f8cb806daf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009870 tx=0x7f8cac02b980 comp rx=0 tx=0).stop 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.131+0000 7f8cbe200640 1 -- 172.21.15.63:0/1264097756 shutdown_connections 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.131+0000 7f8cbe200640 1 --2- 172.21.15.63:0/1264097756 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 0x7f8cb8071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.131+0000 7f8cbe200640 1 --2- 172.21.15.63:0/1264097756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813e650 0x7f8cb806daf0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.131+0000 7f8cbe200640 1 -- 172.21.15.63:0/1264097756 >> 172.21.15.63:0/1264097756 conn(0x7f8cb80670b0 msgr2=0x7f8cb80b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.131+0000 7f8cbe200640 1 -- 172.21.15.63:0/1264097756 shutdown_connections 2024-03-26T06:18:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.131+0000 7f8cbe200640 1 -- 172.21.15.63:0/1264097756 wait complete. 2024-03-26T06:18:04.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.132+0000 7f8cbe200640 1 Processor -- start 2024-03-26T06:18:04.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.133+0000 7f8cbe200640 1 -- start start 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.133+0000 7f8cbe200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 0x7f8cb8159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbe200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cb813e650 0x7f8cb813b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbe200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813eca0 0x7f8cb813a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbe200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8071680 con 0x7f8cb813eca0 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbe200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb806e030 con 0x7f8cb813e650 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbe200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8071800 con 0x7f8cb806d270 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbd800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813eca0 0x7f8cb813a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbd800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813eca0 0x7f8cb813a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44750/0 (socket says 172.21.15.63:44750) 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbd800640 1 -- 172.21.15.63:0/1400900820 learned_addr learned my addr 172.21.15.63:0/1400900820 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbce00640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 0x7f8cb8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbd800640 1 -- 172.21.15.63:0/1400900820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 msgr2=0x7f8cb8159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbd800640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 0x7f8cb8159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cb7e00640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cb813e650 0x7f8cb813b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbd800640 1 -- 172.21.15.63:0/1400900820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cb813e650 msgr2=0x7f8cb813b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbd800640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cb813e650 0x7f8cb813b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cbd800640 1 -- 172.21.15.63:0/1400900820 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb813b7d0 con 0x7f8cb813eca0 2024-03-26T06:18:04.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.134+0000 7f8cb7e00640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cb813e650 0x7f8cb813b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:04.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.135+0000 7f8cbd800640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813eca0 0x7f8cb813a0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000c700 tx=0x7f8cb000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.135+0000 7f8cb4c00640 1 -- 172.21.15.63:0/1400900820 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0018070 con 0x7f8cb813eca0 2024-03-26T06:18:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.135+0000 7f8cb4c00640 1 -- 172.21.15.63:0/1400900820 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb000ce10 con 0x7f8cb813eca0 2024-03-26T06:18:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.135+0000 7f8cb4c00640 1 -- 172.21.15.63:0/1400900820 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb000a880 con 0x7f8cb813eca0 2024-03-26T06:18:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.135+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb8156470 con 0x7f8cb813eca0 2024-03-26T06:18:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.135+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb8156a30 con 0x7f8cb813eca0 2024-03-26T06:18:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.136+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb804f0c0 con 0x7f8cb813eca0 2024-03-26T06:18:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.137+0000 7f8cb4c00640 1 -- 172.21.15.63:0/1400900820 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8cb001b070 con 0x7f8cb813eca0 2024-03-26T06:18:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.138+0000 7f8cb4c00640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8c9806bbd0 0x7f8c9806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.138+0000 7f8cb4c00640 1 -- 172.21.15.63:0/1400900820 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8cb008a430 con 0x7f8cb813eca0 2024-03-26T06:18:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.138+0000 7f8cbce00640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8c9806bbd0 0x7f8c9806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.139+0000 7f8cbce00640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8c9806bbd0 0x7f8c9806e090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8cac036000 tx=0x7f8cac03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.143+0000 7f8cb4c00640 1 -- 172.21.15.63:0/1400900820 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8cb0058a80 con 0x7f8cb813eca0 2024-03-26T06:18:04.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.345+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8cb806d650 con 0x7f8cb813eca0 2024-03-26T06:18:04.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.346+0000 7f8cb4c00640 1 -- 172.21.15.63:0/1400900820 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8cb0058380 con 0x7f8cb813eca0 2024-03-26T06:18:04.347 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8c9806bbd0 msgr2=0x7f8c9806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8c9806bbd0 0x7f8c9806e090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8cac036000 tx=0x7f8cac03b040 comp rx=0 tx=0).stop 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813eca0 msgr2=0x7f8cb813a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813eca0 0x7f8cb813a0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000c700 tx=0x7f8cb000cbc0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 shutdown_connections 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8c9806bbd0 0x7f8c9806e090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cb813eca0 0x7f8cb813a0a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cb813e650 0x7f8cb813b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 --2- 172.21.15.63:0/1400900820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cb806d270 0x7f8cb8159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 >> 172.21.15.63:0/1400900820 conn(0x7f8cb80670b0 msgr2=0x7f8cb8155470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 shutdown_connections 2024-03-26T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.350+0000 7f8cbe200640 1 -- 172.21.15.63:0/1400900820 wait complete. 2024-03-26T06:18:04.371 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:18:04.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.597+0000 7f42ee200640 1 Processor -- start 2024-03-26T06:18:04.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.598+0000 7f42ee200640 1 -- start start 2024-03-26T06:18:04.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.599+0000 7f42ee200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42e80d0b30 0x7f42e8168950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.599+0000 7f42ee200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e80b7be0 con 0x7f42e815df90 2024-03-26T06:18:04.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.599+0000 7f42ee200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e80d2490 con 0x7f42e815dbb0 2024-03-26T06:18:04.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.599+0000 7f42ee200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e80d2770 con 0x7f42e80d0b30 2024-03-26T06:18:04.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.600+0000 7f42dea00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f42e815df90 0x7f42e80d0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60610/0 (socket says 172.21.15.63:60610) 2024-03-26T06:18:04.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.600+0000 7f42dea00640 1 -- 172.21.15.63:0/3855083289 learned_addr learned my addr 172.21.15.63:0/3855083289 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:04.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.600+0000 7f42e7e00640 1 --2- 172.21.15.63:0/3855083289 >> v2:172.21.15.63:3300/0 conn(0x7f42e80d0b30 0x7f42e8168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.600+0000 7f42e6a00640 1 -- 172.21.15.63:0/3855083289 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99274947 0 0) 0x7f42e80b7be0 con 0x7f42e815df90 2024-03-26T06:18:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.600+0000 7f42e6a00640 1 -- 172.21.15.63:0/3855083289 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc003520 con 0x7f42e815df90 2024-03-26T06:18:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.600+0000 7f42e7e00640 1 -- 172.21.15.63:0/3855083289 >> v1:172.21.15.204:6789/0 conn(0x7f42e815dbb0 legacy=0x7f42e80d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.600+0000 7f42e7e00640 1 -- 172.21.15.63:0/3855083289 >> v1:172.21.15.63:6789/0 conn(0x7f42e815df90 legacy=0x7f42e80d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.600+0000 7f42e7e00640 1 -- 172.21.15.63:0/3855083289 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e80d2a50 con 0x7f42e80d0b30 2024-03-26T06:18:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.601+0000 7f42e7e00640 1 --2- 172.21.15.63:0/3855083289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e80d0b30 0x7f42e8168950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009d90 tx=0x7f42e002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dcc4538c4821b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.602+0000 7f42e6a00640 1 -- 172.21.15.63:0/3855083289 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0039070 con 0x7f42e80d0b30 2024-03-26T06:18:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.602+0000 7f42e6a00640 1 -- 172.21.15.63:0/3855083289 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e002cd80 con 0x7f42e80d0b30 2024-03-26T06:18:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.602+0000 7f42e6a00640 1 -- 172.21.15.63:0/3855083289 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0034660 con 0x7f42e80d0b30 2024-03-26T06:18:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.602+0000 7f42ee200640 1 -- 172.21.15.63:0/3855083289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e80d0b30 msgr2=0x7f42e8168950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.602+0000 7f42ee200640 1 --2- 172.21.15.63:0/3855083289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e80d0b30 0x7f42e8168950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009d90 tx=0x7f42e002bfd0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.603+0000 7f42ee200640 1 -- 172.21.15.63:0/3855083289 shutdown_connections 2024-03-26T06:18:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.603+0000 7f42ee200640 1 --2- 172.21.15.63:0/3855083289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e80d0b30 0x7f42e8168950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.603+0000 7f42ee200640 1 -- 172.21.15.63:0/3855083289 >> 172.21.15.63:0/3855083289 conn(0x7f42e80b5540 msgr2=0x7f42e80b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.603+0000 7f42ee200640 1 -- 172.21.15.63:0/3855083289 shutdown_connections 2024-03-26T06:18:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.603+0000 7f42ee200640 1 -- 172.21.15.63:0/3855083289 wait complete. 2024-03-26T06:18:04.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.605+0000 7f42ee200640 1 Processor -- start 2024-03-26T06:18:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.605+0000 7f42ee200640 1 -- start start 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42ee200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42e80d0b30 0x7f42e81f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42ee200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42e815dbb0 0x7f42e80ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42ee200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e815df90 0x7f42e80abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42ee200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e80d36b0 con 0x7f42e815df90 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42ee200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e80d3530 con 0x7f42e80d0b30 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42ee200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e80b96e0 con 0x7f42e815dbb0 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42e7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e815df90 0x7f42e80abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42e7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e815df90 0x7f42e80abfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44768/0 (socket says 172.21.15.63:44768) 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42e7e00640 1 -- 172.21.15.63:0/1301953896 learned_addr learned my addr 172.21.15.63:0/1301953896 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42dea00640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42e815dbb0 0x7f42e80ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42e7400640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42e80d0b30 0x7f42e81f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42e7e00640 1 -- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42e815dbb0 msgr2=0x7f42e80ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42e7e00640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42e815dbb0 0x7f42e80ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.606+0000 7f42e7e00640 1 -- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42e80d0b30 msgr2=0x7f42e81f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.607+0000 7f42e7e00640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42e80d0b30 0x7f42e81f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.607+0000 7f42e7e00640 1 -- 172.21.15.63:0/1301953896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e81f7e40 con 0x7f42e815df90 2024-03-26T06:18:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.607+0000 7f42dea00640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42e815dbb0 0x7f42e80ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.607+0000 7f42e7400640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42e80d0b30 0x7f42e81f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.607+0000 7f42e7e00640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e815df90 0x7f42e80abfb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009d90 tx=0x7f42e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.607+0000 7f42dfe00640 1 -- 172.21.15.63:0/1301953896 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0039050 con 0x7f42e815df90 2024-03-26T06:18:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.607+0000 7f42dfe00640 1 -- 172.21.15.63:0/1301953896 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e0045070 con 0x7f42e815df90 2024-03-26T06:18:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.607+0000 7f42dfe00640 1 -- 172.21.15.63:0/1301953896 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0009450 con 0x7f42e815df90 2024-03-26T06:18:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.607+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e81f75a0 con 0x7f42e815df90 2024-03-26T06:18:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.608+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e81f7b60 con 0x7f42e815df90 2024-03-26T06:18:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.609+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e8074730 con 0x7f42e815df90 2024-03-26T06:18:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.610+0000 7f42dfe00640 1 -- 172.21.15.63:0/1301953896 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f42e003e850 con 0x7f42e815df90 2024-03-26T06:18:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.611+0000 7f42dfe00640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f42c406bc00 0x7f42c406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.611+0000 7f42dfe00640 1 -- 172.21.15.63:0/1301953896 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f42e00ad490 con 0x7f42e815df90 2024-03-26T06:18:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.611+0000 7f42e7400640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f42c406bc00 0x7f42c406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.612+0000 7f42e7400640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f42c406bc00 0x7f42c406e0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f42e815b7a0 tx=0x7f42d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.615+0000 7f42dfe00640 1 -- 172.21.15.63:0/1301953896 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f42e004e020 con 0x7f42e815df90 2024-03-26T06:18:04.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.818+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42e80ab5f0 con 0x7f42e815df90 2024-03-26T06:18:04.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.818+0000 7f42dfe00640 1 -- 172.21.15.63:0/1301953896 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42e007bb70 con 0x7f42e815df90 2024-03-26T06:18:04.820 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.821+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f42c406bc00 msgr2=0x7f42c406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.821+0000 7f42ee200640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f42c406bc00 0x7f42c406e0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f42e815b7a0 tx=0x7f42d8009040 comp rx=0 tx=0).stop 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.821+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e815df90 msgr2=0x7f42e80abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.821+0000 7f42ee200640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e815df90 0x7f42e80abfb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009d90 tx=0x7f42e0004a40 comp rx=0 tx=0).stop 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.822+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 shutdown_connections 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.822+0000 7f42ee200640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f42c406bc00 0x7f42c406e0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.822+0000 7f42ee200640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e815df90 0x7f42e80abfb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.822+0000 7f42ee200640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42e815dbb0 0x7f42e80ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.822+0000 7f42ee200640 1 --2- 172.21.15.63:0/1301953896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42e80d0b30 0x7f42e81f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.822+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 >> 172.21.15.63:0/1301953896 conn(0x7f42e80b5540 msgr2=0x7f42e806c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:04.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.822+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 shutdown_connections 2024-03-26T06:18:04.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:04.822+0000 7f42ee200640 1 -- 172.21.15.63:0/1301953896 wait complete. 2024-03-26T06:18:04.843 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:18:05.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.062+0000 7f0032600640 1 Processor -- start 2024-03-26T06:18:05.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.062+0000 7f0032600640 1 -- start start 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.065+0000 7f0032600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f002c157f90 0x7f002c0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.065+0000 7f0032600640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f002c0ae570 0x7f002c0ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.065+0000 7f0032600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0b32e0 0x7f002c0b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.065+0000 7f0032600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c0b3cb0 con 0x7f002c157f90 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.065+0000 7f0032600640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c15efb0 con 0x7f002c0ae570 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.065+0000 7f0032600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c15e3a0 con 0x7f002c0b32e0 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.066+0000 7f002b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f002c157f90 0x7f002c0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.066+0000 7f002b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f002c157f90 0x7f002c0acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44776/0 (socket says 172.21.15.63:44776) 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.066+0000 7f002b400640 1 -- 172.21.15.63:0/3983904557 learned_addr learned my addr 172.21.15.63:0/3983904557 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.066+0000 7f0022a00640 1 --2- 172.21.15.63:0/3983904557 >> v2:172.21.15.204:3300/0 conn(0x7f002c0ae570 0x7f002c0ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.066+0000 7f002be00640 1 --2- 172.21.15.63:0/3983904557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0b32e0 0x7f002c0b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.066+0000 7f002b400640 1 -- 172.21.15.63:0/3983904557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0b32e0 msgr2=0x7f002c0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:05.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.066+0000 7f002b400640 1 --2- 172.21.15.63:0/3983904557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0b32e0 0x7f002c0b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.067+0000 7f002b400640 1 -- 172.21.15.63:0/3983904557 >> v2:172.21.15.204:3300/0 conn(0x7f002c0ae570 msgr2=0x7f002c0ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:05.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.067+0000 7f002b400640 1 --2- 172.21.15.63:0/3983904557 >> v2:172.21.15.204:3300/0 conn(0x7f002c0ae570 0x7f002c0ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.067+0000 7f002b400640 1 -- 172.21.15.63:0/3983904557 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c15e680 con 0x7f002c157f90 2024-03-26T06:18:05.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.067+0000 7f0022a00640 1 --2- 172.21.15.63:0/3983904557 >> v2:172.21.15.204:3300/0 conn(0x7f002c0ae570 0x7f002c0ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:18:05.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.068+0000 7f002b400640 1 --2- 172.21.15.63:0/3983904557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c157f90 0x7f002c0acc70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f002c06f800 tx=0x7f001c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc07ba55ce98acec server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:05.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.069+0000 7f002aa00640 1 -- 172.21.15.63:0/3983904557 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c035020 con 0x7f002c157f90 2024-03-26T06:18:05.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.069+0000 7f002aa00640 1 -- 172.21.15.63:0/3983904557 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c031870 con 0x7f002c157f90 2024-03-26T06:18:05.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.069+0000 7f002aa00640 1 -- 172.21.15.63:0/3983904557 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c031c40 con 0x7f002c157f90 2024-03-26T06:18:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.070+0000 7f0032600640 1 -- 172.21.15.63:0/3983904557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c157f90 msgr2=0x7f002c0acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.070+0000 7f0032600640 1 --2- 172.21.15.63:0/3983904557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c157f90 0x7f002c0acc70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f002c06f800 tx=0x7f001c02b910 comp rx=0 tx=0).stop 2024-03-26T06:18:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.070+0000 7f0032600640 1 -- 172.21.15.63:0/3983904557 shutdown_connections 2024-03-26T06:18:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.070+0000 7f0032600640 1 --2- 172.21.15.63:0/3983904557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0b32e0 0x7f002c0b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.070+0000 7f0032600640 1 --2- 172.21.15.63:0/3983904557 >> v2:172.21.15.204:3300/0 conn(0x7f002c0ae570 0x7f002c0ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.070+0000 7f0032600640 1 --2- 172.21.15.63:0/3983904557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c157f90 0x7f002c0acc70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.070+0000 7f0032600640 1 -- 172.21.15.63:0/3983904557 >> 172.21.15.63:0/3983904557 conn(0x7f002c06ac90 msgr2=0x7f002c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.070+0000 7f0032600640 1 -- 172.21.15.63:0/3983904557 shutdown_connections 2024-03-26T06:18:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.070+0000 7f0032600640 1 -- 172.21.15.63:0/3983904557 wait complete. 2024-03-26T06:18:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.072+0000 7f0032600640 1 Processor -- start 2024-03-26T06:18:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.072+0000 7f0032600640 1 -- start start 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.073+0000 7f0032600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0ae570 0x7f002c158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.073+0000 7f0032600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c0b32e0 0x7f002c142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.073+0000 7f0032600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f002c157f90 0x7f002c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.073+0000 7f0032600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0ad1b0 con 0x7f002c0b32e0 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.073+0000 7f0032600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c15ec40 con 0x7f002c157f90 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.073+0000 7f0032600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c15e050 con 0x7f002c0ae570 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.073+0000 7f0022a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c0b32e0 0x7f002c142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.073+0000 7f0022a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c0b32e0 0x7f002c142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44790/0 (socket says 172.21.15.63:44790) 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.073+0000 7f0022a00640 1 -- 172.21.15.63:0/208324944 learned_addr learned my addr 172.21.15.63:0/208324944 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f002b400640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0ae570 0x7f002c158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f002be00640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f002c157f90 0x7f002c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0022a00640 1 -- 172.21.15.63:0/208324944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0ae570 msgr2=0x7f002c158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0022a00640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0ae570 0x7f002c158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0022a00640 1 -- 172.21.15.63:0/208324944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f002c157f90 msgr2=0x7f002c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0022a00640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f002c157f90 0x7f002c15d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0022a00640 1 -- 172.21.15.63:0/208324944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c158a70 con 0x7f002c0b32e0 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f002be00640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f002c157f90 0x7f002c15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0022a00640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c0b32e0 0x7f002c142810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f001400d7d0 tx=0x7f001400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0023e00640 1 -- 172.21.15.63:0/208324944 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014004030 con 0x7f002c0b32e0 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0023e00640 1 -- 172.21.15.63:0/208324944 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00140041d0 con 0x7f002c0b32e0 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0023e00640 1 -- 172.21.15.63:0/208324944 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400b6c0 con 0x7f002c0b32e0 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.074+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c158d50 con 0x7f002c0b32e0 2024-03-26T06:18:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.075+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c159310 con 0x7f002c0b32e0 2024-03-26T06:18:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.076+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002c074730 con 0x7f002c0b32e0 2024-03-26T06:18:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.077+0000 7f0023e00640 1 -- 172.21.15.63:0/208324944 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f001400b860 con 0x7f002c0b32e0 2024-03-26T06:18:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.077+0000 7f0023e00640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f000806bbd0 0x7f000806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.078+0000 7f0023e00640 1 -- 172.21.15.63:0/208324944 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f001408b2b0 con 0x7f002c0b32e0 2024-03-26T06:18:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.078+0000 7f002b400640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f000806bbd0 0x7f000806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.079+0000 7f002b400640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f000806bbd0 0x7f000806e090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f001c036000 tx=0x7f001c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.082+0000 7f0023e00640 1 -- 172.21.15.63:0/208324944 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f0014059870 con 0x7f002c0b32e0 2024-03-26T06:18:05.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.286+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f002c1624e0 con 0x7f002c0b32e0 2024-03-26T06:18:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.287+0000 7f0023e00640 1 -- 172.21.15.63:0/208324944 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0014059170 con 0x7f002c0b32e0 2024-03-26T06:18:05.288 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.289+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f000806bbd0 msgr2=0x7f000806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.289+0000 7f0032600640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f000806bbd0 0x7f000806e090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f001c036000 tx=0x7f001c03c040 comp rx=0 tx=0).stop 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.289+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c0b32e0 msgr2=0x7f002c142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.289+0000 7f0032600640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c0b32e0 0x7f002c142810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f001400d7d0 tx=0x7f001400dc90 comp rx=0 tx=0).stop 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.290+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 shutdown_connections 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.290+0000 7f0032600640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f000806bbd0 0x7f000806e090 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.290+0000 7f0032600640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f002c157f90 0x7f002c15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.290+0000 7f0032600640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f002c0b32e0 0x7f002c142810 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.290+0000 7f0032600640 1 --2- 172.21.15.63:0/208324944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f002c0ae570 0x7f002c158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.290+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 >> 172.21.15.63:0/208324944 conn(0x7f002c06ac90 msgr2=0x7f002c06f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.290+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 shutdown_connections 2024-03-26T06:18:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.290+0000 7f0032600640 1 -- 172.21.15.63:0/208324944 wait complete. 2024-03-26T06:18:05.314 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-26T06:18:05.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.534+0000 7fadfda00640 1 Processor -- start 2024-03-26T06:18:05.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.535+0000 7fadfda00640 1 -- start start 2024-03-26T06:18:05.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.536+0000 7fadfda00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadf80b9320 0x7fadf81685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.536+0000 7fadfda00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf80d22d0 con 0x7fadf815dca0 2024-03-26T06:18:05.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.536+0000 7fadfda00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf80d25b0 con 0x7fadf80d3840 2024-03-26T06:18:05.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.536+0000 7fadfda00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf80d2070 con 0x7fadf80b9320 2024-03-26T06:18:05.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.537+0000 7fadf7400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fadf815dca0 0x7fadf80d1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60612/0 (socket says 172.21.15.63:60612) 2024-03-26T06:18:05.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.537+0000 7fadf7400640 1 -- 172.21.15.63:0/3546146861 learned_addr learned my addr 172.21.15.63:0/3546146861 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:05.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.537+0000 7fadfd000640 1 --2- 172.21.15.63:0/3546146861 >> v2:172.21.15.63:3300/0 conn(0x7fadf80b9320 0x7fadf81685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.537+0000 7fadfd000640 1 -- 172.21.15.63:0/3546146861 >> v1:172.21.15.204:6789/0 conn(0x7fadf80d3840 legacy=0x7fadf80d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:05.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.537+0000 7fadfd000640 1 -- 172.21.15.63:0/3546146861 >> v1:172.21.15.63:6789/0 conn(0x7fadf815dca0 legacy=0x7fadf80d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.537+0000 7fadf6a00640 1 -- 172.21.15.63:0/3546146861 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620554546 0 0) 0x7fadf80d22d0 con 0x7fadf815dca0 2024-03-26T06:18:05.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.537+0000 7fadfd000640 1 -- 172.21.15.63:0/3546146861 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80d2890 con 0x7fadf80b9320 2024-03-26T06:18:05.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.538+0000 7fadfd000640 1 --2- 172.21.15.63:0/3546146861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf80b9320 0x7fadf81685c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009d90 tx=0x7fadf002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1322735b28fd3e95 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:05.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.539+0000 7fadf6a00640 1 -- 172.21.15.63:0/3546146861 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0039070 con 0x7fadf80b9320 2024-03-26T06:18:05.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.539+0000 7fadf6a00640 1 -- 172.21.15.63:0/3546146861 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf002cc60 con 0x7fadf80b9320 2024-03-26T06:18:05.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.539+0000 7fadf6a00640 1 -- 172.21.15.63:0/3546146861 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0034660 con 0x7fadf80b9320 2024-03-26T06:18:05.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.539+0000 7fadfda00640 1 -- 172.21.15.63:0/3546146861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf80b9320 msgr2=0x7fadf81685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.539+0000 7fadfda00640 1 --2- 172.21.15.63:0/3546146861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf80b9320 0x7fadf81685c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009d90 tx=0x7fadf002beb0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.539+0000 7fadfda00640 1 -- 172.21.15.63:0/3546146861 shutdown_connections 2024-03-26T06:18:05.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.540+0000 7fadfda00640 1 --2- 172.21.15.63:0/3546146861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf80b9320 0x7fadf81685c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.540+0000 7fadfda00640 1 -- 172.21.15.63:0/3546146861 >> 172.21.15.63:0/3546146861 conn(0x7fadf806c570 msgr2=0x7fadf806c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:05.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.540+0000 7fadfda00640 1 -- 172.21.15.63:0/3546146861 shutdown_connections 2024-03-26T06:18:05.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.540+0000 7fadfda00640 1 -- 172.21.15.63:0/3546146861 wait complete. 2024-03-26T06:18:05.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.541+0000 7fadfda00640 1 Processor -- start 2024-03-26T06:18:05.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.541+0000 7fadfda00640 1 -- start start 2024-03-26T06:18:05.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.542+0000 7fadfda00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadf80b9320 0x7fadf814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.542+0000 7fadfda00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadf80d3840 0x7fadf81571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.542+0000 7fadfda00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf815dca0 0x7fadf8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.542+0000 7fadfda00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80d3370 con 0x7fadf815dca0 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.542+0000 7fadfda00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80d2e50 con 0x7fadf80b9320 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.542+0000 7fadfda00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80d34f0 con 0x7fadf80d3840 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadfd000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf815dca0 0x7fadf8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadfd000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf815dca0 0x7fadf8157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44818/0 (socket says 172.21.15.63:44818) 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadfd000640 1 -- 172.21.15.63:0/3331636818 learned_addr learned my addr 172.21.15.63:0/3331636818 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadf7e00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadf80b9320 0x7fadf814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadf7400640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadf80d3840 0x7fadf81571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadfd000640 1 -- 172.21.15.63:0/3331636818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadf80d3840 msgr2=0x7fadf81571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadfd000640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadf80d3840 0x7fadf81571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadfd000640 1 -- 172.21.15.63:0/3331636818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadf80b9320 msgr2=0x7fadf814ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadfd000640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadf80b9320 0x7fadf814ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadfd000640 1 -- 172.21.15.63:0/3331636818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80c8130 con 0x7fadf815dca0 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadf7e00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadf80b9320 0x7fadf814ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.543+0000 7fadfd000640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf815dca0 0x7fadf8157720 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fadf0037040 tx=0x7fadf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.544+0000 7fadefe00640 1 -- 172.21.15.63:0/3331636818 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0044030 con 0x7fadf815dca0 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.544+0000 7fadefe00640 1 -- 172.21.15.63:0/3331636818 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf002ca60 con 0x7fadf815dca0 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.544+0000 7fadefe00640 1 -- 172.21.15.63:0/3331636818 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0039040 con 0x7fadf815dca0 2024-03-26T06:18:05.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.544+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf80c8410 con 0x7fadf815dca0 2024-03-26T06:18:05.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.544+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf80c89d0 con 0x7fadf815dca0 2024-03-26T06:18:05.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.545+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf804f0c0 con 0x7fadf815dca0 2024-03-26T06:18:05.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.546+0000 7fadefe00640 1 -- 172.21.15.63:0/3331636818 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fadf0047070 con 0x7fadf815dca0 2024-03-26T06:18:05.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.547+0000 7fadefe00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fadd406bbd0 0x7fadd406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:05.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.547+0000 7fadefe00640 1 -- 172.21.15.63:0/3331636818 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fadf00ad700 con 0x7fadf815dca0 2024-03-26T06:18:05.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.547+0000 7fadf7e00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fadd406bbd0 0x7fadd406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:05.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.548+0000 7fadf7e00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fadd406bbd0 0x7fadd406e090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fade8003eb0 tx=0x7fade8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:05.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.551+0000 7fadefe00640 1 -- 172.21.15.63:0/3331636818 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fadf004e070 con 0x7fadf815dca0 2024-03-26T06:18:05.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.770+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fadf80b78e0 con 0x7fadf815dca0 2024-03-26T06:18:05.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.771+0000 7fadefe00640 1 -- 172.21.15.63:0/3331636818 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fadf007bdf0 con 0x7fadf815dca0 2024-03-26T06:18:05.772 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-03-26T06:18:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fadd406bbd0 msgr2=0x7fadd406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fadd406bbd0 0x7fadd406e090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fade8003eb0 tx=0x7fade8009040 comp rx=0 tx=0).stop 2024-03-26T06:18:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf815dca0 msgr2=0x7fadf8157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf815dca0 0x7fadf8157720 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fadf0037040 tx=0x7fadf0004a40 comp rx=0 tx=0).stop 2024-03-26T06:18:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 shutdown_connections 2024-03-26T06:18:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fadd406bbd0 0x7fadd406e090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf815dca0 0x7fadf8157720 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadf80d3840 0x7fadf81571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 --2- 172.21.15.63:0/3331636818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadf80b9320 0x7fadf814ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 >> 172.21.15.63:0/3331636818 conn(0x7fadf806c570 msgr2=0x7fadf80ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 shutdown_connections 2024-03-26T06:18:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:05.774+0000 7fadfda00640 1 -- 172.21.15.63:0/3331636818 wait complete. 2024-03-26T06:18:05.793 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-26T06:18:05.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:05.794 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-26T06:18:05.895 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T06:18:05.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:05.896 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-26T06:18:05.948 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:18:05.948 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:06.003 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:18:06.004 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:06.053 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:18:06.053 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:06.151 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:06.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.378+0000 7fe62f000640 1 Processor -- start 2024-03-26T06:18:06.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.379+0000 7fe62f000640 1 -- start start 2024-03-26T06:18:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.380+0000 7fe62f000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280d1c10 0x7fe6280ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.380+0000 7fe62f000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6280d21b0 con 0x7fe6280d3250 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.380+0000 7fe62f000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6280d2490 con 0x7fe62815d9a0 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.380+0000 7fe62f000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280d2770 con 0x7fe6280d1c10 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.380+0000 7fe62e600640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe6280d3250 0x7fe6280b6970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60622/0 (socket says 172.21.15.63:60622) 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.380+0000 7fe62e600640 1 -- 172.21.15.63:0/1906663166 learned_addr learned my addr 172.21.15.63:0/1906663166 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.381+0000 7fe62d200640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280d1c10 0x7fe6280ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.381+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250353245 0 0) 0x7fe6280d21b0 con 0x7fe6280d3250 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.381+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe610003520 con 0x7fe6280d3250 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.381+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1995659473 0 0) 0x7fe610003520 con 0x7fe6280d3250 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.381+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280d1c10 msgr2=0x7fe6280ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.381+0000 7fe627e00640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280d1c10 0x7fe6280ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.381+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 >> v1:172.21.15.204:6789/0 conn(0x7fe62815d9a0 legacy=0x7fe6280b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.381+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280d2a50 con 0x7fe6280d3250 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fe6200019f0 con 0x7fe6280d3250 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 >> v1:172.21.15.63:6789/0 conn(0x7fe6280d3250 legacy=0x7fe6280b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe627e00640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6100039e0 0x7fe610003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe627e00640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280d1c10 0x7fe610004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe627e00640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe610004d40 0x7fe6100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280d2770 con 0x7fe610004d40 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61000bb20 con 0x7fe6100039e0 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61000bd20 con 0x7fe6280d1c10 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe62e600640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe610004d40 0x7fe6100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe62d200640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280d1c10 0x7fe610004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe62e600640 1 -- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280d1c10 msgr2=0x7fe610004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe62e600640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280d1c10 0x7fe610004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe62e600640 1 -- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6100039e0 msgr2=0x7fe610003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.382+0000 7fe62dc00640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6100039e0 0x7fe610003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.383+0000 7fe62e600640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6100039e0 0x7fe610003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.383+0000 7fe62e600640 1 -- 172.21.15.63:0/1906663166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe610003520 con 0x7fe610004d40 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.384+0000 7fe62e600640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe610004d40 0x7fe6100051c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe62000a860 tx=0x7fe610005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb2d2010b29963b server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.384+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62000a480 con 0x7fe610004d40 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.384+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe620034630 con 0x7fe610004d40 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.384+0000 7fe627e00640 1 -- 172.21.15.63:0/1906663166 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620034a40 con 0x7fe610004d40 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.385+0000 7fe62f000640 1 -- 172.21.15.63:0/1906663166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe610004d40 msgr2=0x7fe6100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.385+0000 7fe62f000640 1 --2- 172.21.15.63:0/1906663166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe610004d40 0x7fe6100051c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe62000a860 tx=0x7fe610005830 comp rx=0 tx=0).stop 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.385+0000 7fe62e600640 1 -- 172.21.15.63:0/1906663166 reap_dead start 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.385+0000 7fe62f000640 1 -- 172.21.15.63:0/1906663166 shutdown_connections 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.385+0000 7fe62f000640 1 -- 172.21.15.63:0/1906663166 >> 172.21.15.63:0/1906663166 conn(0x7fe62806bfa0 msgr2=0x7fe62806c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.385+0000 7fe62f000640 1 -- 172.21.15.63:0/1906663166 shutdown_connections 2024-03-26T06:18:06.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.385+0000 7fe62f000640 1 -- 172.21.15.63:0/1906663166 wait complete. 2024-03-26T06:18:06.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.387+0000 7fe62f000640 1 Processor -- start 2024-03-26T06:18:06.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.387+0000 7fe62f000640 1 -- start start 2024-03-26T06:18:06.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62f000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6281f0a20 0x7fe6281f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62f000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280b5d60 0x7fe6280c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62f000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6280c8a30 0x7fe62815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62f000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280b7080 con 0x7fe6281f0a20 2024-03-26T06:18:06.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62f000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62815dd80 con 0x7fe6280c8a30 2024-03-26T06:18:06.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62f000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280b7200 con 0x7fe6280b5d60 2024-03-26T06:18:06.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62dc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6281f0a20 0x7fe6281f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62dc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6281f0a20 0x7fe6281f3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44838/0 (socket says 172.21.15.63:44838) 2024-03-26T06:18:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62dc00640 1 -- 172.21.15.63:0/3331119900 learned_addr learned my addr 172.21.15.63:0/3331119900 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62dc00640 1 -- 172.21.15.63:0/3331119900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280b5d60 msgr2=0x7fe6280c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62dc00640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280b5d60 0x7fe6280c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62dc00640 1 -- 172.21.15.63:0/3331119900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6280c8a30 msgr2=0x7fe62815ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62dc00640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6280c8a30 0x7fe62815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.388+0000 7fe62dc00640 1 -- 172.21.15.63:0/3331119900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280b61e0 con 0x7fe6281f0a20 2024-03-26T06:18:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.389+0000 7fe62dc00640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6281f0a20 0x7fe6281f3530 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00d570 tx=0x7fe61c00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.389+0000 7fe625600640 1 -- 172.21.15.63:0/3331119900 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c005480 con 0x7fe6281f0a20 2024-03-26T06:18:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.389+0000 7fe625600640 1 -- 172.21.15.63:0/3331119900 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c017070 con 0x7fe6281f0a20 2024-03-26T06:18:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.389+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6281f3c20 con 0x7fe6281f0a20 2024-03-26T06:18:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.389+0000 7fe625600640 1 -- 172.21.15.63:0/3331119900 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c003810 con 0x7fe6281f0a20 2024-03-26T06:18:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.389+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6281f41e0 con 0x7fe6281f0a20 2024-03-26T06:18:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.391+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62804f050 con 0x7fe6281f0a20 2024-03-26T06:18:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.392+0000 7fe625600640 1 -- 172.21.15.63:0/3331119900 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe61c0039b0 con 0x7fe6281f0a20 2024-03-26T06:18:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.392+0000 7fe625600640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe60c06bbd0 0x7fe60c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.393+0000 7fe625600640 1 -- 172.21.15.63:0/3331119900 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe61c08aca0 con 0x7fe6281f0a20 2024-03-26T06:18:06.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.393+0000 7fe62d200640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe60c06bbd0 0x7fe60c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.394+0000 7fe62d200640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe60c06bbd0 0x7fe60c06e090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe6280b3230 tx=0x7fe618008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:06.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.397+0000 7fe625600640 1 -- 172.21.15.63:0/3331119900 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe61c059390 con 0x7fe6281f0a20 2024-03-26T06:18:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.608+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6280ce1d0 con 0x7fe6281f0a20 2024-03-26T06:18:06.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.611+0000 7fe625600640 1 -- 172.21.15.63:0/3331119900 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7fe61c058c90 con 0x7fe6281f0a20 2024-03-26T06:18:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:06.613 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe60c06bbd0 msgr2=0x7fe60c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe60c06bbd0 0x7fe60c06e090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe6280b3230 tx=0x7fe618008040 comp rx=0 tx=0).stop 2024-03-26T06:18:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6281f0a20 msgr2=0x7fe6281f3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6281f0a20 0x7fe6281f3530 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00d570 tx=0x7fe61c00da30 comp rx=0 tx=0).stop 2024-03-26T06:18:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 shutdown_connections 2024-03-26T06:18:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe60c06bbd0 0x7fe60c06e090 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6280c8a30 0x7fe62815ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6280b5d60 0x7fe6280c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 --2- 172.21.15.63:0/3331119900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6281f0a20 0x7fe6281f3530 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 >> 172.21.15.63:0/3331119900 conn(0x7fe62806bfa0 msgr2=0x7fe6280d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 shutdown_connections 2024-03-26T06:18:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.614+0000 7fe62f000640 1 -- 172.21.15.63:0/3331119900 wait complete. 2024-03-26T06:18:06.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:18:06.634 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:18:06.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.842+0000 7f09fca00640 1 Processor -- start 2024-03-26T06:18:06.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.843+0000 7f09fca00640 1 -- start start 2024-03-26T06:18:06.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.844+0000 7f09fca00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09f8071850 0x7f09f806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.844+0000 7f09fca00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 0x7f09f815e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.844+0000 7f09fca00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f815e8b0 con 0x7f09f8143eb0 2024-03-26T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.844+0000 7f09fca00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f8144290 con 0x7f09f8071850 2024-03-26T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.844+0000 7f09fca00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f815ee60 con 0x7f09f815dec0 2024-03-26T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.844+0000 7f09efe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09f8071850 0x7f09f806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.844+0000 7f09efe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09f8071850 0x7f09f806dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44844/0 (socket says 172.21.15.63:44844) 2024-03-26T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.844+0000 7f09efe00640 1 -- 172.21.15.63:0/1297380644 learned_addr learned my addr 172.21.15.63:0/1297380644 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:06.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.845+0000 7f09f7200640 1 --2- 172.21.15.63:0/1297380644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 0x7f09f815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.845+0000 7f09efe00640 1 -- 172.21.15.63:0/1297380644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 msgr2=0x7f09f815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:06.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.845+0000 7f09efe00640 1 --2- 172.21.15.63:0/1297380644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 0x7f09f815e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.845+0000 7f09efe00640 1 -- 172.21.15.63:0/1297380644 >> v1:172.21.15.204:6789/0 conn(0x7f09f8143eb0 legacy=0x7f09f8071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.845+0000 7f09efe00640 1 -- 172.21.15.63:0/1297380644 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f815eb80 con 0x7f09f8071850 2024-03-26T06:18:06.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.846+0000 7f09efe00640 1 --2- 172.21.15.63:0/1297380644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 0x7f09f806dd80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009870 tx=0x7f09e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee6127c29f8756e server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:06.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.846+0000 7f09f5e00640 1 -- 172.21.15.63:0/1297380644 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0035020 con 0x7f09f8071850 2024-03-26T06:18:06.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.846+0000 7f09f5e00640 1 -- 172.21.15.63:0/1297380644 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e0031640 con 0x7f09f8071850 2024-03-26T06:18:06.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.846+0000 7f09f5e00640 1 -- 172.21.15.63:0/1297380644 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e002d040 con 0x7f09f8071850 2024-03-26T06:18:06.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.847+0000 7f09fca00640 1 -- 172.21.15.63:0/1297380644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 msgr2=0x7f09f806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.847+0000 7f09fca00640 1 --2- 172.21.15.63:0/1297380644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 0x7f09f806dd80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009870 tx=0x7f09e002b8f0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.847+0000 7f09fca00640 1 -- 172.21.15.63:0/1297380644 shutdown_connections 2024-03-26T06:18:06.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.847+0000 7f09fca00640 1 --2- 172.21.15.63:0/1297380644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 0x7f09f815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.847+0000 7f09fca00640 1 --2- 172.21.15.63:0/1297380644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 0x7f09f806dd80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.847+0000 7f09fca00640 1 -- 172.21.15.63:0/1297380644 >> 172.21.15.63:0/1297380644 conn(0x7f09f80670b0 msgr2=0x7f09f80b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:06.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.847+0000 7f09fca00640 1 -- 172.21.15.63:0/1297380644 shutdown_connections 2024-03-26T06:18:06.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.847+0000 7f09fca00640 1 -- 172.21.15.63:0/1297380644 wait complete. 2024-03-26T06:18:06.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.849+0000 7f09fca00640 1 Processor -- start 2024-03-26T06:18:06.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.849+0000 7f09fca00640 1 -- start start 2024-03-26T06:18:06.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.850+0000 7f09fca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 0x7f09f815b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.850+0000 7f09fca00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09f8143eb0 0x7f09f80aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.850+0000 7f09fca00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 0x7f09f80b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.850+0000 7f09fca00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f806d860 con 0x7f09f8071850 2024-03-26T06:18:06.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.850+0000 7f09fca00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f806d580 con 0x7f09f8143eb0 2024-03-26T06:18:06.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.850+0000 7f09fca00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80adbc0 con 0x7f09f815dec0 2024-03-26T06:18:06.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.850+0000 7f09f6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 0x7f09f815b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.850+0000 7f09f6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 0x7f09f815b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44854/0 (socket says 172.21.15.63:44854) 2024-03-26T06:18:06.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.850+0000 7f09f6800640 1 -- 172.21.15.63:0/4264017279 learned_addr learned my addr 172.21.15.63:0/4264017279 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:06.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09efe00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09f8143eb0 0x7f09f80aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09f7200640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 0x7f09f80b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09f6800640 1 -- 172.21.15.63:0/4264017279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 msgr2=0x7f09f80b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09f6800640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 0x7f09f80b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09f6800640 1 -- 172.21.15.63:0/4264017279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09f8143eb0 msgr2=0x7f09f80aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:06.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09f6800640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09f8143eb0 0x7f09f80aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:06.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09f6800640 1 -- 172.21.15.63:0/4264017279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f815b820 con 0x7f09f8071850 2024-03-26T06:18:06.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09efe00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09f8143eb0 0x7f09f80aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:06.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09f6800640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 0x7f09f815b2e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c400 tx=0x7f09e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:06.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09eea00640 1 -- 172.21.15.63:0/4264017279 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80052d0 con 0x7f09f8071850 2024-03-26T06:18:06.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09eea00640 1 -- 172.21.15.63:0/4264017279 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8005490 con 0x7f09f8071850 2024-03-26T06:18:06.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09eea00640 1 -- 172.21.15.63:0/4264017279 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8007260 con 0x7f09f8071850 2024-03-26T06:18:06.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.851+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f81e6e10 con 0x7f09f8071850 2024-03-26T06:18:06.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.852+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f81e73d0 con 0x7f09f8071850 2024-03-26T06:18:06.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.853+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f804f0c0 con 0x7f09f8071850 2024-03-26T06:18:06.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.854+0000 7f09eea00640 1 -- 172.21.15.63:0/4264017279 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f09e8007400 con 0x7f09f8071850 2024-03-26T06:18:06.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.855+0000 7f09eea00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f09d406bbd0 0x7f09d406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:06.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.855+0000 7f09eea00640 1 -- 172.21.15.63:0/4264017279 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f09e808a3e0 con 0x7f09f8071850 2024-03-26T06:18:06.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.855+0000 7f09efe00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f09d406bbd0 0x7f09d406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:06.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.856+0000 7f09efe00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f09d406bbd0 0x7f09d406e090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f09e0036000 tx=0x7f09e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:06.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:06.860+0000 7f09eea00640 1 -- 172.21.15.63:0/4264017279 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f09e8058ad0 con 0x7f09f8071850 2024-03-26T06:18:07.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.066+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09f8071390 con 0x7f09f8071850 2024-03-26T06:18:07.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.067+0000 7f09eea00640 1 -- 172.21.15.63:0/4264017279 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09e80583d0 con 0x7f09f8071850 2024-03-26T06:18:07.068 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:18:07.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f09d406bbd0 msgr2=0x7f09d406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f09d406bbd0 0x7f09d406e090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f09e0036000 tx=0x7f09e0008030 comp rx=0 tx=0).stop 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 msgr2=0x7f09f815b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 0x7f09f815b2e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c400 tx=0x7f09e800c8c0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 shutdown_connections 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f09d406bbd0 0x7f09d406e090 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09f815dec0 0x7f09f80b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09f8143eb0 0x7f09f80aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 --2- 172.21.15.63:0/4264017279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f8071850 0x7f09f815b2e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 >> 172.21.15.63:0/4264017279 conn(0x7f09f80670b0 msgr2=0x7f09f8160600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 shutdown_connections 2024-03-26T06:18:07.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.070+0000 7f09fca00640 1 -- 172.21.15.63:0/4264017279 wait complete. 2024-03-26T06:18:07.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:18:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.295+0000 7fe323200640 1 Processor -- start 2024-03-26T06:18:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.295+0000 7fe323200640 1 -- start start 2024-03-26T06:18:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.296+0000 7fe323200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe3240d3840 0x7fe3240d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.296+0000 7fe323200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 0x7fe3240b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.296+0000 7fe323200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3240d4160 con 0x7fe32415dca0 2024-03-26T06:18:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.296+0000 7fe323200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3240d2070 con 0x7fe3240d3840 2024-03-26T06:18:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.296+0000 7fe323200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240d22d0 con 0x7fe3240b9320 2024-03-26T06:18:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.297+0000 7fe321e00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe3240d3840 0x7fe3240d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.297+0000 7fe322800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 0x7fe3240b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.297+0000 7fe321e00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe3240d3840 0x7fe3240d3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:58696/0 (socket says 172.21.15.63:58696) 2024-03-26T06:18:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.297+0000 7fe321e00640 1 -- 172.21.15.63:0/3791649332 learned_addr learned my addr 172.21.15.63:0/3791649332 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:07.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.298+0000 7fe321e00640 1 -- 172.21.15.63:0/3791649332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 msgr2=0x7fe3240b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:07.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.298+0000 7fe321e00640 1 --2- 172.21.15.63:0/3791649332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 0x7fe3240b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.298+0000 7fe321e00640 1 -- 172.21.15.63:0/3791649332 >> v1:172.21.15.204:6789/0 conn(0x7fe32415dca0 legacy=0x7fe3240d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.298+0000 7fe321e00640 1 -- 172.21.15.63:0/3791649332 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3240d25b0 con 0x7fe3240d3840 2024-03-26T06:18:07.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.299+0000 7fe321e00640 1 --2- 172.21.15.63:0/3791649332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3240d3840 0x7fe3240d3c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe314009e50 tx=0x7fe31402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f90a11fe242b7c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:07.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.300+0000 7fe320a00640 1 -- 172.21.15.63:0/3791649332 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31402cb00 con 0x7fe3240d3840 2024-03-26T06:18:07.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.300+0000 7fe320a00640 1 -- 172.21.15.63:0/3791649332 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31402cca0 con 0x7fe3240d3840 2024-03-26T06:18:07.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.300+0000 7fe320a00640 1 -- 172.21.15.63:0/3791649332 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314034610 con 0x7fe3240d3840 2024-03-26T06:18:07.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.300+0000 7fe323200640 1 -- 172.21.15.63:0/3791649332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3240d3840 msgr2=0x7fe3240d3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.300+0000 7fe323200640 1 --2- 172.21.15.63:0/3791649332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3240d3840 0x7fe3240d3c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe314009e50 tx=0x7fe31402bf60 comp rx=0 tx=0).stop 2024-03-26T06:18:07.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.300+0000 7fe323200640 1 -- 172.21.15.63:0/3791649332 shutdown_connections 2024-03-26T06:18:07.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.300+0000 7fe323200640 1 --2- 172.21.15.63:0/3791649332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 0x7fe3240b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.300+0000 7fe323200640 1 --2- 172.21.15.63:0/3791649332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3240d3840 0x7fe3240d3c20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.300+0000 7fe323200640 1 -- 172.21.15.63:0/3791649332 >> 172.21.15.63:0/3791649332 conn(0x7fe32406c570 msgr2=0x7fe32406c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:07.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.301+0000 7fe323200640 1 -- 172.21.15.63:0/3791649332 shutdown_connections 2024-03-26T06:18:07.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.301+0000 7fe323200640 1 -- 172.21.15.63:0/3791649332 wait complete. 2024-03-26T06:18:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.302+0000 7fe323200640 1 Processor -- start 2024-03-26T06:18:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.302+0000 7fe323200640 1 -- start start 2024-03-26T06:18:07.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.303+0000 7fe323200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 0x7fe3241f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.303+0000 7fe323200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3240d3840 0x7fe324160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.303+0000 7fe323200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32415dca0 0x7fe3241f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.303+0000 7fe323200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240d2e50 con 0x7fe32415dca0 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.303+0000 7fe323200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240d2b70 con 0x7fe3240d3840 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.303+0000 7fe323200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240d3370 con 0x7fe3240b9320 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe322800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32415dca0 0x7fe3241f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe322800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32415dca0 0x7fe3241f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44868/0 (socket says 172.21.15.63:44868) 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe322800640 1 -- 172.21.15.63:0/4009792753 learned_addr learned my addr 172.21.15.63:0/4009792753 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe321e00640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 0x7fe3241f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe321400640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3240d3840 0x7fe324160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe322800640 1 -- 172.21.15.63:0/4009792753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 msgr2=0x7fe3241f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe322800640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 0x7fe3241f6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe322800640 1 -- 172.21.15.63:0/4009792753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3240d3840 msgr2=0x7fe324160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe322800640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3240d3840 0x7fe324160400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.304+0000 7fe322800640 1 -- 172.21.15.63:0/4009792753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3241f7520 con 0x7fe32415dca0 2024-03-26T06:18:07.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.305+0000 7fe322800640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32415dca0 0x7fe3241f3240 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00e850 tx=0x7fe31c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:07.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.305+0000 7fe31a000640 1 -- 172.21.15.63:0/4009792753 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c017070 con 0x7fe32415dca0 2024-03-26T06:18:07.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.305+0000 7fe31a000640 1 -- 172.21.15.63:0/4009792753 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c00c940 con 0x7fe32415dca0 2024-03-26T06:18:07.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.305+0000 7fe31a000640 1 -- 172.21.15.63:0/4009792753 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00cd30 con 0x7fe32415dca0 2024-03-26T06:18:07.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.305+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3241f7800 con 0x7fe32415dca0 2024-03-26T06:18:07.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.305+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3241f7dc0 con 0x7fe32415dca0 2024-03-26T06:18:07.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.306+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32404f0c0 con 0x7fe32415dca0 2024-03-26T06:18:07.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.307+0000 7fe31a000640 1 -- 172.21.15.63:0/4009792753 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe31c01a070 con 0x7fe32415dca0 2024-03-26T06:18:07.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.308+0000 7fe31a000640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe30006bbd0 0x7fe30006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.308+0000 7fe31a000640 1 -- 172.21.15.63:0/4009792753 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe31c08b280 con 0x7fe32415dca0 2024-03-26T06:18:07.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.308+0000 7fe321e00640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe30006bbd0 0x7fe30006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.309+0000 7fe321e00640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe30006bbd0 0x7fe30006e090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe314035000 tx=0x7fe314030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:07.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.313+0000 7fe31a000640 1 -- 172.21.15.63:0/4009792753 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe31c0598d0 con 0x7fe32415dca0 2024-03-26T06:18:07.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.504+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe32415bb10 con 0x7fe32415dca0 2024-03-26T06:18:07.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.505+0000 7fe31a000640 1 -- 172.21.15.63:0/4009792753 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe31c0591d0 con 0x7fe32415dca0 2024-03-26T06:18:07.506 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:07.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe30006bbd0 msgr2=0x7fe30006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe30006bbd0 0x7fe30006e090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe314035000 tx=0x7fe314030000 comp rx=0 tx=0).stop 2024-03-26T06:18:07.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32415dca0 msgr2=0x7fe3241f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32415dca0 0x7fe3241f3240 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00e850 tx=0x7fe31c00ed10 comp rx=0 tx=0).stop 2024-03-26T06:18:07.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 shutdown_connections 2024-03-26T06:18:07.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe30006bbd0 0x7fe30006e090 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32415dca0 0x7fe3241f3240 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3240d3840 0x7fe324160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 --2- 172.21.15.63:0/4009792753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3240b9320 0x7fe3241f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.507+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 >> 172.21.15.63:0/4009792753 conn(0x7fe32406c570 msgr2=0x7fe3240b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:07.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.508+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 shutdown_connections 2024-03-26T06:18:07.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.508+0000 7fe323200640 1 -- 172.21.15.63:0/4009792753 wait complete. 2024-03-26T06:18:07.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:18:07.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.753+0000 7f31d9c00640 1 Processor -- start 2024-03-26T06:18:07.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.754+0000 7f31d9c00640 1 -- start start 2024-03-26T06:18:07.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.755+0000 7f31d9c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d4144c70 0x7f31d40712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.755+0000 7f31d9c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f31d41450d0 0x7f31d4071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.755+0000 7f31d9c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40d0140 con 0x7f31d40cfd60 2024-03-26T06:18:07.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.755+0000 7f31d9c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40b3530 con 0x7f31d41450d0 2024-03-26T06:18:07.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.755+0000 7f31d9c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40b3810 con 0x7f31d4144c70 2024-03-26T06:18:07.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.755+0000 7f31d3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f31d41450d0 0x7f31d4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.756+0000 7f31d3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f31d41450d0 0x7f31d4071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44882/0 (socket says 172.21.15.63:44882) 2024-03-26T06:18:07.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.756+0000 7f31d3400640 1 -- 172.21.15.63:0/3367008253 learned_addr learned my addr 172.21.15.63:0/3367008253 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:07.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.756+0000 7f31d2000640 1 --2- 172.21.15.63:0/3367008253 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d4144c70 0x7f31d40712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.756+0000 7f31d3400640 1 -- 172.21.15.63:0/3367008253 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d4144c70 msgr2=0x7f31d40712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:07.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.756+0000 7f31d3400640 1 --2- 172.21.15.63:0/3367008253 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d4144c70 0x7f31d40712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.756+0000 7f31d3400640 1 -- 172.21.15.63:0/3367008253 >> v1:172.21.15.63:6789/0 conn(0x7f31d40cfd60 legacy=0x7f31d40b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.756+0000 7f31d3400640 1 -- 172.21.15.63:0/3367008253 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40b3af0 con 0x7f31d41450d0 2024-03-26T06:18:07.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.757+0000 7f31d3400640 1 --2- 172.21.15.63:0/3367008253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d41450d0 0x7f31d4071830 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009e50 tx=0x7f31cc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f163bc5250367117 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:07.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.758+0000 7f31d1600640 1 -- 172.21.15.63:0/3367008253 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc02cb00 con 0x7f31d41450d0 2024-03-26T06:18:07.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.758+0000 7f31d1600640 1 -- 172.21.15.63:0/3367008253 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc02cca0 con 0x7f31d41450d0 2024-03-26T06:18:07.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.758+0000 7f31d1600640 1 -- 172.21.15.63:0/3367008253 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc034610 con 0x7f31d41450d0 2024-03-26T06:18:07.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.758+0000 7f31d9c00640 1 -- 172.21.15.63:0/3367008253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d41450d0 msgr2=0x7f31d4071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.758+0000 7f31d9c00640 1 --2- 172.21.15.63:0/3367008253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d41450d0 0x7f31d4071830 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009e50 tx=0x7f31cc02bf60 comp rx=0 tx=0).stop 2024-03-26T06:18:07.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.759+0000 7f31d9c00640 1 -- 172.21.15.63:0/3367008253 shutdown_connections 2024-03-26T06:18:07.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.759+0000 7f31d9c00640 1 --2- 172.21.15.63:0/3367008253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d41450d0 0x7f31d4071830 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.759+0000 7f31d9c00640 1 --2- 172.21.15.63:0/3367008253 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d4144c70 0x7f31d40712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.759+0000 7f31d9c00640 1 -- 172.21.15.63:0/3367008253 >> 172.21.15.63:0/3367008253 conn(0x7f31d406ac90 msgr2=0x7f31d406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:07.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.759+0000 7f31d9c00640 1 -- 172.21.15.63:0/3367008253 shutdown_connections 2024-03-26T06:18:07.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.759+0000 7f31d9c00640 1 -- 172.21.15.63:0/3367008253 wait complete. 2024-03-26T06:18:07.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.760+0000 7f31d9c00640 1 Processor -- start 2024-03-26T06:18:07.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.761+0000 7f31d9c00640 1 -- start start 2024-03-26T06:18:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.761+0000 7f31d9c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31d40cfd60 0x7f31d415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.761+0000 7f31d9c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d4144c70 0x7f31d40ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.761+0000 7f31d9c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d41450d0 0x7f31d40ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.761+0000 7f31d9c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40b31c0 con 0x7f31d4144c70 2024-03-26T06:18:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.761+0000 7f31d9c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40b40b0 con 0x7f31d40cfd60 2024-03-26T06:18:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.761+0000 7f31d9c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40ce670 con 0x7f31d41450d0 2024-03-26T06:18:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d4144c70 0x7f31d40ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d4144c70 0x7f31d40ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44894/0 (socket says 172.21.15.63:44894) 2024-03-26T06:18:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d2000640 1 -- 172.21.15.63:0/3333246161 learned_addr learned my addr 172.21.15.63:0/3333246161 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d3400640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d41450d0 0x7f31d40ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d2000640 1 -- 172.21.15.63:0/3333246161 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d41450d0 msgr2=0x7f31d40ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d2000640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d41450d0 0x7f31d40ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d2000640 1 -- 172.21.15.63:0/3333246161 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31d40cfd60 msgr2=0x7f31d415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d2a00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31d40cfd60 0x7f31d415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d2000640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31d40cfd60 0x7f31d415b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.762+0000 7f31d2000640 1 -- 172.21.15.63:0/3333246161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d406d540 con 0x7f31d4144c70 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.763+0000 7f31d2000640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d4144c70 0x7f31d40ad930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f31c000d830 tx=0x7f31c000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.763+0000 7f31caa00640 1 -- 172.21.15.63:0/3333246161 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c000b6c0 con 0x7f31d4144c70 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.763+0000 7f31caa00640 1 -- 172.21.15.63:0/3333246161 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0019070 con 0x7f31d4144c70 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.763+0000 7f31caa00640 1 -- 172.21.15.63:0/3333246161 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c000ba80 con 0x7f31d4144c70 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.763+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d406d820 con 0x7f31d4144c70 2024-03-26T06:18:07.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.763+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d406dde0 con 0x7f31d4144c70 2024-03-26T06:18:07.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.764+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d4074730 con 0x7f31d4144c70 2024-03-26T06:18:07.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.765+0000 7f31caa00640 1 -- 172.21.15.63:0/3333246161 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f31c001e460 con 0x7f31d4144c70 2024-03-26T06:18:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.766+0000 7f31caa00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f31b406bbd0 0x7f31b406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.766+0000 7f31caa00640 1 -- 172.21.15.63:0/3333246161 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f31c008b5c0 con 0x7f31d4144c70 2024-03-26T06:18:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.766+0000 7f31d2a00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f31b406bbd0 0x7f31b406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.767+0000 7f31d2a00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f31b406bbd0 0x7f31b406e090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f31c40015a0 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.771+0000 7f31caa00640 1 -- 172.21.15.63:0/3333246161 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f31c0059c10 con 0x7f31d4144c70 2024-03-26T06:18:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.970+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31d40b2140 con 0x7f31d4144c70 2024-03-26T06:18:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.971+0000 7f31caa00640 1 -- 172.21.15.63:0/3333246161 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31c0059510 con 0x7f31d4144c70 2024-03-26T06:18:07.973 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:18:07.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f31b406bbd0 msgr2=0x7f31b406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f31b406bbd0 0x7f31b406e090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f31c40015a0 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d4144c70 msgr2=0x7f31d40ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d4144c70 0x7f31d40ad930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f31c000d830 tx=0x7f31c000dcf0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 shutdown_connections 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f31b406bbd0 0x7f31b406e090 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d41450d0 0x7f31d40ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31d4144c70 0x7f31d40ad930 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 --2- 172.21.15.63:0/3333246161 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31d40cfd60 0x7f31d415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 >> 172.21.15.63:0/3333246161 conn(0x7f31d406ac90 msgr2=0x7f31d40b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 shutdown_connections 2024-03-26T06:18:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:07.974+0000 7f31d9c00640 1 -- 172.21.15.63:0/3333246161 wait complete. 2024-03-26T06:18:07.995 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:18:08.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.219+0000 7f17f3e00640 1 Processor -- start 2024-03-26T06:18:08.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.220+0000 7f17f3e00640 1 -- start start 2024-03-26T06:18:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.221+0000 7f17f3e00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f17f40b9320 0x7f17f41685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.221+0000 7f17f3e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f40d22d0 con 0x7f17f40d3840 2024-03-26T06:18:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.221+0000 7f17f3e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f40d25b0 con 0x7f17f415dca0 2024-03-26T06:18:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.221+0000 7f17f3e00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f40d2070 con 0x7f17f40b9320 2024-03-26T06:18:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.222+0000 7f17f2a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f17f40d3840 0x7f17f40d3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60632/0 (socket says 172.21.15.63:60632) 2024-03-26T06:18:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.222+0000 7f17f2a00640 1 -- 172.21.15.63:0/3963403481 learned_addr learned my addr 172.21.15.63:0/3963403481 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:08.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.222+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543907199 0 0) 0x7f17f40d22d0 con 0x7f17f40d3840 2024-03-26T06:18:08.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.222+0000 7f17f3400640 1 --2- 172.21.15.63:0/3963403481 >> v2:172.21.15.204:3300/0 conn(0x7f17f40b9320 0x7f17f41685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.222+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d8003520 con 0x7f17f40d3840 2024-03-26T06:18:08.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3951082549 0 0) 0x7f17d8003520 con 0x7f17f40d3840 2024-03-26T06:18:08.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 >> v2:172.21.15.204:3300/0 conn(0x7f17f40b9320 msgr2=0x7f17f41685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:08.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 --2- 172.21.15.63:0/3963403481 >> v2:172.21.15.204:3300/0 conn(0x7f17f40b9320 0x7f17f41685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 >> v1:172.21.15.204:6789/0 conn(0x7f17f415dca0 legacy=0x7f17f40d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f40d2890 con 0x7f17f40d3840 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f17e4001670 con 0x7f17f40d3840 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 >> v1:172.21.15.63:6789/0 conn(0x7f17f40d3840 legacy=0x7f17f40d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17d8003a00 0x7f17d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17d8004800 0x7f17d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d8005210 0x7f17d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40d2070 con 0x7f17d8005210 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d800c140 con 0x7f17d8004800 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d800c340 con 0x7f17d8003a00 2024-03-26T06:18:08.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f3400640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d8005210 0x7f17d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f2a00640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17d8003a00 0x7f17d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.223+0000 7f17f2000640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17d8004800 0x7f17d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.224+0000 7f17f3400640 1 -- 172.21.15.63:0/3963403481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17d8003a00 msgr2=0x7f17d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:08.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.224+0000 7f17f3400640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17d8003a00 0x7f17d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.224+0000 7f17f3400640 1 -- 172.21.15.63:0/3963403481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17d8004800 msgr2=0x7f17d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:08.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.224+0000 7f17f3400640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17d8004800 0x7f17d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.224+0000 7f17f3400640 1 -- 172.21.15.63:0/3963403481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8003520 con 0x7f17d8005210 2024-03-26T06:18:08.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.224+0000 7f17f3400640 1 -- 172.21.15.63:0/3963403481 reap_dead start 2024-03-26T06:18:08.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.225+0000 7f17f3400640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d8005210 0x7f17d800b9c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f17f40d44c0 tx=0x7f17d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80974f7b196b3a00 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:08.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.225+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec039070 con 0x7f17d8005210 2024-03-26T06:18:08.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.225+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec02cca0 con 0x7f17d8005210 2024-03-26T06:18:08.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.225+0000 7f17f1600640 1 -- 172.21.15.63:0/3963403481 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec009be0 con 0x7f17d8005210 2024-03-26T06:18:08.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.226+0000 7f17f3e00640 1 -- 172.21.15.63:0/3963403481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d8005210 msgr2=0x7f17d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.226+0000 7f17f3e00640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d8005210 0x7f17d800b9c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f17f40d44c0 tx=0x7f17d8005830 comp rx=0 tx=0).stop 2024-03-26T06:18:08.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.226+0000 7f17f3e00640 1 -- 172.21.15.63:0/3963403481 shutdown_connections 2024-03-26T06:18:08.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.226+0000 7f17f3e00640 1 --2- 172.21.15.63:0/3963403481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d8005210 0x7f17d800b9c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.226+0000 7f17f3e00640 1 -- 172.21.15.63:0/3963403481 >> 172.21.15.63:0/3963403481 conn(0x7f17f406c570 msgr2=0x7f17f406c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:08.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.226+0000 7f17f3e00640 1 -- 172.21.15.63:0/3963403481 shutdown_connections 2024-03-26T06:18:08.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.226+0000 7f17f3e00640 1 -- 172.21.15.63:0/3963403481 wait complete. 2024-03-26T06:18:08.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.228+0000 7f17f3e00640 1 Processor -- start 2024-03-26T06:18:08.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.228+0000 7f17f3e00640 1 -- start start 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17d8005210 0x7f17f4158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17f4155a20 0x7f17f4151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17f41f64d0 0x7f17f41f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f3e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40d3370 con 0x7f17f4155a20 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f3e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40d2e50 con 0x7f17d8005210 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f3e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40d34f0 con 0x7f17f41f64d0 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17f4155a20 0x7f17f4151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17f4155a20 0x7f17f4151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44920/0 (socket says 172.21.15.63:44920) 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f2000640 1 -- 172.21.15.63:0/392253757 learned_addr learned my addr 172.21.15.63:0/392253757 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f2a00640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17d8005210 0x7f17f4158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.229+0000 7f17f3400640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17f41f64d0 0x7f17f41f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17f2000640 1 -- 172.21.15.63:0/392253757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17f41f64d0 msgr2=0x7f17f41f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17f2000640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17f41f64d0 0x7f17f41f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17f2000640 1 -- 172.21.15.63:0/392253757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17d8005210 msgr2=0x7f17f4158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17f2000640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17d8005210 0x7f17f4158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17f2000640 1 -- 172.21.15.63:0/392253757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f40cd9e0 con 0x7f17f4155a20 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17f3400640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17f41f64d0 0x7f17f41f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17f2000640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17f4155a20 0x7f17f4151b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00e490 tx=0x7f17dc00e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17eb400640 1 -- 172.21.15.63:0/392253757 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0135f0 con 0x7f17f4155a20 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17eb400640 1 -- 172.21.15.63:0/392253757 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc01a070 con 0x7f17f4155a20 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f41572a0 con 0x7f17f4155a20 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17eb400640 1 -- 172.21.15.63:0/392253757 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0139d0 con 0x7f17f4155a20 2024-03-26T06:18:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.230+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f41564e0 con 0x7f17f4155a20 2024-03-26T06:18:08.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.232+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f404f0c0 con 0x7f17f4155a20 2024-03-26T06:18:08.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.233+0000 7f17eb400640 1 -- 172.21.15.63:0/392253757 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f17dc013b70 con 0x7f17f4155a20 2024-03-26T06:18:08.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.234+0000 7f17eb400640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f17d006bc00 0x7f17d006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.234+0000 7f17eb400640 1 -- 172.21.15.63:0/392253757 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f17dc08af50 con 0x7f17f4155a20 2024-03-26T06:18:08.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.234+0000 7f17f2a00640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f17d006bc00 0x7f17d006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.235+0000 7f17f2a00640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f17d006bc00 0x7f17d006e0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17e4001050 tx=0x7f17e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:08.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.238+0000 7f17eb400640 1 -- 172.21.15.63:0/392253757 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f17dc024020 con 0x7f17f4155a20 2024-03-26T06:18:08.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.439+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17f4155040 con 0x7f17f4155a20 2024-03-26T06:18:08.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.439+0000 7f17eb400640 1 -- 172.21.15.63:0/392253757 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f17dc0595a0 con 0x7f17f4155a20 2024-03-26T06:18:08.441 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f17d006bc00 msgr2=0x7f17d006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f17d006bc00 0x7f17d006e0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17e4001050 tx=0x7f17e4009040 comp rx=0 tx=0).stop 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17f4155a20 msgr2=0x7f17f4151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17f4155a20 0x7f17f4151b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00e490 tx=0x7f17dc00e950 comp rx=0 tx=0).stop 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 shutdown_connections 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f17d006bc00 0x7f17d006e0c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17f41f64d0 0x7f17f41f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17f4155a20 0x7f17f4151b00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 --2- 172.21.15.63:0/392253757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17d8005210 0x7f17f4158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 >> 172.21.15.63:0/392253757 conn(0x7f17f406c570 msgr2=0x7f17f40b78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 shutdown_connections 2024-03-26T06:18:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.442+0000 7f17f3e00640 1 -- 172.21.15.63:0/392253757 wait complete. 2024-03-26T06:18:08.462 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-26T06:18:08.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.693+0000 7fb160800640 1 Processor -- start 2024-03-26T06:18:08.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.693+0000 7fb160800640 1 -- start start 2024-03-26T06:18:08.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.694+0000 7fb160800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb1580cfd60 0x7fb1580b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.694+0000 7fb160800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb158071a00 0x7fb1580ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.694+0000 7fb160800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1580d0140 con 0x7fb158144c70 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.694+0000 7fb160800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1580b4b10 con 0x7fb1580cfd60 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.694+0000 7fb160800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1580b3530 con 0x7fb158071a00 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb1580cfd60 0x7fb1580b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15d400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb158144c70 0x7fb1580712f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60642/0 (socket says 172.21.15.63:60642) 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb1580cfd60 0x7fb1580b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44924/0 (socket says 172.21.15.63:44924) 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15d400640 1 -- 172.21.15.63:0/2122002957 learned_addr learned my addr 172.21.15.63:0/2122002957 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15e800640 1 --2- 172.21.15.63:0/2122002957 >> v2:172.21.15.204:3300/0 conn(0x7fb158071a00 0x7fb1580ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15de00640 1 -- 172.21.15.63:0/2122002957 >> v2:172.21.15.204:3300/0 conn(0x7fb158071a00 msgr2=0x7fb1580ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15de00640 1 --2- 172.21.15.63:0/2122002957 >> v2:172.21.15.204:3300/0 conn(0x7fb158071a00 0x7fb1580ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15de00640 1 -- 172.21.15.63:0/2122002957 >> v1:172.21.15.63:6789/0 conn(0x7fb158144c70 legacy=0x7fb1580712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15de00640 1 -- 172.21.15.63:0/2122002957 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580b3810 con 0x7fb1580cfd60 2024-03-26T06:18:08.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.695+0000 7fb15ca00640 1 -- 172.21.15.63:0/2122002957 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207506641 0 0) 0x7fb1580d0140 con 0x7fb158144c70 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.697+0000 7fb15de00640 1 --2- 172.21.15.63:0/2122002957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1580cfd60 0x7fb1580b45d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb1580af220 tx=0x7fb15002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc630be5c3e50fb server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.697+0000 7fb15ca00640 1 -- 172.21.15.63:0/2122002957 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150039070 con 0x7fb1580cfd60 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.697+0000 7fb15ca00640 1 -- 172.21.15.63:0/2122002957 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15002cc70 con 0x7fb1580cfd60 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.697+0000 7fb15ca00640 1 -- 172.21.15.63:0/2122002957 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150034660 con 0x7fb1580cfd60 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.697+0000 7fb160800640 1 -- 172.21.15.63:0/2122002957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1580cfd60 msgr2=0x7fb1580b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.697+0000 7fb160800640 1 --2- 172.21.15.63:0/2122002957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1580cfd60 0x7fb1580b45d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb1580af220 tx=0x7fb15002bec0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.698+0000 7fb160800640 1 -- 172.21.15.63:0/2122002957 shutdown_connections 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.698+0000 7fb160800640 1 --2- 172.21.15.63:0/2122002957 >> v2:172.21.15.204:3300/0 conn(0x7fb158071a00 0x7fb1580ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.698+0000 7fb160800640 1 --2- 172.21.15.63:0/2122002957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1580cfd60 0x7fb1580b45d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.698+0000 7fb160800640 1 -- 172.21.15.63:0/2122002957 >> 172.21.15.63:0/2122002957 conn(0x7fb15806ac90 msgr2=0x7fb15806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.698+0000 7fb160800640 1 -- 172.21.15.63:0/2122002957 shutdown_connections 2024-03-26T06:18:08.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.698+0000 7fb160800640 1 -- 172.21.15.63:0/2122002957 wait complete. 2024-03-26T06:18:08.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.699+0000 7fb160800640 1 Processor -- start 2024-03-26T06:18:08.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.700+0000 7fb160800640 1 -- start start 2024-03-26T06:18:08.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.700+0000 7fb160800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb158071a00 0x7fb158152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.700+0000 7fb160800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1580cfd60 0x7fb1580ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.700+0000 7fb160800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb158144c70 0x7fb15815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb160800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580b40b0 con 0x7fb158071a00 2024-03-26T06:18:08.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb160800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580b3dd0 con 0x7fb158144c70 2024-03-26T06:18:08.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb160800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580b31c0 con 0x7fb1580cfd60 2024-03-26T06:18:08.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb15de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb158071a00 0x7fb158152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb15de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb158071a00 0x7fb158152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44938/0 (socket says 172.21.15.63:44938) 2024-03-26T06:18:08.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb15de00640 1 -- 172.21.15.63:0/407668746 learned_addr learned my addr 172.21.15.63:0/407668746 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:08.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb15de00640 1 -- 172.21.15.63:0/407668746 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1580cfd60 msgr2=0x7fb1580ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb15de00640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1580cfd60 0x7fb1580ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb15de00640 1 -- 172.21.15.63:0/407668746 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb158144c70 msgr2=0x7fb15815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb15de00640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb158144c70 0x7fb15815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb15de00640 1 -- 172.21.15.63:0/407668746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580ad3a0 con 0x7fb158071a00 2024-03-26T06:18:08.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.701+0000 7fb15de00640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb158071a00 0x7fb158152f90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb150009e80 tx=0x7fb150004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:08.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.702+0000 7fb14e000640 1 -- 172.21.15.63:0/407668746 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150039050 con 0x7fb158071a00 2024-03-26T06:18:08.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.702+0000 7fb14e000640 1 -- 172.21.15.63:0/407668746 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb150045070 con 0x7fb158071a00 2024-03-26T06:18:08.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.702+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1580ad680 con 0x7fb158071a00 2024-03-26T06:18:08.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.702+0000 7fb14e000640 1 -- 172.21.15.63:0/407668746 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15003e850 con 0x7fb158071a00 2024-03-26T06:18:08.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.702+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1580adc40 con 0x7fb158071a00 2024-03-26T06:18:08.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.703+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb158074730 con 0x7fb158071a00 2024-03-26T06:18:08.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.704+0000 7fb14e000640 1 -- 172.21.15.63:0/407668746 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb15003e9f0 con 0x7fb158071a00 2024-03-26T06:18:08.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.705+0000 7fb14e000640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb13c06bbd0 0x7fb13c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:08.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.705+0000 7fb14e000640 1 -- 172.21.15.63:0/407668746 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb1500add40 con 0x7fb158071a00 2024-03-26T06:18:08.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.705+0000 7fb15d400640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb13c06bbd0 0x7fb13c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:08.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.706+0000 7fb15d400640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb13c06bbd0 0x7fb13c06e090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb148005880 tx=0x7fb148007950 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:08.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.710+0000 7fb14e000640 1 -- 172.21.15.63:0/407668746 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb15002ce20 con 0x7fb158071a00 2024-03-26T06:18:08.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.920+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb158160050 con 0x7fb158071a00 2024-03-26T06:18:08.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.921+0000 7fb14e000640 1 -- 172.21.15.63:0/407668746 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb15007c550 con 0x7fb158071a00 2024-03-26T06:18:08.922 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-03-26T06:18:08.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb13c06bbd0 msgr2=0x7fb13c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb13c06bbd0 0x7fb13c06e090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb148005880 tx=0x7fb148007950 comp rx=0 tx=0).stop 2024-03-26T06:18:08.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb158071a00 msgr2=0x7fb158152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:08.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb158071a00 0x7fb158152f90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb150009e80 tx=0x7fb150004a40 comp rx=0 tx=0).stop 2024-03-26T06:18:08.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 shutdown_connections 2024-03-26T06:18:08.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb13c06bbd0 0x7fb13c06e090 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb158144c70 0x7fb15815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1580cfd60 0x7fb1580ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 --2- 172.21.15.63:0/407668746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb158071a00 0x7fb158152f90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:08.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.924+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 >> 172.21.15.63:0/407668746 conn(0x7fb15806ac90 msgr2=0x7fb15806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:08.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.925+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 shutdown_connections 2024-03-26T06:18:08.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:08.925+0000 7fb160800640 1 -- 172.21.15.63:0/407668746 wait complete. 2024-03-26T06:18:08.943 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-26T06:18:08.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:08.944 DEBUG:teuthology.orchestra.run.smithi204:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-26T06:18:09.056 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T06:18:09.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:09.056 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-26T06:18:09.118 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:18:09.118 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:09.177 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:18:09.177 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:09.232 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:18:09.232 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:09.286 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:09.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.511+0000 7f4825400640 1 Processor -- start 2024-03-26T06:18:09.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.511+0000 7f4825400640 1 -- start start 2024-03-26T06:18:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4825400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4820070060 0x7f48200b2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4825400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48200c68b0 0x7f48200c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4825400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4820166160 con 0x7f482006ac90 2024-03-26T06:18:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4825400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48200c7240 con 0x7f48200c68b0 2024-03-26T06:18:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4825400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482006b190 con 0x7f4820070060 2024-03-26T06:18:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4824a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48200c68b0 0x7f48200c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4824a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48200c68b0 0x7f48200c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44948/0 (socket says 172.21.15.63:44948) 2024-03-26T06:18:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4824a00640 1 -- 172.21.15.63:0/314826140 learned_addr learned my addr 172.21.15.63:0/314826140 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4824a00640 1 -- 172.21.15.63:0/314826140 >> v2:172.21.15.204:3300/0 conn(0x7f4820070060 msgr2=0x7f48200b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4824a00640 1 --2- 172.21.15.63:0/314826140 >> v2:172.21.15.204:3300/0 conn(0x7f4820070060 0x7f48200b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4824a00640 1 -- 172.21.15.63:0/314826140 >> v1:172.21.15.204:6789/0 conn(0x7f482006ac90 legacy=0x7f4820165a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.513+0000 7f4824a00640 1 -- 172.21.15.63:0/314826140 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482006b470 con 0x7f48200c68b0 2024-03-26T06:18:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.515+0000 7f4824a00640 1 --2- 172.21.15.63:0/314826140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48200c68b0 0x7f48200c6d00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f482009a020 tx=0x7f481802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f72d25e58d89352 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.515+0000 7f481f400640 1 -- 172.21.15.63:0/314826140 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481802cb10 con 0x7f48200c68b0 2024-03-26T06:18:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.515+0000 7f481f400640 1 -- 172.21.15.63:0/314826140 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481802ccb0 con 0x7f48200c68b0 2024-03-26T06:18:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.515+0000 7f481f400640 1 -- 172.21.15.63:0/314826140 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481802ce60 con 0x7f48200c68b0 2024-03-26T06:18:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.515+0000 7f4825400640 1 -- 172.21.15.63:0/314826140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48200c68b0 msgr2=0x7f48200c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.515+0000 7f4825400640 1 --2- 172.21.15.63:0/314826140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48200c68b0 0x7f48200c6d00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f482009a020 tx=0x7f481802bf70 comp rx=0 tx=0).stop 2024-03-26T06:18:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.516+0000 7f4825400640 1 -- 172.21.15.63:0/314826140 shutdown_connections 2024-03-26T06:18:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.516+0000 7f4825400640 1 --2- 172.21.15.63:0/314826140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48200c68b0 0x7f48200c6d00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.516+0000 7f4825400640 1 --2- 172.21.15.63:0/314826140 >> v2:172.21.15.204:3300/0 conn(0x7f4820070060 0x7f48200b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.516+0000 7f4825400640 1 -- 172.21.15.63:0/314826140 >> 172.21.15.63:0/314826140 conn(0x7f4820099a70 msgr2=0x7f48200b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.516+0000 7f4825400640 1 -- 172.21.15.63:0/314826140 shutdown_connections 2024-03-26T06:18:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.516+0000 7f4825400640 1 -- 172.21.15.63:0/314826140 wait complete. 2024-03-26T06:18:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.517+0000 7f4825400640 1 Processor -- start 2024-03-26T06:18:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.517+0000 7f4825400640 1 -- start start 2024-03-26T06:18:09.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.518+0000 7f4825400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f482006ac90 0x7f48201eba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.518+0000 7f4825400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4820070060 0x7f48201ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.518+0000 7f4825400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f48200c68b0 0x7f48201ec930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.518+0000 7f4825400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48200b2ec0 con 0x7f4820070060 2024-03-26T06:18:09.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.518+0000 7f4825400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482006ba30 con 0x7f482006ac90 2024-03-26T06:18:09.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.518+0000 7f4825400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48200b3040 con 0x7f48200c68b0 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4817400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4820070060 0x7f48201ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4817400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4820070060 0x7f48201ec3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44952/0 (socket says 172.21.15.63:44952) 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4817400640 1 -- 172.21.15.63:0/798099695 learned_addr learned my addr 172.21.15.63:0/798099695 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f481fe00640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f482006ac90 0x7f48201eba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4824a00640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f48200c68b0 0x7f48201ec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4817400640 1 -- 172.21.15.63:0/798099695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f48200c68b0 msgr2=0x7f48201ec930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4817400640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f48200c68b0 0x7f48201ec930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4817400640 1 -- 172.21.15.63:0/798099695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f482006ac90 msgr2=0x7f48201eba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4817400640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f482006ac90 0x7f48201eba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4817400640 1 -- 172.21.15.63:0/798099695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48200b5870 con 0x7f4820070060 2024-03-26T06:18:09.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.519+0000 7f4817400640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4820070060 0x7f48201ec3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f480800b3c0 tx=0x7f480800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:09.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.520+0000 7f481cc00640 1 -- 172.21.15.63:0/798099695 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808011830 con 0x7f4820070060 2024-03-26T06:18:09.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.520+0000 7f481cc00640 1 -- 172.21.15.63:0/798099695 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4808016070 con 0x7f4820070060 2024-03-26T06:18:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.520+0000 7f481cc00640 1 -- 172.21.15.63:0/798099695 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808011c30 con 0x7f4820070060 2024-03-26T06:18:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.520+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48200b5b10 con 0x7f4820070060 2024-03-26T06:18:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.520+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48200b60d0 con 0x7f4820070060 2024-03-26T06:18:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.521+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482004f050 con 0x7f4820070060 2024-03-26T06:18:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.522+0000 7f481cc00640 1 -- 172.21.15.63:0/798099695 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f480801b460 con 0x7f4820070060 2024-03-26T06:18:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.523+0000 7f481cc00640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f47fc06bc00 0x7f47fc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.523+0000 7f481cc00640 1 -- 172.21.15.63:0/798099695 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f480808ac00 con 0x7f4820070060 2024-03-26T06:18:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.523+0000 7f481fe00640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f47fc06bc00 0x7f47fc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.524+0000 7f481fe00640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f47fc06bc00 0x7f47fc06e0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f48200b2260 tx=0x7f4810008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:09.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.528+0000 7f481cc00640 1 -- 172.21.15.63:0/798099695 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f4808059250 con 0x7f4820070060 2024-03-26T06:18:09.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.731+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4820072ee0 con 0x7f4820070060 2024-03-26T06:18:09.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.733+0000 7f481cc00640 1 -- 172.21.15.63:0/798099695 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7f4808058b50 con 0x7f4820070060 2024-03-26T06:18:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:09.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f47fc06bc00 msgr2=0x7f47fc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:09.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f47fc06bc00 0x7f47fc06e0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f48200b2260 tx=0x7f4810008040 comp rx=0 tx=0).stop 2024-03-26T06:18:09.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4820070060 msgr2=0x7f48201ec3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:09.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4820070060 0x7f48201ec3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f480800b3c0 tx=0x7f480800b880 comp rx=0 tx=0).stop 2024-03-26T06:18:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 shutdown_connections 2024-03-26T06:18:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f47fc06bc00 0x7f47fc06e0c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f48200c68b0 0x7f48201ec930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4820070060 0x7f48201ec3f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 --2- 172.21.15.63:0/798099695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f482006ac90 0x7f48201eba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.736+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 >> 172.21.15.63:0/798099695 conn(0x7f4820099a70 msgr2=0x7f48200d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.737+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 shutdown_connections 2024-03-26T06:18:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.737+0000 7f4825400640 1 -- 172.21.15.63:0/798099695 wait complete. 2024-03-26T06:18:09.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:18:09.755 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:18:09.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.974+0000 7fedf3200640 1 Processor -- start 2024-03-26T06:18:09.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.974+0000 7fedf3200640 1 -- start start 2024-03-26T06:18:09.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.976+0000 7fedf3200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fedec157f90 0x7fedec0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.976+0000 7fedf3200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fedec0b39f0 0x7fedec0ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.976+0000 7fedf3200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec15efb0 con 0x7fedec0ae570 2024-03-26T06:18:09.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.976+0000 7fedf3200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec15e3a0 con 0x7fedec157f90 2024-03-26T06:18:09.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.976+0000 7fedf3200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec15e680 con 0x7fedec0b39f0 2024-03-26T06:18:09.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.976+0000 7fedebe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fedec157f90 0x7fedec0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.976+0000 7fedebe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fedec157f90 0x7fedec0acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44958/0 (socket says 172.21.15.63:44958) 2024-03-26T06:18:09.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.976+0000 7fedebe00640 1 -- 172.21.15.63:0/4234920131 learned_addr learned my addr 172.21.15.63:0/4234920131 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:09.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.977+0000 7fedebe00640 1 -- 172.21.15.63:0/4234920131 >> v2:172.21.15.204:3300/0 conn(0x7fedec0b39f0 msgr2=0x7fedec0ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:09.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.977+0000 7fedf1200640 1 --2- 172.21.15.63:0/4234920131 >> v2:172.21.15.204:3300/0 conn(0x7fedec0b39f0 0x7fedec0ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.977+0000 7fedebe00640 1 --2- 172.21.15.63:0/4234920131 >> v2:172.21.15.204:3300/0 conn(0x7fedec0b39f0 0x7fedec0ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.977+0000 7fedebe00640 1 -- 172.21.15.63:0/4234920131 >> v1:172.21.15.204:6789/0 conn(0x7fedec0ae570 legacy=0x7fedec0b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:09.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.977+0000 7fedebe00640 1 -- 172.21.15.63:0/4234920131 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec15e960 con 0x7fedec157f90 2024-03-26T06:18:09.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.978+0000 7fedebe00640 1 --2- 172.21.15.63:0/4234920131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 0x7fedec0acc70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fedec06bab0 tx=0x7feddc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773956ccce00028 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:09.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.978+0000 7fedeaa00640 1 -- 172.21.15.63:0/4234920131 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc035020 con 0x7fedec157f90 2024-03-26T06:18:09.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.978+0000 7fedeaa00640 1 -- 172.21.15.63:0/4234920131 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc031870 con 0x7fedec157f90 2024-03-26T06:18:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.978+0000 7fedeaa00640 1 -- 172.21.15.63:0/4234920131 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc031c40 con 0x7fedec157f90 2024-03-26T06:18:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.979+0000 7fedf3200640 1 -- 172.21.15.63:0/4234920131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 msgr2=0x7fedec0acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.979+0000 7fedf3200640 1 --2- 172.21.15.63:0/4234920131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 0x7fedec0acc70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fedec06bab0 tx=0x7feddc02b910 comp rx=0 tx=0).stop 2024-03-26T06:18:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.979+0000 7fedf3200640 1 -- 172.21.15.63:0/4234920131 shutdown_connections 2024-03-26T06:18:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.979+0000 7fedf3200640 1 --2- 172.21.15.63:0/4234920131 >> v2:172.21.15.204:3300/0 conn(0x7fedec0b39f0 0x7fedec0ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.979+0000 7fedf3200640 1 --2- 172.21.15.63:0/4234920131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 0x7fedec0acc70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.979+0000 7fedf3200640 1 -- 172.21.15.63:0/4234920131 >> 172.21.15.63:0/4234920131 conn(0x7fedec06ac90 msgr2=0x7fedec06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.979+0000 7fedf3200640 1 -- 172.21.15.63:0/4234920131 shutdown_connections 2024-03-26T06:18:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.979+0000 7fedf3200640 1 -- 172.21.15.63:0/4234920131 wait complete. 2024-03-26T06:18:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.981+0000 7fedf3200640 1 Processor -- start 2024-03-26T06:18:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.981+0000 7fedf3200640 1 -- start start 2024-03-26T06:18:09.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.982+0000 7fedf3200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedec0ae570 0x7fedec150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.982+0000 7fedf3200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedec0b39f0 0x7fedec14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.982+0000 7fedf3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 0x7fedec0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.982+0000 7fedf3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec15e050 con 0x7fedec157f90 2024-03-26T06:18:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.982+0000 7fedf3200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0ad1b0 con 0x7fedec0ae570 2024-03-26T06:18:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.982+0000 7fedf3200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec158370 con 0x7fedec0b39f0 2024-03-26T06:18:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.982+0000 7fedf1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 0x7fedec0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedf1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 0x7fedec0b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44960/0 (socket says 172.21.15.63:44960) 2024-03-26T06:18:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedf1200640 1 -- 172.21.15.63:0/3790845662 learned_addr learned my addr 172.21.15.63:0/3790845662 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:09.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedebe00640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedec0ae570 0x7fedec150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedeb400640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedec0b39f0 0x7fedec14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedf1200640 1 -- 172.21.15.63:0/3790845662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedec0b39f0 msgr2=0x7fedec14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedf1200640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedec0b39f0 0x7fedec14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedf1200640 1 -- 172.21.15.63:0/3790845662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedec0ae570 msgr2=0x7fedec150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedf1200640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedec0ae570 0x7fedec150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedf1200640 1 -- 172.21.15.63:0/3790845662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec151430 con 0x7fedec157f90 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedeb400640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedec0b39f0 0x7fedec14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.983+0000 7fedf1200640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 0x7fedec0b2d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fede400cdc0 tx=0x7fede400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.984+0000 7fede3e00640 1 -- 172.21.15.63:0/3790845662 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4003b90 con 0x7fedec157f90 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.984+0000 7fede3e00640 1 -- 172.21.15.63:0/3790845662 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede4003d50 con 0x7fedec157f90 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.984+0000 7fede3e00640 1 -- 172.21.15.63:0/3790845662 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4004260 con 0x7fedec157f90 2024-03-26T06:18:09.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.984+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec151710 con 0x7fedec157f90 2024-03-26T06:18:09.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.984+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec151cd0 con 0x7fedec157f90 2024-03-26T06:18:09.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.985+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec0676c0 con 0x7fedec157f90 2024-03-26T06:18:09.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.986+0000 7fede3e00640 1 -- 172.21.15.63:0/3790845662 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fede4004400 con 0x7fedec157f90 2024-03-26T06:18:09.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.987+0000 7fede3e00640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fedc806bbd0 0x7fedc806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:09.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.987+0000 7fede3e00640 1 -- 172.21.15.63:0/3790845662 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fede408b990 con 0x7fedec157f90 2024-03-26T06:18:09.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.987+0000 7fedebe00640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fedc806bbd0 0x7fedc806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:09.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.988+0000 7fedebe00640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fedc806bbd0 0x7fedc806e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feddc036000 tx=0x7feddc03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:09.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:09.991+0000 7fede3e00640 1 -- 172.21.15.63:0/3790845662 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fedec0676c0 con 0x7fedec157f90 2024-03-26T06:18:10.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.183+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedec157500 con 0x7fedec157f90 2024-03-26T06:18:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.184+0000 7fede3e00640 1 -- 172.21.15.63:0/3790845662 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fede401d340 con 0x7fedec157f90 2024-03-26T06:18:10.185 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:18:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fedc806bbd0 msgr2=0x7fedc806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fedc806bbd0 0x7fedc806e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feddc036000 tx=0x7feddc03c040 comp rx=0 tx=0).stop 2024-03-26T06:18:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 msgr2=0x7fedec0b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 0x7fedec0b2d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fede400cdc0 tx=0x7fede400a660 comp rx=0 tx=0).stop 2024-03-26T06:18:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 shutdown_connections 2024-03-26T06:18:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fedc806bbd0 0x7fedc806e090 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedec157f90 0x7fedec0b2d80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedec0b39f0 0x7fedec14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 --2- 172.21.15.63:0/3790845662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedec0ae570 0x7fedec150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.186+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 >> 172.21.15.63:0/3790845662 conn(0x7fedec06ac90 msgr2=0x7fedec161920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.187+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 shutdown_connections 2024-03-26T06:18:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.187+0000 7fedf3200640 1 -- 172.21.15.63:0/3790845662 wait complete. 2024-03-26T06:18:10.207 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:18:10.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.421+0000 7f5f41e00640 1 Processor -- start 2024-03-26T06:18:10.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.422+0000 7f5f41e00640 1 -- start start 2024-03-26T06:18:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.423+0000 7f5f41e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c0d1e90 0x7f5f3c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.423+0000 7f5f41e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5f3c0cfe90 0x7f5f3c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.423+0000 7f5f41e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c06d1f0 con 0x7f5f3c15dc70 2024-03-26T06:18:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.423+0000 7f5f41e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0cc480 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.423+0000 7f5f41e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0d0310 con 0x7f5f3c0d1e90 2024-03-26T06:18:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.424+0000 7f5f3b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5f3c0cfe90 0x7f5f3c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.424+0000 7f5f3b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5f3c0cfe90 0x7f5f3c0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44974/0 (socket says 172.21.15.63:44974) 2024-03-26T06:18:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.424+0000 7f5f3b400640 1 -- 172.21.15.63:0/1603813560 learned_addr learned my addr 172.21.15.63:0/1603813560 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.424+0000 7f5f3a000640 1 --2- 172.21.15.63:0/1603813560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c0d1e90 0x7f5f3c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.424+0000 7f5f3b400640 1 -- 172.21.15.63:0/1603813560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c0d1e90 msgr2=0x7f5f3c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:10.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.424+0000 7f5f3b400640 1 --2- 172.21.15.63:0/1603813560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c0d1e90 0x7f5f3c06c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.424+0000 7f5f3b400640 1 -- 172.21.15.63:0/1603813560 >> v1:172.21.15.204:6789/0 conn(0x7f5f3c15dc70 legacy=0x7f5f3c0d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:10.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.424+0000 7f5f3b400640 1 -- 172.21.15.63:0/1603813560 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c06c950 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.424+0000 7f5f3a000640 1 --2- 172.21.15.63:0/1603813560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c0d1e90 0x7f5f3c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:10.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.425+0000 7f5f3b400640 1 --2- 172.21.15.63:0/1603813560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 0x7f5f3c0cbf40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009e50 tx=0x7f5f3402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbe97ee74dacee8 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:10.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.426+0000 7f5f39600640 1 -- 172.21.15.63:0/1603813560 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3402ca70 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.426+0000 7f5f39600640 1 -- 172.21.15.63:0/1603813560 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3402cc10 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.426+0000 7f5f39600640 1 -- 172.21.15.63:0/1603813560 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340343f0 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.426+0000 7f5f41e00640 1 -- 172.21.15.63:0/1603813560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 msgr2=0x7f5f3c0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.426+0000 7f5f41e00640 1 --2- 172.21.15.63:0/1603813560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 0x7f5f3c0cbf40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009e50 tx=0x7f5f3402bed0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.426+0000 7f5f41e00640 1 -- 172.21.15.63:0/1603813560 shutdown_connections 2024-03-26T06:18:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.426+0000 7f5f41e00640 1 --2- 172.21.15.63:0/1603813560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 0x7f5f3c0cbf40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.426+0000 7f5f41e00640 1 --2- 172.21.15.63:0/1603813560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c0d1e90 0x7f5f3c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.426+0000 7f5f41e00640 1 -- 172.21.15.63:0/1603813560 >> 172.21.15.63:0/1603813560 conn(0x7f5f3c071000 msgr2=0x7f5f3c0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.427+0000 7f5f41e00640 1 -- 172.21.15.63:0/1603813560 shutdown_connections 2024-03-26T06:18:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.427+0000 7f5f41e00640 1 -- 172.21.15.63:0/1603813560 wait complete. 2024-03-26T06:18:10.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.428+0000 7f5f41e00640 1 Processor -- start 2024-03-26T06:18:10.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.428+0000 7f5f41e00640 1 -- start start 2024-03-26T06:18:10.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.429+0000 7f5f41e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 0x7f5f3c1485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.429+0000 7f5f41e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f3c0d1e90 0x7f5f3c1f7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.429+0000 7f5f41e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c15dc70 0x7f5f3c1f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.429+0000 7f5f41e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c15e050 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.429+0000 7f5f41e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c06cf10 con 0x7f5f3c0d1e90 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.429+0000 7f5f41e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0ce390 con 0x7f5f3c15dc70 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 0x7f5f3c1485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 0x7f5f3c1485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44978/0 (socket says 172.21.15.63:44978) 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3aa00640 1 -- 172.21.15.63:0/929655799 learned_addr learned my addr 172.21.15.63:0/929655799 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3a000640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f3c0d1e90 0x7f5f3c1f7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3aa00640 1 -- 172.21.15.63:0/929655799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c15dc70 msgr2=0x7f5f3c1f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3aa00640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c15dc70 0x7f5f3c1f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3aa00640 1 -- 172.21.15.63:0/929655799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f3c0d1e90 msgr2=0x7f5f3c1f7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3aa00640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f3c0d1e90 0x7f5f3c1f7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3aa00640 1 -- 172.21.15.63:0/929655799 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c15b2e0 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.430+0000 7f5f3aa00640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 0x7f5f3c1485d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00b3f0 tx=0x7f5f2c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.431+0000 7f5f33400640 1 -- 172.21.15.63:0/929655799 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c015020 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.431+0000 7f5f33400640 1 -- 172.21.15.63:0/929655799 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c011830 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.431+0000 7f5f33400640 1 -- 172.21.15.63:0/929655799 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c011c20 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.431+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c15b5c0 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.431+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c15e550 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.432+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c06df30 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.433+0000 7f5f33400640 1 -- 172.21.15.63:0/929655799 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5f2c018020 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.434+0000 7f5f33400640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5f1806bbd0 0x7f5f1806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.434+0000 7f5f33400640 1 -- 172.21.15.63:0/929655799 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5f2c08a9d0 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.434+0000 7f5f3a000640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5f1806bbd0 0x7f5f1806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.435+0000 7f5f3a000640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5f1806bbd0 0x7f5f1806e090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0b28b0 tx=0x7f5f24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:10.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.439+0000 7f5f33400640 1 -- 172.21.15.63:0/929655799 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f5f2c01f030 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.649+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f3c15e750 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.650+0000 7f5f33400640 1 -- 172.21.15.63:0/929655799 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f3c15e750 con 0x7f5f3c0cfe90 2024-03-26T06:18:10.652 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5f1806bbd0 msgr2=0x7f5f1806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5f1806bbd0 0x7f5f1806e090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0b28b0 tx=0x7f5f24008040 comp rx=0 tx=0).stop 2024-03-26T06:18:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 msgr2=0x7f5f3c1485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 0x7f5f3c1485d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00b3f0 tx=0x7f5f2c00b8b0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 shutdown_connections 2024-03-26T06:18:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f5f1806bbd0 0x7f5f1806e090 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5f3c15dc70 0x7f5f3c1f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5f3c0d1e90 0x7f5f3c1f7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 --2- 172.21.15.63:0/929655799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f3c0cfe90 0x7f5f3c1485d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 >> 172.21.15.63:0/929655799 conn(0x7f5f3c071000 msgr2=0x7f5f3c0d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 shutdown_connections 2024-03-26T06:18:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.653+0000 7f5f41e00640 1 -- 172.21.15.63:0/929655799 wait complete. 2024-03-26T06:18:10.674 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:18:10.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.901+0000 7f9fc5a00640 1 Processor -- start 2024-03-26T06:18:10.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.902+0000 7f9fc5a00640 1 -- start start 2024-03-26T06:18:10.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.903+0000 7f9fc5a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9fc00d3840 0x7f9fc00d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.903+0000 7f9fc5a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9fc015dca0 0x7f9fc00d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.903+0000 7f9fc5a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc00d4160 con 0x7f9fc00b9320 2024-03-26T06:18:10.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.903+0000 7f9fc5a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc00d22d0 con 0x7f9fc015dca0 2024-03-26T06:18:10.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.903+0000 7f9fc5a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc00d25b0 con 0x7f9fc00d3840 2024-03-26T06:18:10.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.903+0000 7f9fb7e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9fc015dca0 0x7f9fc00d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.904+0000 7f9fb7e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9fc015dca0 0x7f9fc00d1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36260/0 (socket says 172.21.15.63:36260) 2024-03-26T06:18:10.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.904+0000 7f9fb7e00640 1 -- 172.21.15.63:0/4169871774 learned_addr learned my addr 172.21.15.63:0/4169871774 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:10.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.904+0000 7f9fbfe00640 1 --2- 172.21.15.63:0/4169871774 >> v2:172.21.15.204:3300/0 conn(0x7f9fc00d3840 0x7f9fc00d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.904+0000 7f9fb7e00640 1 -- 172.21.15.63:0/4169871774 >> v2:172.21.15.204:3300/0 conn(0x7f9fc00d3840 msgr2=0x7f9fc00d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:10.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.904+0000 7f9fb7e00640 1 --2- 172.21.15.63:0/4169871774 >> v2:172.21.15.204:3300/0 conn(0x7f9fc00d3840 0x7f9fc00d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.904+0000 7f9fb7e00640 1 -- 172.21.15.63:0/4169871774 >> v1:172.21.15.204:6789/0 conn(0x7f9fc00b9320 legacy=0x7f9fc00b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:10.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.904+0000 7f9fb7e00640 1 -- 172.21.15.63:0/4169871774 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00d2890 con 0x7f9fc015dca0 2024-03-26T06:18:10.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.905+0000 7f9fb7e00640 1 --2- 172.21.15.63:0/4169871774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc015dca0 0x7f9fc00d1960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00d49b0 tx=0x7f9fa802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d68d38fc4cc8b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:10.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.905+0000 7f9fbf400640 1 -- 172.21.15.63:0/4169871774 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8035020 con 0x7f9fc015dca0 2024-03-26T06:18:10.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.905+0000 7f9fbf400640 1 -- 172.21.15.63:0/4169871774 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa8031870 con 0x7f9fc015dca0 2024-03-26T06:18:10.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.905+0000 7f9fbf400640 1 -- 172.21.15.63:0/4169871774 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8031c40 con 0x7f9fc015dca0 2024-03-26T06:18:10.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.906+0000 7f9fc5a00640 1 -- 172.21.15.63:0/4169871774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc015dca0 msgr2=0x7f9fc00d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.906+0000 7f9fc5a00640 1 --2- 172.21.15.63:0/4169871774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc015dca0 0x7f9fc00d1960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00d49b0 tx=0x7f9fa802b910 comp rx=0 tx=0).stop 2024-03-26T06:18:10.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.906+0000 7f9fc5a00640 1 -- 172.21.15.63:0/4169871774 shutdown_connections 2024-03-26T06:18:10.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.906+0000 7f9fc5a00640 1 --2- 172.21.15.63:0/4169871774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc015dca0 0x7f9fc00d1960 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.906+0000 7f9fc5a00640 1 --2- 172.21.15.63:0/4169871774 >> v2:172.21.15.204:3300/0 conn(0x7f9fc00d3840 0x7f9fc00d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.906+0000 7f9fc5a00640 1 -- 172.21.15.63:0/4169871774 >> 172.21.15.63:0/4169871774 conn(0x7f9fc006c570 msgr2=0x7f9fc006c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:10.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.906+0000 7f9fc5a00640 1 -- 172.21.15.63:0/4169871774 shutdown_connections 2024-03-26T06:18:10.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.906+0000 7f9fc5a00640 1 -- 172.21.15.63:0/4169871774 wait complete. 2024-03-26T06:18:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.908+0000 7f9fc5a00640 1 Processor -- start 2024-03-26T06:18:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.908+0000 7f9fc5a00640 1 -- start start 2024-03-26T06:18:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.909+0000 7f9fc5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc00b9320 0x7f9fc014d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.909+0000 7f9fc5a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc00d3840 0x7f9fc00b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.909+0000 7f9fc5a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc015dca0 0x7f9fc014cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.909+0000 7f9fc5a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00d1ea0 con 0x7f9fc00b9320 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.909+0000 7f9fc5a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00d2e50 con 0x7f9fc00d3840 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.909+0000 7f9fc5a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00d2020 con 0x7f9fc015dca0 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.909+0000 7f9fbfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc00b9320 0x7f9fc014d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fbfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc00b9320 0x7f9fc014d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36264/0 (socket says 172.21.15.63:36264) 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fbfe00640 1 -- 172.21.15.63:0/2754842469 learned_addr learned my addr 172.21.15.63:0/2754842469 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fb7e00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc00d3840 0x7f9fc00b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fc5000640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc015dca0 0x7f9fc014cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fbfe00640 1 -- 172.21.15.63:0/2754842469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc015dca0 msgr2=0x7f9fc014cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fbfe00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc015dca0 0x7f9fc014cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fbfe00640 1 -- 172.21.15.63:0/2754842469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc00d3840 msgr2=0x7f9fc00b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fbfe00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc00d3840 0x7f9fc00b7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fbfe00640 1 -- 172.21.15.63:0/2754842469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00cd350 con 0x7f9fc00b9320 2024-03-26T06:18:10.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fc5000640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc015dca0 0x7f9fc014cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:10.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.910+0000 7f9fbfe00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc00b9320 0x7f9fc014d040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000d830 tx=0x7f9fb000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:10.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.911+0000 7f9fbcc00640 1 -- 172.21.15.63:0/2754842469 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000b6c0 con 0x7f9fc00b9320 2024-03-26T06:18:10.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.911+0000 7f9fbcc00640 1 -- 172.21.15.63:0/2754842469 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb0019070 con 0x7f9fc00b9320 2024-03-26T06:18:10.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.911+0000 7f9fbcc00640 1 -- 172.21.15.63:0/2754842469 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000ba80 con 0x7f9fc00b9320 2024-03-26T06:18:10.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.911+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc00cd630 con 0x7f9fc00b9320 2024-03-26T06:18:10.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.911+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc00c8660 con 0x7f9fc00b9320 2024-03-26T06:18:10.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.912+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc004f0c0 con 0x7f9fc00b9320 2024-03-26T06:18:10.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.913+0000 7f9fbcc00640 1 -- 172.21.15.63:0/2754842469 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9fb001e460 con 0x7f9fc00b9320 2024-03-26T06:18:10.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.914+0000 7f9fbcc00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9f9c06bbd0 0x7f9f9c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:10.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.914+0000 7f9fbcc00640 1 -- 172.21.15.63:0/2754842469 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9fb008b5a0 con 0x7f9fc00b9320 2024-03-26T06:18:10.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.914+0000 7f9fb7e00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9f9c06bbd0 0x7f9f9c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:10.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.915+0000 7f9fb7e00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9f9c06bbd0 0x7f9f9c06e090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8036000 tx=0x7f9fa803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:10.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:10.918+0000 7f9fbcc00640 1 -- 172.21.15.63:0/2754842469 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f9fb0059c80 con 0x7f9fc00b9320 2024-03-26T06:18:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.121+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fc015f260 con 0x7f9fc00b9320 2024-03-26T06:18:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.122+0000 7f9fbcc00640 1 -- 172.21.15.63:0/2754842469 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fb0059580 con 0x7f9fc00b9320 2024-03-26T06:18:11.123 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:18:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.124+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9f9c06bbd0 msgr2=0x7f9f9c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.124+0000 7f9fc5a00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9f9c06bbd0 0x7f9f9c06e090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8036000 tx=0x7f9fa803c040 comp rx=0 tx=0).stop 2024-03-26T06:18:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc00b9320 msgr2=0x7f9fc014d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc00b9320 0x7f9fc014d040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000d830 tx=0x7f9fb000dcf0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 shutdown_connections 2024-03-26T06:18:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9f9c06bbd0 0x7f9f9c06e090 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc015dca0 0x7f9fc014cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc00d3840 0x7f9fc00b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 --2- 172.21.15.63:0/2754842469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc00b9320 0x7f9fc014d040 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 >> 172.21.15.63:0/2754842469 conn(0x7f9fc006c570 msgr2=0x7f9fc00b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 shutdown_connections 2024-03-26T06:18:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.125+0000 7f9fc5a00640 1 -- 172.21.15.63:0/2754842469 wait complete. 2024-03-26T06:18:11.144 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:18:11.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.367+0000 7f6e41800640 1 Processor -- start 2024-03-26T06:18:11.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.368+0000 7f6e41800640 1 -- start start 2024-03-26T06:18:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.369+0000 7f6e41800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6e3c06d270 0x7f6e3c071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.369+0000 7f6e41800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3c15f410 con 0x7f6e3c13eca0 2024-03-26T06:18:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.369+0000 7f6e41800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3c15f6f0 con 0x7f6e3c13e650 2024-03-26T06:18:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.369+0000 7f6e41800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3c15f9d0 con 0x7f6e3c06d270 2024-03-26T06:18:11.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.370+0000 7f6e40e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6e3c13eca0 0x7f6e3c140d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35566/0 (socket says 172.21.15.63:35566) 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.370+0000 7f6e40e00640 1 -- 172.21.15.63:0/3935465630 learned_addr learned my addr 172.21.15.63:0/3935465630 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.370+0000 7f6e33e00640 1 --2- 172.21.15.63:0/3935465630 >> v2:172.21.15.204:3300/0 conn(0x7f6e3c06d270 0x7f6e3c071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.370+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258397145 0 0) 0x7f6e3c15f410 con 0x7f6e3c13eca0 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.370+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e20003520 con 0x7f6e3c13eca0 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.370+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3585697390 0 0) 0x7f6e20003520 con 0x7f6e3c13eca0 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 >> v2:172.21.15.204:3300/0 conn(0x7f6e3c06d270 msgr2=0x7f6e3c071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 --2- 172.21.15.63:0/3935465630 >> v2:172.21.15.204:3300/0 conn(0x7f6e3c06d270 0x7f6e3c071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 >> v1:172.21.15.204:6789/0 conn(0x7f6e3c13e650 legacy=0x7f6e3c06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c15fcb0 con 0x7f6e3c13eca0 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f6e340019f0 con 0x7f6e3c13eca0 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 >> v1:172.21.15.63:6789/0 conn(0x7f6e3c13eca0 legacy=0x7f6e3c140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6e200039e0 0x7f6e20003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e20004800 0x7f6e20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e200051c0 0x7f6e2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c15f9d0 con 0x7f6e200051c0 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2000c090 con 0x7f6e200039e0 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2000c290 con 0x7f6e20004800 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e40e00640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e200051c0 0x7f6e2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e40e00640 1 -- 172.21.15.63:0/3935465630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e20004800 msgr2=0x7f6e20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.371+0000 7f6e33e00640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e20004800 0x7f6e20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.372+0000 7f6e40e00640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e20004800 0x7f6e20004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.372+0000 7f6e40e00640 1 -- 172.21.15.63:0/3935465630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6e200039e0 msgr2=0x7f6e20003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.372+0000 7f6e40e00640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6e200039e0 0x7f6e20003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.372+0000 7f6e40e00640 1 -- 172.21.15.63:0/3935465630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20003520 con 0x7f6e200051c0 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.372+0000 7f6e40e00640 1 -- 172.21.15.63:0/3935465630 reap_dead start 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.373+0000 7f6e40e00640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e200051c0 0x7f6e2000b9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400a800 tx=0x7f6e20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca933139e0c0490c server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.373+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3400a450 con 0x7f6e200051c0 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.373+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34034670 con 0x7f6e200051c0 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.373+0000 7f6e3b400640 1 -- 172.21.15.63:0/3935465630 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34034a60 con 0x7f6e200051c0 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.373+0000 7f6e41800640 1 -- 172.21.15.63:0/3935465630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e200051c0 msgr2=0x7f6e2000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.373+0000 7f6e41800640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e200051c0 0x7f6e2000b9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400a800 tx=0x7f6e20005830 comp rx=0 tx=0).stop 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.374+0000 7f6e41800640 1 -- 172.21.15.63:0/3935465630 shutdown_connections 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.374+0000 7f6e41800640 1 --2- 172.21.15.63:0/3935465630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e200051c0 0x7f6e2000b9c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.374+0000 7f6e41800640 1 -- 172.21.15.63:0/3935465630 >> 172.21.15.63:0/3935465630 conn(0x7f6e3c0670b0 msgr2=0x7f6e3c0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.374+0000 7f6e41800640 1 -- 172.21.15.63:0/3935465630 shutdown_connections 2024-03-26T06:18:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.374+0000 7f6e41800640 1 -- 172.21.15.63:0/3935465630 wait complete. 2024-03-26T06:18:11.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.376+0000 7f6e41800640 1 Processor -- start 2024-03-26T06:18:11.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.376+0000 7f6e41800640 1 -- start start 2024-03-26T06:18:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e41800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6e200051c0 0x7f6e3c13c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e41800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c15ad00 0x7f6e3c15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e41800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e3c156f30 0x7f6e3c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e41800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c06dc70 con 0x7f6e3c15ad00 2024-03-26T06:18:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e41800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c06daf0 con 0x7f6e200051c0 2024-03-26T06:18:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e41800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c06ddf0 con 0x7f6e3c156f30 2024-03-26T06:18:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e33e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c15ad00 0x7f6e3c15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e33e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c15ad00 0x7f6e3c15b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36284/0 (socket says 172.21.15.63:36284) 2024-03-26T06:18:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e33e00640 1 -- 172.21.15.63:0/164955645 learned_addr learned my addr 172.21.15.63:0/164955645 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e33e00640 1 -- 172.21.15.63:0/164955645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e3c156f30 msgr2=0x7f6e3c1573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e3be00640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6e200051c0 0x7f6e3c13c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e33e00640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e3c156f30 0x7f6e3c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e33e00640 1 -- 172.21.15.63:0/164955645 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6e200051c0 msgr2=0x7f6e3c13c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e33e00640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6e200051c0 0x7f6e3c13c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e33e00640 1 -- 172.21.15.63:0/164955645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c159130 con 0x7f6e3c15ad00 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.377+0000 7f6e3be00640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6e200051c0 0x7f6e3c13c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.378+0000 7f6e33e00640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c15ad00 0x7f6e3c15b180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e240108c0 tx=0x7f6e24010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.378+0000 7f6e38c00640 1 -- 172.21.15.63:0/164955645 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400f040 con 0x7f6e3c15ad00 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.378+0000 7f6e38c00640 1 -- 172.21.15.63:0/164955645 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2400eb20 con 0x7f6e3c15ad00 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.378+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3c156450 con 0x7f6e3c15ad00 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.378+0000 7f6e38c00640 1 -- 172.21.15.63:0/164955645 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2401c400 con 0x7f6e3c15ad00 2024-03-26T06:18:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.378+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c0affe0 con 0x7f6e3c15ad00 2024-03-26T06:18:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.380+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3c04f0c0 con 0x7f6e3c15ad00 2024-03-26T06:18:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.380+0000 7f6e38c00640 1 -- 172.21.15.63:0/164955645 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6e240253f0 con 0x7f6e3c15ad00 2024-03-26T06:18:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.381+0000 7f6e38c00640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6e1806bc00 0x7f6e1806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.381+0000 7f6e38c00640 1 -- 172.21.15.63:0/164955645 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6e2408b4d0 con 0x7f6e3c15ad00 2024-03-26T06:18:11.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.382+0000 7f6e3be00640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6e1806bc00 0x7f6e1806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.382+0000 7f6e3be00640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6e1806bc00 0x7f6e1806e0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0016d0 tx=0x7f6e2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:11.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.386+0000 7f6e38c00640 1 -- 172.21.15.63:0/164955645 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f6e24018030 con 0x7f6e3c15ad00 2024-03-26T06:18:11.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.586+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6e3c06e2a0 con 0x7f6e3c15ad00 2024-03-26T06:18:11.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.587+0000 7f6e38c00640 1 -- 172.21.15.63:0/164955645 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6e24059c50 con 0x7f6e3c15ad00 2024-03-26T06:18:11.588 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:11.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.589+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6e1806bc00 msgr2=0x7f6e1806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.589+0000 7f6e41800640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6e1806bc00 0x7f6e1806e0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0016d0 tx=0x7f6e2c009040 comp rx=0 tx=0).stop 2024-03-26T06:18:11.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c15ad00 msgr2=0x7f6e3c15b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c15ad00 0x7f6e3c15b180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e240108c0 tx=0x7f6e24010d80 comp rx=0 tx=0).stop 2024-03-26T06:18:11.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 shutdown_connections 2024-03-26T06:18:11.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f6e1806bc00 0x7f6e1806e0c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e3c156f30 0x7f6e3c1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c15ad00 0x7f6e3c15b180 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 --2- 172.21.15.63:0/164955645 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6e200051c0 0x7f6e3c13c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 >> 172.21.15.63:0/164955645 conn(0x7f6e3c0670b0 msgr2=0x7f6e3c13c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:11.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 shutdown_connections 2024-03-26T06:18:11.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.590+0000 7f6e41800640 1 -- 172.21.15.63:0/164955645 wait complete. 2024-03-26T06:18:11.611 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-26T06:18:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.834+0000 7effb8200640 1 Processor -- start 2024-03-26T06:18:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.835+0000 7effb8200640 1 -- start start 2024-03-26T06:18:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.836+0000 7effb8200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effb015dbb0 0x7effb00d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.836+0000 7effb8200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7effb00d0b30 0x7effb00b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.836+0000 7effb8200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb00d2490 con 0x7effb015df90 2024-03-26T06:18:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.836+0000 7effb8200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00d2770 con 0x7effb015dbb0 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.836+0000 7effb8200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00d2a50 con 0x7effb00d0b30 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb5800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effb015dbb0 0x7effb00d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb4e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7effb015df90 0x7effb00d0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35578/0 (socket says 172.21.15.63:35578) 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb5800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effb015dbb0 0x7effb00d1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36286/0 (socket says 172.21.15.63:36286) 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb4e00640 1 -- 172.21.15.63:0/2912602540 learned_addr learned my addr 172.21.15.63:0/2912602540 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb6200640 1 --2- 172.21.15.63:0/2912602540 >> v2:172.21.15.204:3300/0 conn(0x7effb00d0b30 0x7effb00b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb5800640 1 -- 172.21.15.63:0/2912602540 >> v2:172.21.15.204:3300/0 conn(0x7effb00d0b30 msgr2=0x7effb00b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb5800640 1 --2- 172.21.15.63:0/2912602540 >> v2:172.21.15.204:3300/0 conn(0x7effb00d0b30 0x7effb00b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb5800640 1 -- 172.21.15.63:0/2912602540 >> v1:172.21.15.63:6789/0 conn(0x7effb015df90 legacy=0x7effb00d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb5800640 1 -- 172.21.15.63:0/2912602540 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00d2d30 con 0x7effb015dbb0 2024-03-26T06:18:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.837+0000 7effb6200640 1 --2- 172.21.15.63:0/2912602540 >> v2:172.21.15.204:3300/0 conn(0x7effb00d0b30 0x7effb00b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.838+0000 7effb5800640 1 --2- 172.21.15.63:0/2912602540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 0x7effb00d1bb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7effb00b9160 tx=0x7effa402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfea24240a309639 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.839+0000 7effafe00640 1 -- 172.21.15.63:0/2912602540 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4039070 con 0x7effb015dbb0 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.839+0000 7effafe00640 1 -- 172.21.15.63:0/2912602540 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa402cd10 con 0x7effb015dbb0 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.839+0000 7effafe00640 1 -- 172.21.15.63:0/2912602540 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4034660 con 0x7effb015dbb0 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.839+0000 7effb8200640 1 -- 172.21.15.63:0/2912602540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 msgr2=0x7effb00d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.839+0000 7effb8200640 1 --2- 172.21.15.63:0/2912602540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 0x7effb00d1bb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7effb00b9160 tx=0x7effa402bf60 comp rx=0 tx=0).stop 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.840+0000 7effb8200640 1 -- 172.21.15.63:0/2912602540 shutdown_connections 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.840+0000 7effb8200640 1 --2- 172.21.15.63:0/2912602540 >> v2:172.21.15.204:3300/0 conn(0x7effb00d0b30 0x7effb00b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.840+0000 7effb8200640 1 --2- 172.21.15.63:0/2912602540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 0x7effb00d1bb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.840+0000 7effb8200640 1 -- 172.21.15.63:0/2912602540 >> 172.21.15.63:0/2912602540 conn(0x7effb00b5540 msgr2=0x7effb00b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:11.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.840+0000 7effb8200640 1 -- 172.21.15.63:0/2912602540 shutdown_connections 2024-03-26T06:18:11.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.840+0000 7effb8200640 1 -- 172.21.15.63:0/2912602540 wait complete. 2024-03-26T06:18:11.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.841+0000 7effb8200640 1 Processor -- start 2024-03-26T06:18:11.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.842+0000 7effb8200640 1 -- start start 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.842+0000 7effb8200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effb00d0b30 0x7effb0149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.842+0000 7effb8200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 0x7effb00cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb8200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effb015df90 0x7effb01e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb8200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb00d36b0 con 0x7effb015dbb0 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb8200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb00d3530 con 0x7effb015df90 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb8200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb00b96e0 con 0x7effb00d0b30 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb4e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 0x7effb00cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb4e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 0x7effb00cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36288/0 (socket says 172.21.15.63:36288) 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb4e00640 1 -- 172.21.15.63:0/2853345036 learned_addr learned my addr 172.21.15.63:0/2853345036 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb5800640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effb00d0b30 0x7effb0149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb4e00640 1 -- 172.21.15.63:0/2853345036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effb00d0b30 msgr2=0x7effb0149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb4e00640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effb00d0b30 0x7effb0149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb6200640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effb015df90 0x7effb01e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb4e00640 1 -- 172.21.15.63:0/2853345036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effb015df90 msgr2=0x7effb01e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb4e00640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effb015df90 0x7effb01e54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb4e00640 1 -- 172.21.15.63:0/2853345036 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00cd150 con 0x7effb015dbb0 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.843+0000 7effb6200640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effb015df90 0x7effb01e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.844+0000 7effb4e00640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 0x7effb00cc690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c440 tx=0x7eff9c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.844+0000 7effad600640 1 -- 172.21.15.63:0/2853345036 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c017070 con 0x7effb015dbb0 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.844+0000 7effad600640 1 -- 172.21.15.63:0/2853345036 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c005ce0 con 0x7effb015dbb0 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.844+0000 7effad600640 1 -- 172.21.15.63:0/2853345036 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0072f0 con 0x7effb015dbb0 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.844+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb00cd430 con 0x7effb015dbb0 2024-03-26T06:18:11.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.844+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb01e3610 con 0x7effb015dbb0 2024-03-26T06:18:11.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.845+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb00cfcb0 con 0x7effb015dbb0 2024-03-26T06:18:11.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.846+0000 7effad600640 1 -- 172.21.15.63:0/2853345036 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7eff9c01a070 con 0x7effb015dbb0 2024-03-26T06:18:11.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.847+0000 7effad600640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7eff9006bbd0 0x7eff9006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:11.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.847+0000 7effad600640 1 -- 172.21.15.63:0/2853345036 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7eff9c08a270 con 0x7effb015dbb0 2024-03-26T06:18:11.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.847+0000 7effb5800640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7eff9006bbd0 0x7eff9006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:11.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.848+0000 7effb5800640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7eff9006bbd0 0x7eff9006e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7effa4036000 tx=0x7effa4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:11.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:11.851+0000 7effad600640 1 -- 172.21.15.63:0/2853345036 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7effb00cfcb0 con 0x7effb015dbb0 2024-03-26T06:18:12.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.071+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7effb01e3810 con 0x7effb015dbb0 2024-03-26T06:18:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.072+0000 7effad600640 1 -- 172.21.15.63:0/2853345036 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7effb01e3810 con 0x7effb015dbb0 2024-03-26T06:18:12.074 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-03-26T06:18:12.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7eff9006bbd0 msgr2=0x7eff9006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7eff9006bbd0 0x7eff9006e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7effa4036000 tx=0x7effa4030000 comp rx=0 tx=0).stop 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 msgr2=0x7effb00cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 0x7effb00cc690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c440 tx=0x7eff9c00c900 comp rx=0 tx=0).stop 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 shutdown_connections 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7eff9006bbd0 0x7eff9006e090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effb015df90 0x7effb01e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effb015dbb0 0x7effb00cc690 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 --2- 172.21.15.63:0/2853345036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effb00d0b30 0x7effb0149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 >> 172.21.15.63:0/2853345036 conn(0x7effb00b5540 msgr2=0x7effb00c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 shutdown_connections 2024-03-26T06:18:12.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.075+0000 7effb8200640 1 -- 172.21.15.63:0/2853345036 wait complete. 2024-03-26T06:18:12.094 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-26T06:18:12.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:12.094 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-26T06:18:12.201 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T06:18:12.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:12.201 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-26T06:18:12.252 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:18:12.252 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:12.309 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:18:12.309 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:12.360 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T06:18:12.360 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:12.458 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:12.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.687+0000 7fbcd0800640 1 Processor -- start 2024-03-26T06:18:12.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.687+0000 7fbcd0800640 1 -- start start 2024-03-26T06:18:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.689+0000 7fbcd0800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbcc81440f0 0x7fbcc815f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.689+0000 7fbcd0800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc80ae980 con 0x7fbcc8071350 2024-03-26T06:18:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.689+0000 7fbcd0800640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc80af1d0 con 0x7fbcc80ae530 2024-03-26T06:18:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.689+0000 7fbcd0800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc80aec10 con 0x7fbcc81440f0 2024-03-26T06:18:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.689+0000 7fbccde00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbcc81440f0 0x7fbcc815f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.689+0000 7fbccde00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbcc81440f0 0x7fbcc815f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36294/0 (socket says 172.21.15.63:36294) 2024-03-26T06:18:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.689+0000 7fbccde00640 1 -- 172.21.15.63:0/3526336709 learned_addr learned my addr 172.21.15.63:0/3526336709 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:12.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.690+0000 7fbccca00640 1 -- 172.21.15.63:0/3526336709 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586845718 0 0) 0x7fbcc80ae980 con 0x7fbcc8071350 2024-03-26T06:18:12.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.690+0000 7fbccca00640 1 -- 172.21.15.63:0/3526336709 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcb0003520 con 0x7fbcc8071350 2024-03-26T06:18:12.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.690+0000 7fbccde00640 1 -- 172.21.15.63:0/3526336709 >> v1:172.21.15.204:6789/0 conn(0x7fbcc80ae530 legacy=0x7fbcc806dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:12.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.690+0000 7fbccde00640 1 -- 172.21.15.63:0/3526336709 >> v1:172.21.15.63:6789/0 conn(0x7fbcc8071350 legacy=0x7fbcc80ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:12.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.690+0000 7fbccde00640 1 -- 172.21.15.63:0/3526336709 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc80aeef0 con 0x7fbcc81440f0 2024-03-26T06:18:12.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.691+0000 7fbccde00640 1 --2- 172.21.15.63:0/3526336709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc81440f0 0x7fbcc815f3a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009870 tx=0x7fbcbc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e866ac8bb802a7a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:12.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.692+0000 7fbccca00640 1 -- 172.21.15.63:0/3526336709 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc02f840 con 0x7fbcc81440f0 2024-03-26T06:18:12.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.692+0000 7fbccca00640 1 -- 172.21.15.63:0/3526336709 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc02f9e0 con 0x7fbcc81440f0 2024-03-26T06:18:12.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.692+0000 7fbccca00640 1 -- 172.21.15.63:0/3526336709 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc02fdb0 con 0x7fbcc81440f0 2024-03-26T06:18:12.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.692+0000 7fbcd0800640 1 -- 172.21.15.63:0/3526336709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc81440f0 msgr2=0x7fbcc815f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:12.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.692+0000 7fbcd0800640 1 --2- 172.21.15.63:0/3526336709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc81440f0 0x7fbcc815f3a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009870 tx=0x7fbcbc02ba20 comp rx=0 tx=0).stop 2024-03-26T06:18:12.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.693+0000 7fbcd0800640 1 -- 172.21.15.63:0/3526336709 shutdown_connections 2024-03-26T06:18:12.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.693+0000 7fbcd0800640 1 --2- 172.21.15.63:0/3526336709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc81440f0 0x7fbcc815f3a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.693+0000 7fbcd0800640 1 -- 172.21.15.63:0/3526336709 >> 172.21.15.63:0/3526336709 conn(0x7fbcc806ac90 msgr2=0x7fbcc806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:12.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.693+0000 7fbcd0800640 1 -- 172.21.15.63:0/3526336709 shutdown_connections 2024-03-26T06:18:12.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.693+0000 7fbcd0800640 1 -- 172.21.15.63:0/3526336709 wait complete. 2024-03-26T06:18:12.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.694+0000 7fbcd0800640 1 Processor -- start 2024-03-26T06:18:12.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.695+0000 7fbcd0800640 1 -- start start 2024-03-26T06:18:12.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.696+0000 7fbcd0800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcc8071350 0x7fbcc80b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:12.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.696+0000 7fbcd0800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc80ae530 0x7fbcc81589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.696+0000 7fbcd0800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcc81440f0 0x7fbcc8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.696+0000 7fbcd0800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc81444d0 con 0x7fbcc80ae530 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.696+0000 7fbcd0800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc815f8e0 con 0x7fbcc81440f0 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.696+0000 7fbcd0800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc806e360 con 0x7fbcc8071350 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.696+0000 7fbccd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc80ae530 0x7fbcc81589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.696+0000 7fbccd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc80ae530 0x7fbcc81589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36300/0 (socket says 172.21.15.63:36300) 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.696+0000 7fbccd400640 1 -- 172.21.15.63:0/225172818 learned_addr learned my addr 172.21.15.63:0/225172818 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbccde00640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcc8071350 0x7fbcc80b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbcce800640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcc81440f0 0x7fbcc8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbccd400640 1 -- 172.21.15.63:0/225172818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcc8071350 msgr2=0x7fbcc80b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbccd400640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcc8071350 0x7fbcc80b3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbccd400640 1 -- 172.21.15.63:0/225172818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcc81440f0 msgr2=0x7fbcc8158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbccd400640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcc81440f0 0x7fbcc8158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbccd400640 1 -- 172.21.15.63:0/225172818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8159870 con 0x7fbcc80ae530 2024-03-26T06:18:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbcce800640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcc81440f0 0x7fbcc8158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbccd400640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc80ae530 0x7fbcc81589d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800c490 tx=0x7fbcb800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbcc2000640 1 -- 172.21.15.63:0/225172818 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb80052d0 con 0x7fbcc80ae530 2024-03-26T06:18:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbcc2000640 1 -- 172.21.15.63:0/225172818 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb8005470 con 0x7fbcc80ae530 2024-03-26T06:18:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbcc2000640 1 -- 172.21.15.63:0/225172818 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8012850 con 0x7fbcc80ae530 2024-03-26T06:18:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.697+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc8159bb0 con 0x7fbcc80ae530 2024-03-26T06:18:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.698+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc8159560 con 0x7fbcc80ae530 2024-03-26T06:18:12.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.699+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc8074730 con 0x7fbcc80ae530 2024-03-26T06:18:12.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.700+0000 7fbcc2000640 1 -- 172.21.15.63:0/225172818 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbcb80129f0 con 0x7fbcc80ae530 2024-03-26T06:18:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.701+0000 7fbcc2000640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbcac06bc20 0x7fbcac06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.701+0000 7fbcc2000640 1 -- 172.21.15.63:0/225172818 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbcb808ab70 con 0x7fbcc80ae530 2024-03-26T06:18:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.701+0000 7fbccde00640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbcac06bc20 0x7fbcac06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.702+0000 7fbccde00640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbcac06bc20 0x7fbcac06e0e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc036000 tx=0x7fbcbc039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:12.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.705+0000 7fbcc2000640 1 -- 172.21.15.63:0/225172818 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fbcc8159bb0 con 0x7fbcc80ae530 2024-03-26T06:18:12.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.911+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcc806b110 con 0x7fbcc80ae530 2024-03-26T06:18:12.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.914+0000 7fbcc2000640 1 -- 172.21.15.63:0/225172818 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7fbcb8059240 con 0x7fbcc80ae530 2024-03-26T06:18:12.916 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:12.916 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbcac06bc20 msgr2=0x7fbcac06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbcac06bc20 0x7fbcac06e0e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc036000 tx=0x7fbcbc039040 comp rx=0 tx=0).stop 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc80ae530 msgr2=0x7fbcc81589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc80ae530 0x7fbcc81589d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800c490 tx=0x7fbcb800c950 comp rx=0 tx=0).stop 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 shutdown_connections 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbcac06bc20 0x7fbcac06e0e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcc81440f0 0x7fbcc8158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc80ae530 0x7fbcc81589d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 --2- 172.21.15.63:0/225172818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcc8071350 0x7fbcc80b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 >> 172.21.15.63:0/225172818 conn(0x7fbcc806ac90 msgr2=0x7fbcc815be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 shutdown_connections 2024-03-26T06:18:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:12.917+0000 7fbcd0800640 1 -- 172.21.15.63:0/225172818 wait complete. 2024-03-26T06:18:12.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:18:12.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:18:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.158+0000 7f3922800640 1 Processor -- start 2024-03-26T06:18:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.158+0000 7f3922800640 1 -- start start 2024-03-26T06:18:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.160+0000 7f3922800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c15d770 0x7f391c0b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.160+0000 7f3922800640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f391c0d0840 0x7f391c0d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.160+0000 7f3922800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c0d2a10 con 0x7f391c15db50 2024-03-26T06:18:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.160+0000 7f3922800640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0d11d0 con 0x7f391c0d0840 2024-03-26T06:18:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.160+0000 7f3922800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0d2cf0 con 0x7f391c15d770 2024-03-26T06:18:13.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.160+0000 7f3920a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f391c15db50 0x7f391c0ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35598/0 (socket says 172.21.15.63:35598) 2024-03-26T06:18:13.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.160+0000 7f3920a00640 1 -- 172.21.15.63:0/3653043900 learned_addr learned my addr 172.21.15.63:0/3653043900 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f3921e00640 1 --2- 172.21.15.63:0/3653043900 >> v2:172.21.15.204:3300/0 conn(0x7f391c0d0840 0x7f391c0d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f3921400640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c15d770 0x7f391c0b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219441337 0 0) 0x7f391c0d2a10 con 0x7f391c15db50 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3904003520 con 0x7f391c15db50 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048462592 0 0) 0x7f3904003520 con 0x7f391c15db50 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c15d770 msgr2=0x7f391c0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c15d770 0x7f391c0b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 >> v2:172.21.15.204:3300/0 conn(0x7f391c0d0840 msgr2=0x7f391c0d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 --2- 172.21.15.63:0/3653043900 >> v2:172.21.15.204:3300/0 conn(0x7f391c0d0840 0x7f391c0d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0d2fd0 con 0x7f391c15db50 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f3908001670 con 0x7f391c15db50 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 >> v1:172.21.15.63:6789/0 conn(0x7f391c15db50 legacy=0x7f391c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39040039b0 0x7f3904003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c15d770 0x7f3904004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.161+0000 7f391be00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3904004d40 0x7f39040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0d11d0 con 0x7f3904004d40 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0d2cf0 con 0x7f39040039b0 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390400b9c0 con 0x7f391c15d770 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f3921e00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3904004d40 0x7f39040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f3921400640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39040039b0 0x7f3904003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f3920a00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c15d770 0x7f3904004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f3921e00640 1 -- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c15d770 msgr2=0x7f3904004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f3921e00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c15d770 0x7f3904004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f3921e00640 1 -- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39040039b0 msgr2=0x7f3904003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f3921e00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39040039b0 0x7f3904003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f3921e00640 1 -- 172.21.15.63:0/3653043900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3904003520 con 0x7f3904004d40 2024-03-26T06:18:13.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.162+0000 7f3920a00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c15d770 0x7f3904004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.163+0000 7f3921e00640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3904004d40 0x7f39040051c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3914009fc0 tx=0x7f3904005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c99024f906e563 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.164+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914039070 con 0x7f3904004d40 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.164+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391402cc50 con 0x7f3904004d40 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.164+0000 7f391be00640 1 -- 172.21.15.63:0/3653043900 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914009c10 con 0x7f3904004d40 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.164+0000 7f3922800640 1 -- 172.21.15.63:0/3653043900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3904004d40 msgr2=0x7f39040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.164+0000 7f3922800640 1 --2- 172.21.15.63:0/3653043900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3904004d40 0x7f39040051c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3914009fc0 tx=0x7f3904005830 comp rx=0 tx=0).stop 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.164+0000 7f3921e00640 1 -- 172.21.15.63:0/3653043900 reap_dead start 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.164+0000 7f3922800640 1 -- 172.21.15.63:0/3653043900 shutdown_connections 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.164+0000 7f3922800640 1 -- 172.21.15.63:0/3653043900 >> 172.21.15.63:0/3653043900 conn(0x7f391c06c570 msgr2=0x7f391c06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.164+0000 7f3922800640 1 -- 172.21.15.63:0/3653043900 shutdown_connections 2024-03-26T06:18:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.165+0000 7f3922800640 1 -- 172.21.15.63:0/3653043900 wait complete. 2024-03-26T06:18:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.166+0000 7f3922800640 1 Processor -- start 2024-03-26T06:18:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.167+0000 7f3922800640 1 -- start start 2024-03-26T06:18:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3922800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3904004d40 0x7f391c0c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3922800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c1e5f60 0x7f391c1e63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3922800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f391c0c8920 0x7f391c0c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3922800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0cf020 con 0x7f391c0c8920 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3922800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0d3610 con 0x7f3904004d40 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3922800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0d2600 con 0x7f391c1e5f60 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3921e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f391c0c8920 0x7f391c0c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3921e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f391c0c8920 0x7f391c0c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36318/0 (socket says 172.21.15.63:36318) 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3921e00640 1 -- 172.21.15.63:0/1541938171 learned_addr learned my addr 172.21.15.63:0/1541938171 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3921e00640 1 -- 172.21.15.63:0/1541938171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c1e5f60 msgr2=0x7f391c1e63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3921e00640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c1e5f60 0x7f391c1e63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3921e00640 1 -- 172.21.15.63:0/1541938171 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3904004d40 msgr2=0x7f391c0c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3921e00640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3904004d40 0x7f391c0c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.168+0000 7f3921e00640 1 -- 172.21.15.63:0/1541938171 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0c92e0 con 0x7f391c0c8920 2024-03-26T06:18:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.169+0000 7f3921e00640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f391c0c8920 0x7f391c0c8da0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f391400e230 tx=0x7f3914009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:13.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.169+0000 7f3919600640 1 -- 172.21.15.63:0/1541938171 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914039070 con 0x7f391c0c8920 2024-03-26T06:18:13.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.169+0000 7f3919600640 1 -- 172.21.15.63:0/1541938171 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391403a040 con 0x7f391c0c8920 2024-03-26T06:18:13.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.169+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c0cb1d0 con 0x7f391c0c8920 2024-03-26T06:18:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.169+0000 7f3919600640 1 -- 172.21.15.63:0/1541938171 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914009c10 con 0x7f391c0c8920 2024-03-26T06:18:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.169+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c0cb790 con 0x7f391c0c8920 2024-03-26T06:18:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.170+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c04f0c0 con 0x7f391c0c8920 2024-03-26T06:18:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.171+0000 7f3919600640 1 -- 172.21.15.63:0/1541938171 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3914003990 con 0x7f391c0c8920 2024-03-26T06:18:13.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.172+0000 7f3919600640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f38fc06bc00 0x7f38fc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.172+0000 7f3919600640 1 -- 172.21.15.63:0/1541938171 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f39140ad0d0 con 0x7f391c0c8920 2024-03-26T06:18:13.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.172+0000 7f3921400640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f38fc06bc00 0x7f38fc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.173+0000 7f3921400640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f38fc06bc00 0x7f38fc06e0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3910009910 tx=0x7f3910008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:13.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.177+0000 7f3919600640 1 -- 172.21.15.63:0/1541938171 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f391407b7b0 con 0x7f391c0c8920 2024-03-26T06:18:13.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.374+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f391c0ce6f0 con 0x7f391c0c8920 2024-03-26T06:18:13.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.374+0000 7f3919600640 1 -- 172.21.15.63:0/1541938171 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f391407b0b0 con 0x7f391c0c8920 2024-03-26T06:18:13.376 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f38fc06bc00 msgr2=0x7f38fc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f38fc06bc00 0x7f38fc06e0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3910009910 tx=0x7f3910008040 comp rx=0 tx=0).stop 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f391c0c8920 msgr2=0x7f391c0c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f391c0c8920 0x7f391c0c8da0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f391400e230 tx=0x7f3914009750 comp rx=0 tx=0).stop 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 shutdown_connections 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f38fc06bc00 0x7f38fc06e0c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f391c0c8920 0x7f391c0c8da0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f391c1e5f60 0x7f391c1e63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 --2- 172.21.15.63:0/1541938171 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3904004d40 0x7f391c0c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 >> 172.21.15.63:0/1541938171 conn(0x7f391c06c570 msgr2=0x7f391c0d1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.377+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 shutdown_connections 2024-03-26T06:18:13.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.378+0000 7f3922800640 1 -- 172.21.15.63:0/1541938171 wait complete. 2024-03-26T06:18:13.396 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:18:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.617+0000 7f5657e00640 1 Processor -- start 2024-03-26T06:18:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.618+0000 7f5657e00640 1 -- start start 2024-03-26T06:18:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.619+0000 7f5657e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5658071850 0x7f5658166590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.619+0000 7f5657e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565815f410 con 0x7f565813e650 2024-03-26T06:18:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.619+0000 7f5657e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565815f6f0 con 0x7f565806d270 2024-03-26T06:18:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.619+0000 7f5657e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565815f9d0 con 0x7f5658071850 2024-03-26T06:18:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.620+0000 7f5656a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f565813e650 0x7f565806daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35608/0 (socket says 172.21.15.63:35608) 2024-03-26T06:18:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.620+0000 7f5656a00640 1 -- 172.21.15.63:0/2531054615 learned_addr learned my addr 172.21.15.63:0/2531054615 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.620+0000 7f5657400640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5658071850 0x7f5658166590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.620+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775296037 0 0) 0x7f565815f410 con 0x7f565813e650 2024-03-26T06:18:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.620+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f563c003520 con 0x7f565813e650 2024-03-26T06:18:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4209692016 0 0) 0x7f563c003520 con 0x7f565813e650 2024-03-26T06:18:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5658071850 msgr2=0x7f5658166590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5658071850 0x7f5658166590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 >> v1:172.21.15.204:6789/0 conn(0x7f565806d270 legacy=0x7f5658071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565815fcb0 con 0x7f565813e650 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f5648001670 con 0x7f565813e650 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 >> v1:172.21.15.63:6789/0 conn(0x7f565813e650 legacy=0x7f565806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f563c0039e0 0x7f563c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f563c004800 0x7f563c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5658071850 0x7f563c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565815f9d0 con 0x7f563c0039e0 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c00baa0 con 0x7f563c004800 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c00bca0 con 0x7f5658071850 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5656a00640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f563c0039e0 0x7f563c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5656000640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f563c004800 0x7f563c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.621+0000 7f5657400640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5658071850 0x7f563c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.622+0000 7f5656a00640 1 -- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5658071850 msgr2=0x7f563c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.622+0000 7f5656a00640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5658071850 0x7f563c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.622+0000 7f5656a00640 1 -- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f563c004800 msgr2=0x7f563c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.622+0000 7f5656a00640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f563c004800 0x7f563c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.622+0000 7f5656a00640 1 -- 172.21.15.63:0/2531054615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c003520 con 0x7f563c0039e0 2024-03-26T06:18:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.622+0000 7f5657400640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5658071850 0x7f563c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:13.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.623+0000 7f5656a00640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f563c0039e0 0x7f563c003e00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f564800c210 tx=0x7f563c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e60f643660e2803 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:13.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.623+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648007cf0 con 0x7f563c0039e0 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.623+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648030070 con 0x7f563c0039e0 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.623+0000 7f5655600640 1 -- 172.21.15.63:0/2531054615 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648005d30 con 0x7f563c0039e0 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.624+0000 7f5657e00640 1 -- 172.21.15.63:0/2531054615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f563c0039e0 msgr2=0x7f563c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.624+0000 7f5657e00640 1 --2- 172.21.15.63:0/2531054615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f563c0039e0 0x7f563c003e00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f564800c210 tx=0x7f563c005830 comp rx=0 tx=0).stop 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.624+0000 7f5657400640 1 -- 172.21.15.63:0/2531054615 reap_dead start 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.624+0000 7f5657e00640 1 -- 172.21.15.63:0/2531054615 shutdown_connections 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.624+0000 7f5657e00640 1 -- 172.21.15.63:0/2531054615 >> 172.21.15.63:0/2531054615 conn(0x7f56580670b0 msgr2=0x7f56580b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.624+0000 7f5657e00640 1 -- 172.21.15.63:0/2531054615 shutdown_connections 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.624+0000 7f5657e00640 1 -- 172.21.15.63:0/2531054615 wait complete. 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.625+0000 7f5657e00640 1 Processor -- start 2024-03-26T06:18:13.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.626+0000 7f5657e00640 1 -- start start 2024-03-26T06:18:13.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f563c0039e0 0x7f56581309c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565815e2f0 0x7f56581f1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f565815e750 0x7f565815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565813ee20 con 0x7f565815e750 2024-03-26T06:18:13.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565813eca0 con 0x7f565815e2f0 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565813efa0 con 0x7f563c0039e0 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f565815e750 0x7f565815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f565815e750 0x7f565815c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36338/0 (socket says 172.21.15.63:36338) 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657400640 1 -- 172.21.15.63:0/1178200244 learned_addr learned my addr 172.21.15.63:0/1178200244 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657400640 1 -- 172.21.15.63:0/1178200244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f563c0039e0 msgr2=0x7f56581309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657400640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f563c0039e0 0x7f56581309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657400640 1 -- 172.21.15.63:0/1178200244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565815e2f0 msgr2=0x7f56581f1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5656000640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565815e2f0 0x7f56581f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657400640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565815e2f0 0x7f56581f1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.627+0000 7f5657400640 1 -- 172.21.15.63:0/1178200244 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5658159950 con 0x7f565815e750 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.628+0000 7f5657400640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f565815e750 0x7f565815c220 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5658156260 tx=0x7f565000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.628+0000 7f564ea00640 1 -- 172.21.15.63:0/1178200244 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565001c070 con 0x7f565815e750 2024-03-26T06:18:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.628+0000 7f564ea00640 1 -- 172.21.15.63:0/1178200244 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5650017400 con 0x7f565815e750 2024-03-26T06:18:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.628+0000 7f564ea00640 1 -- 172.21.15.63:0/1178200244 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500177d0 con 0x7f565815e750 2024-03-26T06:18:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.628+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5658159c30 con 0x7f565815e750 2024-03-26T06:18:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.628+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565815a1f0 con 0x7f565815e750 2024-03-26T06:18:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.629+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565804f0c0 con 0x7f565815e750 2024-03-26T06:18:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.630+0000 7f564ea00640 1 -- 172.21.15.63:0/1178200244 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f565001f070 con 0x7f565815e750 2024-03-26T06:18:13.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.631+0000 7f564ea00640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f563806bbd0 0x7f563806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:13.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.631+0000 7f564ea00640 1 -- 172.21.15.63:0/1178200244 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f565008aff0 con 0x7f565815e750 2024-03-26T06:18:13.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.632+0000 7f5656a00640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f563806bbd0 0x7f563806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:13.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.632+0000 7f5656a00640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f563806bbd0 0x7f563806e090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5648034000 tx=0x7f5648039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:13.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.636+0000 7f564ea00640 1 -- 172.21.15.63:0/1178200244 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f5650012070 con 0x7f565815e750 2024-03-26T06:18:13.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.838+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5658071550 con 0x7f565815e750 2024-03-26T06:18:13.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.840+0000 7f564ea00640 1 -- 172.21.15.63:0/1178200244 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5650059610 con 0x7f565815e750 2024-03-26T06:18:13.841 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:13.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f563806bbd0 msgr2=0x7f563806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f563806bbd0 0x7f563806e090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5648034000 tx=0x7f5648039040 comp rx=0 tx=0).stop 2024-03-26T06:18:13.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f565815e750 msgr2=0x7f565815c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:13.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f565815e750 0x7f565815c220 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5658156260 tx=0x7f565000f4a0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 shutdown_connections 2024-03-26T06:18:13.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f563806bbd0 0x7f563806e090 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f565815e750 0x7f565815c220 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565815e2f0 0x7f56581f1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 --2- 172.21.15.63:0/1178200244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f563c0039e0 0x7f56581309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:13.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.842+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 >> 172.21.15.63:0/1178200244 conn(0x7f56580670b0 msgr2=0x7f565813f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:13.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.843+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 shutdown_connections 2024-03-26T06:18:13.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:13.843+0000 7f5657e00640 1 -- 172.21.15.63:0/1178200244 wait complete. 2024-03-26T06:18:13.862 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:18:14.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.083+0000 7f20fba00640 1 Processor -- start 2024-03-26T06:18:14.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.083+0000 7f20fba00640 1 -- start start 2024-03-26T06:18:14.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.085+0000 7f20fba00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f20f40cfd60 0x7f20f40b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.085+0000 7f20fba00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20f4071a00 0x7f20f40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.085+0000 7f20fba00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f40d0140 con 0x7f20f4144c70 2024-03-26T06:18:14.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.085+0000 7f20fba00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f40b4b10 con 0x7f20f4071a00 2024-03-26T06:18:14.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.085+0000 7f20fba00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f40b3530 con 0x7f20f40cfd60 2024-03-26T06:18:14.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.085+0000 7f20f9a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20f4071a00 0x7f20f40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.085+0000 7f20f9a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20f4071a00 0x7f20f40ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36346/0 (socket says 172.21.15.63:36346) 2024-03-26T06:18:14.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.085+0000 7f20f9a00640 1 -- 172.21.15.63:0/1408287622 learned_addr learned my addr 172.21.15.63:0/1408287622 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:14.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.086+0000 7f20f9000640 1 --2- 172.21.15.63:0/1408287622 >> v2:172.21.15.204:3300/0 conn(0x7f20f40cfd60 0x7f20f40b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.086+0000 7f20f9a00640 1 -- 172.21.15.63:0/1408287622 >> v2:172.21.15.204:3300/0 conn(0x7f20f40cfd60 msgr2=0x7f20f40b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:14.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.086+0000 7f20f9a00640 1 --2- 172.21.15.63:0/1408287622 >> v2:172.21.15.204:3300/0 conn(0x7f20f40cfd60 0x7f20f40b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.086+0000 7f20f9a00640 1 -- 172.21.15.63:0/1408287622 >> v1:172.21.15.204:6789/0 conn(0x7f20f4144c70 legacy=0x7f20f40712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.086+0000 7f20f9a00640 1 -- 172.21.15.63:0/1408287622 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f40b3810 con 0x7f20f4071a00 2024-03-26T06:18:14.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.087+0000 7f20f9a00640 1 --2- 172.21.15.63:0/1408287622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 0x7f20f40ce670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20f406f570 tx=0x7f20ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110f4d4142f52c96 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:14.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20f3400640 1 -- 172.21.15.63:0/1408287622 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec034070 con 0x7f20f4071a00 2024-03-26T06:18:14.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20f3400640 1 -- 172.21.15.63:0/1408287622 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec030860 con 0x7f20f4071a00 2024-03-26T06:18:14.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20f3400640 1 -- 172.21.15.63:0/1408287622 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec030c30 con 0x7f20f4071a00 2024-03-26T06:18:14.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20fba00640 1 -- 172.21.15.63:0/1408287622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 msgr2=0x7f20f40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20fba00640 1 --2- 172.21.15.63:0/1408287622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 0x7f20f40ce670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20f406f570 tx=0x7f20ec02b9a0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20fba00640 1 -- 172.21.15.63:0/1408287622 shutdown_connections 2024-03-26T06:18:14.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20fba00640 1 --2- 172.21.15.63:0/1408287622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 0x7f20f40ce670 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20fba00640 1 --2- 172.21.15.63:0/1408287622 >> v2:172.21.15.204:3300/0 conn(0x7f20f40cfd60 0x7f20f40b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20fba00640 1 -- 172.21.15.63:0/1408287622 >> 172.21.15.63:0/1408287622 conn(0x7f20f406ac90 msgr2=0x7f20f406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:14.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20fba00640 1 -- 172.21.15.63:0/1408287622 shutdown_connections 2024-03-26T06:18:14.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.088+0000 7f20fba00640 1 -- 172.21.15.63:0/1408287622 wait complete. 2024-03-26T06:18:14.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.090+0000 7f20fba00640 1 Processor -- start 2024-03-26T06:18:14.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.090+0000 7f20fba00640 1 -- start start 2024-03-26T06:18:14.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.091+0000 7f20fba00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 0x7f20f415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.091+0000 7f20fba00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20f40cfd60 0x7f20f4142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.091+0000 7f20fba00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20f4144c70 0x7f20f40b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.091+0000 7f20fba00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40b40b0 con 0x7f20f4071a00 2024-03-26T06:18:14.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.091+0000 7f20fba00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40b3dd0 con 0x7f20f4144c70 2024-03-26T06:18:14.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.091+0000 7f20fba00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40b31c0 con 0x7f20f40cfd60 2024-03-26T06:18:14.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.091+0000 7f20f9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 0x7f20f415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 0x7f20f415b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36356/0 (socket says 172.21.15.63:36356) 2024-03-26T06:18:14.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f9000640 1 -- 172.21.15.63:0/3931946424 learned_addr learned my addr 172.21.15.63:0/3931946424 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:14.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f9a00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20f4144c70 0x7f20f40b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f3e00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20f40cfd60 0x7f20f4142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f9000640 1 -- 172.21.15.63:0/3931946424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20f40cfd60 msgr2=0x7f20f4142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f9000640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20f40cfd60 0x7f20f4142230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f9000640 1 -- 172.21.15.63:0/3931946424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20f4144c70 msgr2=0x7f20f40b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f9000640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20f4144c70 0x7f20f40b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f9000640 1 -- 172.21.15.63:0/3931946424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f415b700 con 0x7f20f4071a00 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f3e00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20f40cfd60 0x7f20f4142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.092+0000 7f20f9000640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 0x7f20f415b1c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20e400efc0 tx=0x7f20e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.093+0000 7f20f0c00640 1 -- 172.21.15.63:0/3931946424 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4018020 con 0x7f20f4071a00 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.093+0000 7f20f0c00640 1 -- 172.21.15.63:0/3931946424 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e4014480 con 0x7f20f4071a00 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.093+0000 7f20f0c00640 1 -- 172.21.15.63:0/3931946424 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4014870 con 0x7f20f4071a00 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.093+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f412f930 con 0x7f20f4071a00 2024-03-26T06:18:14.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.093+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f412fef0 con 0x7f20f4071a00 2024-03-26T06:18:14.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.094+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f4074730 con 0x7f20f4071a00 2024-03-26T06:18:14.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.095+0000 7f20f0c00640 1 -- 172.21.15.63:0/3931946424 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f20e4005d10 con 0x7f20f4071a00 2024-03-26T06:18:14.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.096+0000 7f20f0c00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f20d006bc00 0x7f20d006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.096+0000 7f20f0c00640 1 -- 172.21.15.63:0/3931946424 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f20e408b9a0 con 0x7f20f4071a00 2024-03-26T06:18:14.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.097+0000 7f20f3e00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f20d006bc00 0x7f20d006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.097+0000 7f20f3e00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f20d006bc00 0x7f20d006e0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f20f4144720 tx=0x7f20dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.101+0000 7f20f0c00640 1 -- 172.21.15.63:0/3931946424 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f20e4022070 con 0x7f20f4071a00 2024-03-26T06:18:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.303+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20f415f1d0 con 0x7f20f4071a00 2024-03-26T06:18:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.304+0000 7f20f0c00640 1 -- 172.21.15.63:0/3931946424 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20f415b700 con 0x7f20f4071a00 2024-03-26T06:18:14.305 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:18:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f20d006bc00 msgr2=0x7f20d006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f20d006bc00 0x7f20d006e0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f20f4144720 tx=0x7f20dc009040 comp rx=0 tx=0).stop 2024-03-26T06:18:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 msgr2=0x7f20f415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 0x7f20f415b1c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20e400efc0 tx=0x7f20e400c490 comp rx=0 tx=0).stop 2024-03-26T06:18:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 shutdown_connections 2024-03-26T06:18:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f20d006bc00 0x7f20d006e0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20f4144c70 0x7f20f40b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20f40cfd60 0x7f20f4142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 --2- 172.21.15.63:0/3931946424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20f4071a00 0x7f20f415b1c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.306+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 >> 172.21.15.63:0/3931946424 conn(0x7f20f406ac90 msgr2=0x7f20f40712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.307+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 shutdown_connections 2024-03-26T06:18:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.307+0000 7f20fba00640 1 -- 172.21.15.63:0/3931946424 wait complete. 2024-03-26T06:18:14.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:18:14.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.541+0000 7fe8d6200640 1 Processor -- start 2024-03-26T06:18:14.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.542+0000 7fe8d6200640 1 -- start start 2024-03-26T06:18:14.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.543+0000 7fe8d6200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 0x7fe8d00d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.543+0000 7fe8d6200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe8d00b96e0 0x7fe8d00d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.543+0000 7fe8d6200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d00d2490 con 0x7fe8d015dbb0 2024-03-26T06:18:14.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.543+0000 7fe8d6200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d00b7be0 con 0x7fe8d00b96e0 2024-03-26T06:18:14.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.543+0000 7fe8d6200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00d2770 con 0x7fe8d015df90 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.543+0000 7fe8cfe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe8d00b96e0 0x7fe8d00d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.544+0000 7fe8cfe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe8d00b96e0 0x7fe8d00d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36364/0 (socket says 172.21.15.63:36364) 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.544+0000 7fe8cfe00640 1 -- 172.21.15.63:0/2419094627 learned_addr learned my addr 172.21.15.63:0/2419094627 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.544+0000 7fe8cf400640 1 --1- 172.21.15.63:0/2419094627 >> v1:172.21.15.63:6789/0 conn(0x7fe8d015dbb0 0x7fe8d00d1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35618/0 (socket says 172.21.15.63:35618) 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.544+0000 7fe8cea00640 1 --2- 172.21.15.63:0/2419094627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 0x7fe8d00d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.544+0000 7fe8cfe00640 1 -- 172.21.15.63:0/2419094627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 msgr2=0x7fe8d00d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.544+0000 7fe8cfe00640 1 --2- 172.21.15.63:0/2419094627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 0x7fe8d00d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.544+0000 7fe8cfe00640 1 -- 172.21.15.63:0/2419094627 >> v1:172.21.15.63:6789/0 conn(0x7fe8d015dbb0 legacy=0x7fe8d00d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.544+0000 7fe8cfe00640 1 -- 172.21.15.63:0/2419094627 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00d2a50 con 0x7fe8d00b96e0 2024-03-26T06:18:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.544+0000 7fe8cea00640 1 --2- 172.21.15.63:0/2419094627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 0x7fe8d00d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:14.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.545+0000 7fe8cfe00640 1 --2- 172.21.15.63:0/2419094627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 0x7fe8d00d0960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009e50 tx=0x7fe8c802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5873519f141b5649 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8ce000640 1 -- 172.21.15.63:0/2419094627 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c802cb90 con 0x7fe8d00b96e0 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8ce000640 1 -- 172.21.15.63:0/2419094627 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c802cd30 con 0x7fe8d00b96e0 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8ce000640 1 -- 172.21.15.63:0/2419094627 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8034610 con 0x7fe8d00b96e0 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8d6200640 1 -- 172.21.15.63:0/2419094627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 msgr2=0x7fe8d00d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8d6200640 1 --2- 172.21.15.63:0/2419094627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 0x7fe8d00d0960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009e50 tx=0x7fe8c802bff0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8d6200640 1 -- 172.21.15.63:0/2419094627 shutdown_connections 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8d6200640 1 --2- 172.21.15.63:0/2419094627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 0x7fe8d00d0960 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8d6200640 1 --2- 172.21.15.63:0/2419094627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 0x7fe8d00d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8d6200640 1 -- 172.21.15.63:0/2419094627 >> 172.21.15.63:0/2419094627 conn(0x7fe8d00b5540 msgr2=0x7fe8d00b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8d6200640 1 -- 172.21.15.63:0/2419094627 shutdown_connections 2024-03-26T06:18:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.546+0000 7fe8d6200640 1 -- 172.21.15.63:0/2419094627 wait complete. 2024-03-26T06:18:14.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.548+0000 7fe8d6200640 1 Processor -- start 2024-03-26T06:18:14.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.548+0000 7fe8d6200640 1 -- start start 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.549+0000 7fe8d6200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 0x7fe8d0152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.549+0000 7fe8d6200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d015dbb0 0x7fe8d014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.549+0000 7fe8d6200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 0x7fe8d014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.549+0000 7fe8d6200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00d36b0 con 0x7fe8d00b96e0 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.549+0000 7fe8d6200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00d3530 con 0x7fe8d015dbb0 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.549+0000 7fe8d6200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00b6bd0 con 0x7fe8d015df90 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.549+0000 7fe8cf400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 0x7fe8d0152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.549+0000 7fe8cf400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 0x7fe8d0152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36370/0 (socket says 172.21.15.63:36370) 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.550+0000 7fe8cf400640 1 -- 172.21.15.63:0/3266272797 learned_addr learned my addr 172.21.15.63:0/3266272797 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.550+0000 7fe8cfe00640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 0x7fe8d014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.550+0000 7fe8cf400640 1 -- 172.21.15.63:0/3266272797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 msgr2=0x7fe8d014efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.550+0000 7fe8cf400640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 0x7fe8d014efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.550+0000 7fe8cf400640 1 -- 172.21.15.63:0/3266272797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d015dbb0 msgr2=0x7fe8d014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.550+0000 7fe8cea00640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d015dbb0 0x7fe8d014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.550+0000 7fe8cf400640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d015dbb0 0x7fe8d014ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.550+0000 7fe8cf400640 1 -- 172.21.15.63:0/3266272797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d01528a0 con 0x7fe8d00b96e0 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.550+0000 7fe8cf400640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 0x7fe8d0152360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000c400 tx=0x7fe8c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.551+0000 7fe8c7400640 1 -- 172.21.15.63:0/3266272797 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00074e0 con 0x7fe8d00b96e0 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.551+0000 7fe8c7400640 1 -- 172.21.15.63:0/3266272797 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0007680 con 0x7fe8d00b96e0 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.551+0000 7fe8c7400640 1 -- 172.21.15.63:0/3266272797 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004a00 con 0x7fe8d00b96e0 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.551+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d00cd1b0 con 0x7fe8d00b96e0 2024-03-26T06:18:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.551+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d014cca0 con 0x7fe8d00b96e0 2024-03-26T06:18:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.552+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d0074730 con 0x7fe8d00b96e0 2024-03-26T06:18:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.553+0000 7fe8c7400640 1 -- 172.21.15.63:0/3266272797 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe8c001a020 con 0x7fe8d00b96e0 2024-03-26T06:18:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.554+0000 7fe8c7400640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8b006bbd0 0x7fe8b006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.554+0000 7fe8c7400640 1 -- 172.21.15.63:0/3266272797 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe8c008a6a0 con 0x7fe8d00b96e0 2024-03-26T06:18:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.554+0000 7fe8cea00640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8b006bbd0 0x7fe8b006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.555+0000 7fe8cea00640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8b006bbd0 0x7fe8b006e090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe8d01f6d60 tx=0x7fe8bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:14.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.558+0000 7fe8c7400640 1 -- 172.21.15.63:0/3266272797 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe8c0010300 con 0x7fe8d00b96e0 2024-03-26T06:18:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.762+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe8d00cf5e0 con 0x7fe8d00b96e0 2024-03-26T06:18:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.763+0000 7fe8c7400640 1 -- 172.21.15.63:0/3266272797 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe8c0058d90 con 0x7fe8d00b96e0 2024-03-26T06:18:14.765 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:14.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8b006bbd0 msgr2=0x7fe8b006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8b006bbd0 0x7fe8b006e090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe8d01f6d60 tx=0x7fe8bc008040 comp rx=0 tx=0).stop 2024-03-26T06:18:14.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 msgr2=0x7fe8d0152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:14.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 0x7fe8d0152360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000c400 tx=0x7fe8c000c8c0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 shutdown_connections 2024-03-26T06:18:14.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe8b006bbd0 0x7fe8b006e090 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015df90 0x7fe8d014efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d015dbb0 0x7fe8d014ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 --2- 172.21.15.63:0/3266272797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8d00b96e0 0x7fe8d0152360 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:14.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 >> 172.21.15.63:0/3266272797 conn(0x7fe8d00b5540 msgr2=0x7fe8d00d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:14.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 shutdown_connections 2024-03-26T06:18:14.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:14.766+0000 7fe8d6200640 1 -- 172.21.15.63:0/3266272797 wait complete. 2024-03-26T06:18:14.788 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-26T06:18:15.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.014+0000 7f62c6e00640 1 Processor -- start 2024-03-26T06:18:15.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.014+0000 7f62c6e00640 1 -- start start 2024-03-26T06:18:15.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.016+0000 7f62c6e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62c00cfd60 0x7f62c00b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.016+0000 7f62c6e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c00d0140 con 0x7f62c0071a00 2024-03-26T06:18:15.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.016+0000 7f62c6e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c00b4b10 con 0x7f62c0144c70 2024-03-26T06:18:15.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.016+0000 7f62c6e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c00b3530 con 0x7f62c00cfd60 2024-03-26T06:18:15.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.016+0000 7f62bfe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62c00cfd60 0x7f62c00b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.016+0000 7f62c4e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f62c0071a00 0x7f62c00ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35632/0 (socket says 172.21.15.63:35632) 2024-03-26T06:18:15.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.016+0000 7f62c4e00640 1 -- 172.21.15.63:0/789504854 learned_addr learned my addr 172.21.15.63:0/789504854 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:15.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.017+0000 7f62bea00640 1 -- 172.21.15.63:0/789504854 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828404529 0 0) 0x7f62c00d0140 con 0x7f62c0071a00 2024-03-26T06:18:15.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.017+0000 7f62bea00640 1 -- 172.21.15.63:0/789504854 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a4003520 con 0x7f62c0071a00 2024-03-26T06:18:15.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.017+0000 7f62bfe00640 1 -- 172.21.15.63:0/789504854 >> v1:172.21.15.204:6789/0 conn(0x7f62c0144c70 legacy=0x7f62c00712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.017+0000 7f62bfe00640 1 -- 172.21.15.63:0/789504854 >> v1:172.21.15.63:6789/0 conn(0x7f62c0071a00 legacy=0x7f62c00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.017+0000 7f62bfe00640 1 -- 172.21.15.63:0/789504854 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c00b3810 con 0x7f62c00cfd60 2024-03-26T06:18:15.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.018+0000 7f62bfe00640 1 --2- 172.21.15.63:0/789504854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 0x7f62c00b45d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f62b00097a0 tx=0x7f62b002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696af55534771df2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:15.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.018+0000 7f62bea00640 1 -- 172.21.15.63:0/789504854 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0034070 con 0x7f62c00cfd60 2024-03-26T06:18:15.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.018+0000 7f62bea00640 1 -- 172.21.15.63:0/789504854 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0030610 con 0x7f62c00cfd60 2024-03-26T06:18:15.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.018+0000 7f62bea00640 1 -- 172.21.15.63:0/789504854 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b00309e0 con 0x7f62c00cfd60 2024-03-26T06:18:15.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.019+0000 7f62c6e00640 1 -- 172.21.15.63:0/789504854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 msgr2=0x7f62c00b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.019+0000 7f62c6e00640 1 --2- 172.21.15.63:0/789504854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 0x7f62c00b45d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f62b00097a0 tx=0x7f62b002b960 comp rx=0 tx=0).stop 2024-03-26T06:18:15.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.019+0000 7f62c6e00640 1 -- 172.21.15.63:0/789504854 shutdown_connections 2024-03-26T06:18:15.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.019+0000 7f62c6e00640 1 --2- 172.21.15.63:0/789504854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 0x7f62c00b45d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.019+0000 7f62c6e00640 1 -- 172.21.15.63:0/789504854 >> 172.21.15.63:0/789504854 conn(0x7f62c006ac90 msgr2=0x7f62c006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:15.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.019+0000 7f62c6e00640 1 -- 172.21.15.63:0/789504854 shutdown_connections 2024-03-26T06:18:15.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.019+0000 7f62c6e00640 1 -- 172.21.15.63:0/789504854 wait complete. 2024-03-26T06:18:15.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.021+0000 7f62c6e00640 1 Processor -- start 2024-03-26T06:18:15.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.021+0000 7f62c6e00640 1 -- start start 2024-03-26T06:18:15.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.022+0000 7f62c6e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62c0071a00 0x7f62c00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.022+0000 7f62c6e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 0x7f62c015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.022+0000 7f62c6e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62c0144c70 0x7f62c015af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.022+0000 7f62c6e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00b40b0 con 0x7f62c00cfd60 2024-03-26T06:18:15.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.022+0000 7f62c6e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00b3dd0 con 0x7f62c0144c70 2024-03-26T06:18:15.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.022+0000 7f62c6e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00b31c0 con 0x7f62c0071a00 2024-03-26T06:18:15.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.022+0000 7f62bf400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 0x7f62c015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.022+0000 7f62bf400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 0x7f62c015e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36378/0 (socket says 172.21.15.63:36378) 2024-03-26T06:18:15.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.022+0000 7f62bf400640 1 -- 172.21.15.63:0/54029499 learned_addr learned my addr 172.21.15.63:0/54029499 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:15.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.023+0000 7f62bfe00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62c0071a00 0x7f62c00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.023+0000 7f62c4e00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62c0144c70 0x7f62c015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.023+0000 7f62bf400640 1 -- 172.21.15.63:0/54029499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62c0071a00 msgr2=0x7f62c00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.023+0000 7f62bf400640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62c0071a00 0x7f62c00ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.023+0000 7f62bf400640 1 -- 172.21.15.63:0/54029499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62c0144c70 msgr2=0x7f62c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.023+0000 7f62bf400640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62c0144c70 0x7f62c015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.023+0000 7f62bf400640 1 -- 172.21.15.63:0/54029499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c00acfc0 con 0x7f62c00cfd60 2024-03-26T06:18:15.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.023+0000 7f62bf400640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 0x7f62c015e8e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c400 tx=0x7f62ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:15.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.024+0000 7f62b7e00640 1 -- 172.21.15.63:0/54029499 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac017070 con 0x7f62c00cfd60 2024-03-26T06:18:15.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.024+0000 7f62b7e00640 1 -- 172.21.15.63:0/54029499 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0052d0 con 0x7f62c00cfd60 2024-03-26T06:18:15.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.024+0000 7f62b7e00640 1 -- 172.21.15.63:0/54029499 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac003830 con 0x7f62c00cfd60 2024-03-26T06:18:15.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.024+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c00ad2a0 con 0x7f62c00cfd60 2024-03-26T06:18:15.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.024+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c00ad860 con 0x7f62c00cfd60 2024-03-26T06:18:15.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.025+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c0074730 con 0x7f62c00cfd60 2024-03-26T06:18:15.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.026+0000 7f62b7e00640 1 -- 172.21.15.63:0/54029499 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f62ac01a070 con 0x7f62c00cfd60 2024-03-26T06:18:15.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.027+0000 7f62b7e00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f62a006bbd0 0x7f62a006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.027+0000 7f62b7e00640 1 -- 172.21.15.63:0/54029499 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f62ac08a310 con 0x7f62c00cfd60 2024-03-26T06:18:15.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.027+0000 7f62bfe00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f62a006bbd0 0x7f62a006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.028+0000 7f62bfe00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f62a006bbd0 0x7f62a006e090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62b0036000 tx=0x7f62b003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:15.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.032+0000 7f62b7e00640 1 -- 172.21.15.63:0/54029499 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f62ac0588d0 con 0x7f62c00cfd60 2024-03-26T06:18:15.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.246+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f62c015f1d0 con 0x7f62c00cfd60 2024-03-26T06:18:15.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.247+0000 7f62b7e00640 1 -- 172.21.15.63:0/54029499 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f62ac08a0d0 con 0x7f62c00cfd60 2024-03-26T06:18:15.248 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-03-26T06:18:15.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f62a006bbd0 msgr2=0x7f62a006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f62a006bbd0 0x7f62a006e090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62b0036000 tx=0x7f62b003b040 comp rx=0 tx=0).stop 2024-03-26T06:18:15.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 msgr2=0x7f62c015e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 0x7f62c015e8e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c400 tx=0x7f62ac00c8c0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 shutdown_connections 2024-03-26T06:18:15.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f62a006bbd0 0x7f62a006e090 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62c0144c70 0x7f62c015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00cfd60 0x7f62c015e8e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 --2- 172.21.15.63:0/54029499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62c0071a00 0x7f62c00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.249+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 >> 172.21.15.63:0/54029499 conn(0x7f62c006ac90 msgr2=0x7f62c00712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:15.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.250+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 shutdown_connections 2024-03-26T06:18:15.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.250+0000 7f62c6e00640 1 -- 172.21.15.63:0/54029499 wait complete. 2024-03-26T06:18:15.272 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-26T06:18:15.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:15.272 DEBUG:teuthology.orchestra.run.smithi204:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-26T06:18:15.375 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T06:18:15.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:15.376 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-26T06:18:15.427 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-26T06:18:15.427 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:18:15.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.651+0000 7f8b9ec00640 1 Processor -- start 2024-03-26T06:18:15.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.651+0000 7f8b9ec00640 1 -- start start 2024-03-26T06:18:15.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.653+0000 7f8b9ec00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b980cdf10 0x7f8b980ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.653+0000 7f8b9ec00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b980c76f0 con 0x7f8b980c6b50 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.653+0000 7f8b9ec00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b980ce830 con 0x7f8b9815fe40 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.653+0000 7f8b9ec00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980cfaa0 con 0x7f8b980cdf10 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.653+0000 7f8b9cc00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8b980c6b50 0x7f8b980c6fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35636/0 (socket says 172.21.15.63:35636) 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.653+0000 7f8b9cc00640 1 -- 172.21.15.63:0/706150503 learned_addr learned my addr 172.21.15.63:0/706150503 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b97e00640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b980cdf10 0x7f8b980ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512204081 0 0) 0x7f8b980c76f0 con 0x7f8b980c6b50 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b7c003520 con 0x7f8b980c6b50 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1844609698 0 0) 0x7f8b7c003520 con 0x7f8b980c6b50 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b980cdf10 msgr2=0x7f8b980ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b980cdf10 0x7f8b980ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 >> v1:172.21.15.204:6789/0 conn(0x7f8b9815fe40 legacy=0x7f8b980cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:15.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980cfd50 con 0x7f8b980c6b50 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f8b90001670 con 0x7f8b980c6b50 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 >> v1:172.21.15.63:6789/0 conn(0x7f8b980c6b50 legacy=0x7f8b980c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b7c0039e0 0x7f8b7c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c004800 0x7f8b7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b980cdf10 0x7f8b7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980cfaa0 con 0x7f8b7c004800 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c00ba70 con 0x7f8b7c0039e0 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.654+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c00bc40 con 0x7f8b980cdf10 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.655+0000 7f8b97400640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c004800 0x7f8b7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.655+0000 7f8b9cc00640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b980cdf10 0x7f8b7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.655+0000 7f8b97400640 1 -- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b980cdf10 msgr2=0x7f8b7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.655+0000 7f8b97400640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b980cdf10 0x7f8b7c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.655+0000 7f8b97400640 1 -- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b7c0039e0 msgr2=0x7f8b7c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.655+0000 7f8b97400640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b7c0039e0 0x7f8b7c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.655+0000 7f8b97400640 1 -- 172.21.15.63:0/706150503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c003520 con 0x7f8b7c004800 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.656+0000 7f8b97400640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c004800 0x7f8b7c004c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8b80003db0 tx=0x7f8b7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6d403a7d73e8e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.656+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80037070 con 0x7f8b7c004800 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.657+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b80032600 con 0x7f8b7c004800 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.657+0000 7f8b96a00640 1 -- 172.21.15.63:0/706150503 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80003980 con 0x7f8b7c004800 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.657+0000 7f8b9ec00640 1 -- 172.21.15.63:0/706150503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c004800 msgr2=0x7f8b7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.657+0000 7f8b9ec00640 1 --2- 172.21.15.63:0/706150503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c004800 0x7f8b7c004c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8b80003db0 tx=0x7f8b7c005830 comp rx=0 tx=0).stop 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.657+0000 7f8b9cc00640 1 -- 172.21.15.63:0/706150503 reap_dead start 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.657+0000 7f8b9ec00640 1 -- 172.21.15.63:0/706150503 shutdown_connections 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.657+0000 7f8b9ec00640 1 -- 172.21.15.63:0/706150503 >> 172.21.15.63:0/706150503 conn(0x7f8b980b3410 msgr2=0x7f8b980b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:15.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.657+0000 7f8b9ec00640 1 -- 172.21.15.63:0/706150503 shutdown_connections 2024-03-26T06:18:15.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.657+0000 7f8b9ec00640 1 -- 172.21.15.63:0/706150503 wait complete. 2024-03-26T06:18:15.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.659+0000 7f8b9ec00640 1 Processor -- start 2024-03-26T06:18:15.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.659+0000 7f8b9ec00640 1 -- start start 2024-03-26T06:18:15.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.660+0000 7f8b9ec00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b7c004800 0x7f8b981401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.660+0000 7f8b9ec00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b98159c00 0x7f8b9815a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.660+0000 7f8b9ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9814e130 0x7f8b9814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.660+0000 7f8b9ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9815f640 con 0x7f8b9814e130 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.660+0000 7f8b9ec00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980d0310 con 0x7f8b98159c00 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.660+0000 7f8b9ec00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981602c0 con 0x7f8b7c004800 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.660+0000 7f8b9cc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9814e130 0x7f8b9814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b9cc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9814e130 0x7f8b9814e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36386/0 (socket says 172.21.15.63:36386) 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b9cc00640 1 -- 172.21.15.63:0/1726293060 learned_addr learned my addr 172.21.15.63:0/1726293060 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b97e00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b7c004800 0x7f8b981401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b97400640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b98159c00 0x7f8b9815a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b9cc00640 1 -- 172.21.15.63:0/1726293060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b7c004800 msgr2=0x7f8b981401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b9cc00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b7c004800 0x7f8b981401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b9cc00640 1 -- 172.21.15.63:0/1726293060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b98159c00 msgr2=0x7f8b9815a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b9cc00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b98159c00 0x7f8b9815a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b9cc00640 1 -- 172.21.15.63:0/1726293060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b98140710 con 0x7f8b9814e130 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.661+0000 7f8b9cc00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9814e130 0x7f8b9814e5b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b980b79d0 tx=0x7f8b9000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.662+0000 7f8b8fe00640 1 -- 172.21.15.63:0/1726293060 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90007230 con 0x7f8b9814e130 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.662+0000 7f8b8fe00640 1 -- 172.21.15.63:0/1726293060 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b900073d0 con 0x7f8b9814e130 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.662+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9815b060 con 0x7f8b9814e130 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.662+0000 7f8b8fe00640 1 -- 172.21.15.63:0/1726293060 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900047e0 con 0x7f8b9814e130 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.662+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9815aaa0 con 0x7f8b9814e130 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.663+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b98074730 con 0x7f8b9814e130 2024-03-26T06:18:15.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.664+0000 7f8b8fe00640 1 -- 172.21.15.63:0/1726293060 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8b9001b020 con 0x7f8b9814e130 2024-03-26T06:18:15.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.665+0000 7f8b8fe00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8b7406bbd0 0x7f8b7406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:15.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.665+0000 7f8b8fe00640 1 -- 172.21.15.63:0/1726293060 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8b9008aab0 con 0x7f8b9814e130 2024-03-26T06:18:15.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.665+0000 7f8b97e00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8b7406bbd0 0x7f8b7406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:15.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.666+0000 7f8b97e00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8b7406bbd0 0x7f8b7406e090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b88004b30 tx=0x7f8b8800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:15.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.669+0000 7f8b8fe00640 1 -- 172.21.15.63:0/1726293060 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8b98140710 con 0x7f8b9814e130 2024-03-26T06:18:15.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.912+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b98071b40 con 0x7f8b9814e130 2024-03-26T06:18:15.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.913+0000 7f8b8fe00640 1 -- 172.21.15.63:0/1726293060 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4937 (secure 0 0 0) 0x7f8b90059100 con 0x7f8b9814e130 2024-03-26T06:18:15.915 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:15.915 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:20.131439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-26T06:18:15.915 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-03-26T06:18:15.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8b7406bbd0 msgr2=0x7f8b7406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8b7406bbd0 0x7f8b7406e090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b88004b30 tx=0x7f8b8800d040 comp rx=0 tx=0).stop 2024-03-26T06:18:15.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9814e130 msgr2=0x7f8b9814e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:15.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9814e130 0x7f8b9814e5b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b980b79d0 tx=0x7f8b9000dc00 comp rx=0 tx=0).stop 2024-03-26T06:18:15.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 shutdown_connections 2024-03-26T06:18:15.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f8b7406bbd0 0x7f8b7406e090 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9814e130 0x7f8b9814e5b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b98159c00 0x7f8b9815a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 --2- 172.21.15.63:0/1726293060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b7c004800 0x7f8b981401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:15.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 >> 172.21.15.63:0/1726293060 conn(0x7f8b980b3410 msgr2=0x7f8b980cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:15.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 shutdown_connections 2024-03-26T06:18:15.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:15.916+0000 7f8b9ec00640 1 -- 172.21.15.63:0/1726293060 wait complete. 2024-03-26T06:18:15.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:16.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.159+0000 7f9b0c000640 1 Processor -- start 2024-03-26T06:18:16.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.159+0000 7f9b0c000640 1 -- start start 2024-03-26T06:18:16.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.160+0000 7f9b0c000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b0415dd80 0x7f9b0406cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.160+0000 7f9b0c000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b040ce630 con 0x7f9b040cfd10 2024-03-26T06:18:16.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.161+0000 7f9b0c000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b040ce910 con 0x7f9b040cdec0 2024-03-26T06:18:16.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.161+0000 7f9b0c000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b040cebf0 con 0x7f9b0415dd80 2024-03-26T06:18:16.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.161+0000 7f9b09600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b0415dd80 0x7f9b0406cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.161+0000 7f9b0a000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9b040cfd10 0x7f9b040cc750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35640/0 (socket says 172.21.15.63:35640) 2024-03-26T06:18:16.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.161+0000 7f9b0a000640 1 -- 172.21.15.63:0/3161077465 learned_addr learned my addr 172.21.15.63:0/3161077465 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:16.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.161+0000 7f9b09600640 1 -- 172.21.15.63:0/3161077465 >> v1:172.21.15.204:6789/0 conn(0x7f9b040cdec0 legacy=0x7f9b040cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:16.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.161+0000 7f9b09600640 1 -- 172.21.15.63:0/3161077465 >> v1:172.21.15.63:6789/0 conn(0x7f9b040cfd10 legacy=0x7f9b040cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.161+0000 7f9b09600640 1 -- 172.21.15.63:0/3161077465 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040cc230 con 0x7f9b0415dd80 2024-03-26T06:18:16.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.162+0000 7f9b09600640 1 --2- 172.21.15.63:0/3161077465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 0x7f9b0406cca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097a0 tx=0x7f9af802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3280d31488555 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:16.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.162+0000 7f9b03e00640 1 -- 172.21.15.63:0/3161077465 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80315a0 con 0x7f9b0415dd80 2024-03-26T06:18:16.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.163+0000 7f9b03e00640 1 -- 172.21.15.63:0/3161077465 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8037070 con 0x7f9b0415dd80 2024-03-26T06:18:16.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.163+0000 7f9b03e00640 1 -- 172.21.15.63:0/3161077465 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8031960 con 0x7f9b0415dd80 2024-03-26T06:18:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.163+0000 7f9b0c000640 1 -- 172.21.15.63:0/3161077465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 msgr2=0x7f9b0406cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.163+0000 7f9b0c000640 1 --2- 172.21.15.63:0/3161077465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 0x7f9b0406cca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097a0 tx=0x7f9af802b840 comp rx=0 tx=0).stop 2024-03-26T06:18:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.163+0000 7f9b0c000640 1 -- 172.21.15.63:0/3161077465 shutdown_connections 2024-03-26T06:18:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.163+0000 7f9b0c000640 1 --2- 172.21.15.63:0/3161077465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 0x7f9b0406cca0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.163+0000 7f9b0c000640 1 -- 172.21.15.63:0/3161077465 >> 172.21.15.63:0/3161077465 conn(0x7f9b040b3410 msgr2=0x7f9b040b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.163+0000 7f9b0c000640 1 -- 172.21.15.63:0/3161077465 shutdown_connections 2024-03-26T06:18:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.163+0000 7f9b0c000640 1 -- 172.21.15.63:0/3161077465 wait complete. 2024-03-26T06:18:16.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.165+0000 7f9b0c000640 1 Processor -- start 2024-03-26T06:18:16.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.165+0000 7f9b0c000640 1 -- start start 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.166+0000 7f9b0c000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b040cdec0 0x7f9b041592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.166+0000 7f9b0c000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b040cfd10 0x7f9b040acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.166+0000 7f9b0c000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 0x7f9b040cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.166+0000 7f9b0c000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040cbe70 con 0x7f9b0415dd80 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.166+0000 7f9b0c000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0415e160 con 0x7f9b040cdec0 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.166+0000 7f9b0c000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040cbff0 con 0x7f9b040cfd10 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.166+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 0x7f9b040cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 0x7f9b040cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36418/0 (socket says 172.21.15.63:36418) 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b0a000640 1 -- 172.21.15.63:0/1961883572 learned_addr learned my addr 172.21.15.63:0/1961883572 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b09600640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b040cdec0 0x7f9b041592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b08c00640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b040cfd10 0x7f9b040acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b0a000640 1 -- 172.21.15.63:0/1961883572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b040cfd10 msgr2=0x7f9b040acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b0a000640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b040cfd10 0x7f9b040acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b0a000640 1 -- 172.21.15.63:0/1961883572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b040cdec0 msgr2=0x7f9b041592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b0a000640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b040cdec0 0x7f9b041592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b0a000640 1 -- 172.21.15.63:0/1961883572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b041f5370 con 0x7f9b0415dd80 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b09600640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b040cdec0 0x7f9b041592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.167+0000 7f9b0a000640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 0x7f9b040cac20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00caf0 tx=0x7f9afc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.168+0000 7f9b01600640 1 -- 172.21.15.63:0/1961883572 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc017070 con 0x7f9b0415dd80 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.168+0000 7f9b01600640 1 -- 172.21.15.63:0/1961883572 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc00aca0 con 0x7f9b0415dd80 2024-03-26T06:18:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.168+0000 7f9b01600640 1 -- 172.21.15.63:0/1961883572 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc012600 con 0x7f9b0415dd80 2024-03-26T06:18:16.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.168+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b041f5650 con 0x7f9b0415dd80 2024-03-26T06:18:16.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.168+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b041f5c10 con 0x7f9b0415dd80 2024-03-26T06:18:16.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.169+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0406df30 con 0x7f9b0415dd80 2024-03-26T06:18:16.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.170+0000 7f9b01600640 1 -- 172.21.15.63:0/1961883572 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9afc01a070 con 0x7f9b0415dd80 2024-03-26T06:18:16.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.171+0000 7f9b01600640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9ae406bc00 0x7f9ae406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.171+0000 7f9b01600640 1 -- 172.21.15.63:0/1961883572 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9afc08ab80 con 0x7f9b0415dd80 2024-03-26T06:18:16.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.171+0000 7f9b09600640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9ae406bc00 0x7f9ae406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.172+0000 7f9b09600640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9ae406bc00 0x7f9ae406e0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9af8036000 tx=0x7f9af8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:16.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.175+0000 7f9b01600640 1 -- 172.21.15.63:0/1961883572 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f9afc058b80 con 0x7f9b0415dd80 2024-03-26T06:18:16.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.378+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b04074730 con 0x7f9b0415dd80 2024-03-26T06:18:16.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.381+0000 7f9b01600640 1 -- 172.21.15.63:0/1961883572 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7f9afc05cc20 con 0x7f9b0415dd80 2024-03-26T06:18:16.383 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:16.383 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:16.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9ae406bc00 msgr2=0x7f9ae406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9ae406bc00 0x7f9ae406e0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9af8036000 tx=0x7f9af8008030 comp rx=0 tx=0).stop 2024-03-26T06:18:16.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 msgr2=0x7f9b040cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 0x7f9b040cac20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00caf0 tx=0x7f9afc00a060 comp rx=0 tx=0).stop 2024-03-26T06:18:16.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 shutdown_connections 2024-03-26T06:18:16.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f9ae406bc00 0x7f9ae406e0c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b0415dd80 0x7f9b040cac20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b040cfd10 0x7f9b040acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 --2- 172.21.15.63:0/1961883572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b040cdec0 0x7f9b041592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 >> 172.21.15.63:0/1961883572 conn(0x7f9b040b3410 msgr2=0x7f9b04070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:16.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 shutdown_connections 2024-03-26T06:18:16.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.384+0000 7f9b0c000640 1 -- 172.21.15.63:0/1961883572 wait complete. 2024-03-26T06:18:16.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:16:56.306346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:16:56.978584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-26T06:17:00.587176+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-26T06:18:16.407 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:18:16.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.633+0000 7ff59ae00640 1 Processor -- start 2024-03-26T06:18:16.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.633+0000 7ff59ae00640 1 -- start start 2024-03-26T06:18:16.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff59ae00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff594144c70 0x7ff5940712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff59ae00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff5941450d0 0x7ff594071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff59ae00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5940d0140 con 0x7ff5940cfd60 2024-03-26T06:18:16.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff59ae00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5940b3530 con 0x7ff594144c70 2024-03-26T06:18:16.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff59ae00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5940b3810 con 0x7ff5941450d0 2024-03-26T06:18:16.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff593e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff5940cfd60 0x7ff5940b45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35656/0 (socket says 172.21.15.63:35656) 2024-03-26T06:18:16.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff593e00640 1 -- 172.21.15.63:0/3314763880 learned_addr learned my addr 172.21.15.63:0/3314763880 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:16.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff593400640 1 --2- 172.21.15.63:0/3314763880 >> v2:172.21.15.63:3300/0 conn(0x7ff594144c70 0x7ff5940712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff592a00640 1 -- 172.21.15.63:0/3314763880 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061481514 0 0) 0x7ff5940d0140 con 0x7ff5940cfd60 2024-03-26T06:18:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.635+0000 7ff598e00640 1 --2- 172.21.15.63:0/3314763880 >> v2:172.21.15.204:3300/0 conn(0x7ff5941450d0 0x7ff594071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.636+0000 7ff592a00640 1 -- 172.21.15.63:0/3314763880 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff578003520 con 0x7ff5940cfd60 2024-03-26T06:18:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.636+0000 7ff593400640 1 -- 172.21.15.63:0/3314763880 >> v2:172.21.15.204:3300/0 conn(0x7ff5941450d0 msgr2=0x7ff594071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.636+0000 7ff593400640 1 --2- 172.21.15.63:0/3314763880 >> v2:172.21.15.204:3300/0 conn(0x7ff5941450d0 0x7ff594071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.636+0000 7ff593400640 1 -- 172.21.15.63:0/3314763880 >> v1:172.21.15.63:6789/0 conn(0x7ff5940cfd60 legacy=0x7ff5940b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.636+0000 7ff593400640 1 -- 172.21.15.63:0/3314763880 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940b3af0 con 0x7ff594144c70 2024-03-26T06:18:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.637+0000 7ff593400640 1 --2- 172.21.15.63:0/3314763880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 0x7ff5940712f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff5940b4ce0 tx=0x7ff57c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ef8cd8b45334fd server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff592a00640 1 -- 172.21.15.63:0/3314763880 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c035020 con 0x7ff594144c70 2024-03-26T06:18:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff592a00640 1 -- 172.21.15.63:0/3314763880 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c031830 con 0x7ff594144c70 2024-03-26T06:18:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff592a00640 1 -- 172.21.15.63:0/3314763880 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c031c00 con 0x7ff594144c70 2024-03-26T06:18:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff59ae00640 1 -- 172.21.15.63:0/3314763880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 msgr2=0x7ff5940712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff59ae00640 1 --2- 172.21.15.63:0/3314763880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 0x7ff5940712f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff5940b4ce0 tx=0x7ff57c02b8d0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff59ae00640 1 -- 172.21.15.63:0/3314763880 shutdown_connections 2024-03-26T06:18:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff59ae00640 1 --2- 172.21.15.63:0/3314763880 >> v2:172.21.15.204:3300/0 conn(0x7ff5941450d0 0x7ff594071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff59ae00640 1 --2- 172.21.15.63:0/3314763880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 0x7ff5940712f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff59ae00640 1 -- 172.21.15.63:0/3314763880 >> 172.21.15.63:0/3314763880 conn(0x7ff59406ac90 msgr2=0x7ff59406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.638+0000 7ff59ae00640 1 -- 172.21.15.63:0/3314763880 shutdown_connections 2024-03-26T06:18:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.639+0000 7ff59ae00640 1 -- 172.21.15.63:0/3314763880 wait complete. 2024-03-26T06:18:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.640+0000 7ff59ae00640 1 Processor -- start 2024-03-26T06:18:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.640+0000 7ff59ae00640 1 -- start start 2024-03-26T06:18:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.641+0000 7ff59ae00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5940cfd60 0x7ff59415af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.641+0000 7ff59ae00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 0x7ff59413aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.641+0000 7ff59ae00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5941450d0 0x7ff59415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.641+0000 7ff59ae00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5940b31c0 con 0x7ff594144c70 2024-03-26T06:18:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.641+0000 7ff59ae00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5940b40b0 con 0x7ff5941450d0 2024-03-26T06:18:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.641+0000 7ff59ae00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5940ce670 con 0x7ff5940cfd60 2024-03-26T06:18:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.641+0000 7ff593400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 0x7ff59413aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff593400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 0x7ff59413aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36434/0 (socket says 172.21.15.63:36434) 2024-03-26T06:18:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff593400640 1 -- 172.21.15.63:0/1080218388 learned_addr learned my addr 172.21.15.63:0/1080218388 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff593e00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5940cfd60 0x7ff59415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff593400640 1 -- 172.21.15.63:0/1080218388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5940cfd60 msgr2=0x7ff59415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff598e00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5941450d0 0x7ff59415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff593400640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5940cfd60 0x7ff59415af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff593400640 1 -- 172.21.15.63:0/1080218388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5941450d0 msgr2=0x7ff59415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff593400640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5941450d0 0x7ff59415e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff593400640 1 -- 172.21.15.63:0/1080218388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59413e090 con 0x7ff594144c70 2024-03-26T06:18:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff598e00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5941450d0 0x7ff59415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.642+0000 7ff593400640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 0x7ff59413aa70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009890 tx=0x7ff57c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.643+0000 7ff58be00640 1 -- 172.21.15.63:0/1080218388 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c041070 con 0x7ff594144c70 2024-03-26T06:18:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.643+0000 7ff58be00640 1 -- 172.21.15.63:0/1080218388 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c03b920 con 0x7ff594144c70 2024-03-26T06:18:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.643+0000 7ff58be00640 1 -- 172.21.15.63:0/1080218388 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c035040 con 0x7ff594144c70 2024-03-26T06:18:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.643+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59413e330 con 0x7ff594144c70 2024-03-26T06:18:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.643+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59413e8f0 con 0x7ff594144c70 2024-03-26T06:18:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.644+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff594074730 con 0x7ff594144c70 2024-03-26T06:18:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.645+0000 7ff58be00640 1 -- 172.21.15.63:0/1080218388 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff57c038020 con 0x7ff594144c70 2024-03-26T06:18:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.646+0000 7ff58be00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff57006bbd0 0x7ff57006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.646+0000 7ff58be00640 1 -- 172.21.15.63:0/1080218388 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff57c0ac7f0 con 0x7ff594144c70 2024-03-26T06:18:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.646+0000 7ff593e00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff57006bbd0 0x7ff57006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:16.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.647+0000 7ff593e00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff57006bbd0 0x7ff57006e090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff584000f60 tx=0x7ff584009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.651+0000 7ff58be00640 1 -- 172.21.15.63:0/1080218388 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7ff57c02f2e0 con 0x7ff594144c70 2024-03-26T06:18:16.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.851+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5941441d0 con 0x7ff594144c70 2024-03-26T06:18:16.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.852+0000 7ff58be00640 1 -- 172.21.15.63:0/1080218388 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff57c031800 con 0x7ff594144c70 2024-03-26T06:18:16.853 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.854+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff57006bbd0 msgr2=0x7ff57006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.854+0000 7ff59ae00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff57006bbd0 0x7ff57006e090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff584000f60 tx=0x7ff584009040 comp rx=0 tx=0).stop 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.854+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 msgr2=0x7ff59413aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.854+0000 7ff59ae00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 0x7ff59413aa70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009890 tx=0x7ff57c0046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.854+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 shutdown_connections 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.854+0000 7ff59ae00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff57006bbd0 0x7ff57006e090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.854+0000 7ff59ae00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5941450d0 0x7ff59415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.854+0000 7ff59ae00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff594144c70 0x7ff59413aa70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.854+0000 7ff59ae00640 1 --2- 172.21.15.63:0/1080218388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5940cfd60 0x7ff59415af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:16.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.855+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 >> 172.21.15.63:0/1080218388 conn(0x7ff59406ac90 msgr2=0x7ff5940cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:16.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.855+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 shutdown_connections 2024-03-26T06:18:16.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:16.855+0000 7ff59ae00640 1 -- 172.21.15.63:0/1080218388 wait complete. 2024-03-26T06:18:16.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T06:18:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.101+0000 7fa111c00640 1 Processor -- start 2024-03-26T06:18:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.102+0000 7fa111c00640 1 -- start start 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.103+0000 7fa111c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa10c0d3840 0x7fa10c0d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.103+0000 7fa111c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c15dca0 0x7fa10c0d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.103+0000 7fa111c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa10c0b9320 0x7fa10c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.103+0000 7fa111c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c0d4160 con 0x7fa10c0d3840 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.103+0000 7fa111c00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c0d22d0 con 0x7fa10c0b9320 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.103+0000 7fa111c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0d25b0 con 0x7fa10c15dca0 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.104+0000 7fa10be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa10c0d3840 0x7fa10c0d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.104+0000 7fa10be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa10c0d3840 0x7fa10c0d3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36438/0 (socket says 172.21.15.63:36438) 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.104+0000 7fa10be00640 1 -- 172.21.15.63:0/3942211008 learned_addr learned my addr 172.21.15.63:0/3942211008 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.104+0000 7fa10b400640 1 --2- 172.21.15.63:0/3942211008 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c15dca0 0x7fa10c0d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.104+0000 7fa10be00640 1 -- 172.21.15.63:0/3942211008 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c15dca0 msgr2=0x7fa10c0d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.104+0000 7fa10be00640 1 --2- 172.21.15.63:0/3942211008 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c15dca0 0x7fa10c0d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.104+0000 7fa10be00640 1 -- 172.21.15.63:0/3942211008 >> v2:172.21.15.204:3300/0 conn(0x7fa10c0b9320 msgr2=0x7fa10c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.104+0000 7fa10be00640 1 --2- 172.21.15.63:0/3942211008 >> v2:172.21.15.204:3300/0 conn(0x7fa10c0b9320 0x7fa10c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.104+0000 7fa10be00640 1 -- 172.21.15.63:0/3942211008 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c0d2890 con 0x7fa10c0d3840 2024-03-26T06:18:17.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.106+0000 7fa10be00640 1 --2- 172.21.15.63:0/3942211008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c0d3840 0x7fa10c0d3c20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0b6820 tx=0x7fa0fc02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db37916ccd7e41dc server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:17.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.106+0000 7fa10aa00640 1 -- 172.21.15.63:0/3942211008 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc02caa0 con 0x7fa10c0d3840 2024-03-26T06:18:17.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.106+0000 7fa10aa00640 1 -- 172.21.15.63:0/3942211008 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc02cc40 con 0x7fa10c0d3840 2024-03-26T06:18:17.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.106+0000 7fa10aa00640 1 -- 172.21.15.63:0/3942211008 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0343f0 con 0x7fa10c0d3840 2024-03-26T06:18:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.107+0000 7fa111c00640 1 -- 172.21.15.63:0/3942211008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c0d3840 msgr2=0x7fa10c0d3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.107+0000 7fa111c00640 1 --2- 172.21.15.63:0/3942211008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c0d3840 0x7fa10c0d3c20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0b6820 tx=0x7fa0fc02bf00 comp rx=0 tx=0).stop 2024-03-26T06:18:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.107+0000 7fa111c00640 1 -- 172.21.15.63:0/3942211008 shutdown_connections 2024-03-26T06:18:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.107+0000 7fa111c00640 1 --2- 172.21.15.63:0/3942211008 >> v2:172.21.15.204:3300/0 conn(0x7fa10c0b9320 0x7fa10c0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.107+0000 7fa111c00640 1 --2- 172.21.15.63:0/3942211008 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c15dca0 0x7fa10c0d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.107+0000 7fa111c00640 1 --2- 172.21.15.63:0/3942211008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c0d3840 0x7fa10c0d3c20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.107+0000 7fa111c00640 1 -- 172.21.15.63:0/3942211008 >> 172.21.15.63:0/3942211008 conn(0x7fa10c06c570 msgr2=0x7fa10c06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.107+0000 7fa111c00640 1 -- 172.21.15.63:0/3942211008 shutdown_connections 2024-03-26T06:18:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.107+0000 7fa111c00640 1 -- 172.21.15.63:0/3942211008 wait complete. 2024-03-26T06:18:17.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.109+0000 7fa111c00640 1 Processor -- start 2024-03-26T06:18:17.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.109+0000 7fa111c00640 1 -- start start 2024-03-26T06:18:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.110+0000 7fa111c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa10c0b9320 0x7fa10c1f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.110+0000 7fa111c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c0d3840 0x7fa10c151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.110+0000 7fa111c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c15dca0 0x7fa10c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.110+0000 7fa111c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0d1ea0 con 0x7fa10c15dca0 2024-03-26T06:18:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.110+0000 7fa111c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0d2e50 con 0x7fa10c0b9320 2024-03-26T06:18:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.110+0000 7fa111c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0d2020 con 0x7fa10c0d3840 2024-03-26T06:18:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.110+0000 7fa111200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c15dca0 0x7fa10c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.110+0000 7fa111200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c15dca0 0x7fa10c151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36440/0 (socket says 172.21.15.63:36440) 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.110+0000 7fa111200640 1 -- 172.21.15.63:0/3899409699 learned_addr learned my addr 172.21.15.63:0/3899409699 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.111+0000 7fa10be00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa10c0b9320 0x7fa10c1f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.111+0000 7fa10b400640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c0d3840 0x7fa10c151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.111+0000 7fa111200640 1 -- 172.21.15.63:0/3899409699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c0d3840 msgr2=0x7fa10c151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.111+0000 7fa111200640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c0d3840 0x7fa10c151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.111+0000 7fa111200640 1 -- 172.21.15.63:0/3899409699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa10c0b9320 msgr2=0x7fa10c1f2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.111+0000 7fa111200640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa10c0b9320 0x7fa10c1f2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.111+0000 7fa111200640 1 -- 172.21.15.63:0/3899409699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c0cabd0 con 0x7fa10c15dca0 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.111+0000 7fa111200640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c15dca0 0x7fa10c151850 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa10400b410 tx=0x7fa10400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.112+0000 7fa103e00640 1 -- 172.21.15.63:0/3899409699 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104015020 con 0x7fa10c15dca0 2024-03-26T06:18:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.112+0000 7fa103e00640 1 -- 172.21.15.63:0/3899409699 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104011830 con 0x7fa10c15dca0 2024-03-26T06:18:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.112+0000 7fa103e00640 1 -- 172.21.15.63:0/3899409699 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104011c20 con 0x7fa10c15dca0 2024-03-26T06:18:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.112+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c0caeb0 con 0x7fa10c15dca0 2024-03-26T06:18:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.112+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c1f32a0 con 0x7fa10c15dca0 2024-03-26T06:18:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.113+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c0d3400 con 0x7fa10c15dca0 2024-03-26T06:18:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.114+0000 7fa103e00640 1 -- 172.21.15.63:0/3899409699 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa104018020 con 0x7fa10c15dca0 2024-03-26T06:18:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.115+0000 7fa103e00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0e806bbd0 0x7fa0e806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.115+0000 7fa103e00640 1 -- 172.21.15.63:0/3899409699 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa10408ad00 con 0x7fa10c15dca0 2024-03-26T06:18:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.115+0000 7fa10be00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0e806bbd0 0x7fa0e806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.116+0000 7fa10be00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0e806bbd0 0x7fa0e806e090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc035000 tx=0x7fa0fc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:17.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.119+0000 7fa103e00640 1 -- 172.21.15.63:0/3899409699 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa10c0d3400 con 0x7fa10c15dca0 2024-03-26T06:18:17.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.321+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa10c04f0c0 con 0x7fa10c15dca0 2024-03-26T06:18:17.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.323+0000 7fa103e00640 1 -- 172.21.15.63:0/3899409699 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa10401f020 con 0x7fa10c15dca0 2024-03-26T06:18:17.324 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0e806bbd0 msgr2=0x7fa0e806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0e806bbd0 0x7fa0e806e090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc035000 tx=0x7fa0fc030000 comp rx=0 tx=0).stop 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c15dca0 msgr2=0x7fa10c151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c15dca0 0x7fa10c151850 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa10400b410 tx=0x7fa10400b8d0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 shutdown_connections 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa0e806bbd0 0x7fa0e806e090 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa10c15dca0 0x7fa10c151850 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa10c0d3840 0x7fa10c151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 --2- 172.21.15.63:0/3899409699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa10c0b9320 0x7fa10c1f2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.325+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 >> 172.21.15.63:0/3899409699 conn(0x7fa10c06c570 msgr2=0x7fa10c15bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.326+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 shutdown_connections 2024-03-26T06:18:17.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.326+0000 7fa111c00640 1 -- 172.21.15.63:0/3899409699 wait complete. 2024-03-26T06:18:17.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T06:18:17.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.567+0000 7fc1d0a00640 1 Processor -- start 2024-03-26T06:18:17.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.567+0000 7fc1d0a00640 1 -- start start 2024-03-26T06:18:17.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.569+0000 7fc1d0a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc0cfd60 0x7fc1cc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.569+0000 7fc1d0a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc1cc144c70 0x7fc1cc0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.569+0000 7fc1d0a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc0d0140 con 0x7fc1cc1450d0 2024-03-26T06:18:17.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.569+0000 7fc1d0a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b4b10 con 0x7fc1cc144c70 2024-03-26T06:18:17.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.569+0000 7fc1d0a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b3530 con 0x7fc1cc0cfd60 2024-03-26T06:18:17.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.569+0000 7fc1ca800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc1cc1450d0 0x7fc1cc0ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35658/0 (socket says 172.21.15.63:35658) 2024-03-26T06:18:17.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.569+0000 7fc1ca800640 1 -- 172.21.15.63:0/1684358333 learned_addr learned my addr 172.21.15.63:0/1684358333 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:17.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c1400640 1 --2- 172.21.15.63:0/1684358333 >> v2:172.21.15.204:3300/0 conn(0x7fc1cc144c70 0x7fc1cc0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9e00640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc0cfd60 0x7fc1cc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269872 0 0) 0x7fc1cc0d0140 con 0x7fc1cc1450d0 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b0003520 con 0x7fc1cc1450d0 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 407330314 0 0) 0x7fc1b0003520 con 0x7fc1cc1450d0 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc0cfd60 msgr2=0x7fc1cc0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc0cfd60 0x7fc1cc0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 >> v2:172.21.15.204:3300/0 conn(0x7fc1cc144c70 msgr2=0x7fc1cc0712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 --2- 172.21.15.63:0/1684358333 >> v2:172.21.15.204:3300/0 conn(0x7fc1cc144c70 0x7fc1cc0712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0b3810 con 0x7fc1cc1450d0 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fc1c40019f0 con 0x7fc1cc1450d0 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 >> v1:172.21.15.63:6789/0 conn(0x7fc1cc1450d0 legacy=0x7fc1cc0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.570+0000 7fc1c9400640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc0cfd60 0x7fc1b00039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1c9400640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1b0003f50 0x7fc1b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1c9400640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0004d40 0x7fc1b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b4b10 con 0x7fc1b0004d40 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b3530 con 0x7fc1b0003f50 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000b9c0 con 0x7fc1cc0cfd60 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1ca800640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0004d40 0x7fc1b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1c9e00640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc0cfd60 0x7fc1b00039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1c1400640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1b0003f50 0x7fc1b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1ca800640 1 -- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc0cfd60 msgr2=0x7fc1b00039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1ca800640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc0cfd60 0x7fc1b00039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1ca800640 1 -- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1b0003f50 msgr2=0x7fc1b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1ca800640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1b0003f50 0x7fc1b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.571+0000 7fc1ca800640 1 -- 172.21.15.63:0/1684358333 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0003520 con 0x7fc1b0004d40 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1ca800640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0004d40 0x7fc1b00051c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400a8b0 tx=0x7fc1b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5494ad35079d8dad server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c400a4a0 con 0x7fc1b0004d40 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c4034650 con 0x7fc1b0004d40 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1c9400640 1 -- 172.21.15.63:0/1684358333 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4034a80 con 0x7fc1b0004d40 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1d0a00640 1 -- 172.21.15.63:0/1684358333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0004d40 msgr2=0x7fc1b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1d0a00640 1 --2- 172.21.15.63:0/1684358333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0004d40 0x7fc1b00051c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400a8b0 tx=0x7fc1b0005830 comp rx=0 tx=0).stop 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1ca800640 1 -- 172.21.15.63:0/1684358333 reap_dead start 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1d0a00640 1 -- 172.21.15.63:0/1684358333 shutdown_connections 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1d0a00640 1 -- 172.21.15.63:0/1684358333 >> 172.21.15.63:0/1684358333 conn(0x7fc1cc06ac90 msgr2=0x7fc1cc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.573+0000 7fc1d0a00640 1 -- 172.21.15.63:0/1684358333 shutdown_connections 2024-03-26T06:18:17.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.574+0000 7fc1d0a00640 1 -- 172.21.15.63:0/1684358333 wait complete. 2024-03-26T06:18:17.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.575+0000 7fc1d0a00640 1 Processor -- start 2024-03-26T06:18:17.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.575+0000 7fc1d0a00640 1 -- start start 2024-03-26T06:18:17.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.576+0000 7fc1d0a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1cc0adcb0 0x7fc1cc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.576+0000 7fc1d0a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1cc0ae090 0x7fc1cc06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.576+0000 7fc1d0a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc15adc0 0x7fc1cc15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.576+0000 7fc1d0a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b40b0 con 0x7fc1cc0ae090 2024-03-26T06:18:17.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.576+0000 7fc1d0a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b3dd0 con 0x7fc1cc0adcb0 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.576+0000 7fc1d0a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b31c0 con 0x7fc1cc15adc0 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1cc0ae090 0x7fc1cc06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1cc0ae090 0x7fc1cc06ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36456/0 (socket says 172.21.15.63:36456) 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c1400640 1 -- 172.21.15.63:0/2199317408 learned_addr learned my addr 172.21.15.63:0/2199317408 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1ca800640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc15adc0 0x7fc1cc15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c1400640 1 -- 172.21.15.63:0/2199317408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc15adc0 msgr2=0x7fc1cc15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c9e00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1cc0adcb0 0x7fc1cc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c1400640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc15adc0 0x7fc1cc15b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c1400640 1 -- 172.21.15.63:0/2199317408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1cc0adcb0 msgr2=0x7fc1cc06d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c1400640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1cc0adcb0 0x7fc1cc06d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c1400640 1 -- 172.21.15.63:0/2199317408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc06d8d0 con 0x7fc1cc0ae090 2024-03-26T06:18:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.577+0000 7fc1c9e00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1cc0adcb0 0x7fc1cc06d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:17.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.578+0000 7fc1c1400640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1cc0ae090 0x7fc1cc06ed20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4011600 tx=0x7fc1b4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:17.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.578+0000 7fc1c2a00640 1 -- 172.21.15.63:0/2199317408 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400f920 con 0x7fc1cc0ae090 2024-03-26T06:18:17.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.578+0000 7fc1c2a00640 1 -- 172.21.15.63:0/2199317408 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b400fac0 con 0x7fc1cc0ae090 2024-03-26T06:18:17.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.578+0000 7fc1c2a00640 1 -- 172.21.15.63:0/2199317408 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400fe70 con 0x7fc1cc0ae090 2024-03-26T06:18:17.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.578+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1cc06dbb0 con 0x7fc1cc0ae090 2024-03-26T06:18:17.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.578+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc06e170 con 0x7fc1cc0ae090 2024-03-26T06:18:17.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.579+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1cc074730 con 0x7fc1cc0ae090 2024-03-26T06:18:17.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.580+0000 7fc1c2a00640 1 -- 172.21.15.63:0/2199317408 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc1b4015460 con 0x7fc1cc0ae090 2024-03-26T06:18:17.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.581+0000 7fc1c2a00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc1a806bbd0 0x7fc1a806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:17.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.581+0000 7fc1c2a00640 1 -- 172.21.15.63:0/2199317408 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc1b408b360 con 0x7fc1cc0ae090 2024-03-26T06:18:17.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.582+0000 7fc1c9e00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc1a806bbd0 0x7fc1a806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:17.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.582+0000 7fc1c9e00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc1a806bbd0 0x7fc1a806e090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0099e0 tx=0x7fc1bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:17.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.586+0000 7fc1c2a00640 1 -- 172.21.15.63:0/2199317408 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc1b4019030 con 0x7fc1cc0ae090 2024-03-26T06:18:17.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.792+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1cc15f1d0 con 0x7fc1cc0ae090 2024-03-26T06:18:17.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.793+0000 7fc1c2a00640 1 -- 172.21.15.63:0/2199317408 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1b4059ae0 con 0x7fc1cc0ae090 2024-03-26T06:18:17.794 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T06:18:17.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.795+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc1a806bbd0 msgr2=0x7fc1a806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.795+0000 7fc1d0a00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc1a806bbd0 0x7fc1a806e090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0099e0 tx=0x7fc1bc008040 comp rx=0 tx=0).stop 2024-03-26T06:18:17.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.795+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1cc0ae090 msgr2=0x7fc1cc06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:17.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.795+0000 7fc1d0a00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1cc0ae090 0x7fc1cc06ed20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4011600 tx=0x7fc1b4011ac0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.796+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 shutdown_connections 2024-03-26T06:18:17.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.796+0000 7fc1d0a00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc1a806bbd0 0x7fc1a806e090 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.796+0000 7fc1d0a00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1cc15adc0 0x7fc1cc15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.796+0000 7fc1d0a00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1cc0ae090 0x7fc1cc06ed20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.796+0000 7fc1d0a00640 1 --2- 172.21.15.63:0/2199317408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1cc0adcb0 0x7fc1cc06d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:17.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.796+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 >> 172.21.15.63:0/2199317408 conn(0x7fc1cc06ac90 msgr2=0x7fc1cc0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:17.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.796+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 shutdown_connections 2024-03-26T06:18:17.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:17.796+0000 7fc1d0a00640 1 -- 172.21.15.63:0/2199317408 wait complete. 2024-03-26T06:18:17.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-26T06:18:18.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.042+0000 7fa378e00640 1 Processor -- start 2024-03-26T06:18:18.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.042+0000 7fa378e00640 1 -- start start 2024-03-26T06:18:18.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.043+0000 7fa378e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa3740d3840 0x7fa3740d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.044+0000 7fa378e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3740d4160 con 0x7fa3740b9320 2024-03-26T06:18:18.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.044+0000 7fa378e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3740d22d0 con 0x7fa37415dca0 2024-03-26T06:18:18.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.044+0000 7fa378e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3740d2070 con 0x7fa3740d3840 2024-03-26T06:18:18.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.044+0000 7fa373400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa3740d3840 0x7fa3740d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.044+0000 7fa373400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa3740d3840 0x7fa3740d3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36468/0 (socket says 172.21.15.63:36468) 2024-03-26T06:18:18.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.044+0000 7fa373400640 1 -- 172.21.15.63:0/3928035875 learned_addr learned my addr 172.21.15.63:0/3928035875 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:18.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.045+0000 7fa373400640 1 -- 172.21.15.63:0/3928035875 >> v1:172.21.15.204:6789/0 conn(0x7fa37415dca0 legacy=0x7fa3740d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:18.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.045+0000 7fa373400640 1 -- 172.21.15.63:0/3928035875 >> v1:172.21.15.63:6789/0 conn(0x7fa3740b9320 legacy=0x7fa3740b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.045+0000 7fa373400640 1 -- 172.21.15.63:0/3928035875 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740d25b0 con 0x7fa3740d3840 2024-03-26T06:18:18.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.046+0000 7fa373400640 1 --2- 172.21.15.63:0/3928035875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3740d3840 0x7fa3740d3c20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa364009870 tx=0x7fa36402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4759a9df81d9c8e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.046+0000 7fa372000640 1 -- 172.21.15.63:0/3928035875 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364034070 con 0x7fa3740d3840 2024-03-26T06:18:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.046+0000 7fa372000640 1 -- 172.21.15.63:0/3928035875 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364030860 con 0x7fa3740d3840 2024-03-26T06:18:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.046+0000 7fa372000640 1 -- 172.21.15.63:0/3928035875 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364030c30 con 0x7fa3740d3840 2024-03-26T06:18:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.047+0000 7fa378e00640 1 -- 172.21.15.63:0/3928035875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3740d3840 msgr2=0x7fa3740d3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.047+0000 7fa378e00640 1 --2- 172.21.15.63:0/3928035875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3740d3840 0x7fa3740d3c20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa364009870 tx=0x7fa36402b9a0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.047+0000 7fa378e00640 1 -- 172.21.15.63:0/3928035875 shutdown_connections 2024-03-26T06:18:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.047+0000 7fa378e00640 1 --2- 172.21.15.63:0/3928035875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3740d3840 0x7fa3740d3c20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.047+0000 7fa378e00640 1 -- 172.21.15.63:0/3928035875 >> 172.21.15.63:0/3928035875 conn(0x7fa37406c570 msgr2=0x7fa37406c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.047+0000 7fa378e00640 1 -- 172.21.15.63:0/3928035875 shutdown_connections 2024-03-26T06:18:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.047+0000 7fa378e00640 1 -- 172.21.15.63:0/3928035875 wait complete. 2024-03-26T06:18:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.049+0000 7fa378e00640 1 Processor -- start 2024-03-26T06:18:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.049+0000 7fa378e00640 1 -- start start 2024-03-26T06:18:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.050+0000 7fa378e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3740b9320 0x7fa3741448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.050+0000 7fa378e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3740d3840 0x7fa3740c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.050+0000 7fa378e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37415dca0 0x7fa374146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.050+0000 7fa378e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740d2e50 con 0x7fa37415dca0 2024-03-26T06:18:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.050+0000 7fa378e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740d2b70 con 0x7fa3740b9320 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.050+0000 7fa378e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740d3370 con 0x7fa3740d3840 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.050+0000 7fa373e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37415dca0 0x7fa374146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.050+0000 7fa373e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37415dca0 0x7fa374146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36474/0 (socket says 172.21.15.63:36474) 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.050+0000 7fa373e00640 1 -- 172.21.15.63:0/3410492452 learned_addr learned my addr 172.21.15.63:0/3410492452 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa373400640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3740b9320 0x7fa3741448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa372a00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3740d3840 0x7fa3740c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa373e00640 1 -- 172.21.15.63:0/3410492452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3740d3840 msgr2=0x7fa3740c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa373e00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3740d3840 0x7fa3740c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa373e00640 1 -- 172.21.15.63:0/3410492452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3740b9320 msgr2=0x7fa3741448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa373e00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3740b9320 0x7fa3741448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa373e00640 1 -- 172.21.15.63:0/3410492452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3741452a0 con 0x7fa37415dca0 2024-03-26T06:18:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa372a00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3740d3840 0x7fa3740c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa373e00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37415dca0 0x7fa374146340 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00c7a0 tx=0x7fa36c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa36b400640 1 -- 172.21.15.63:0/3410492452 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c003b70 con 0x7fa37415dca0 2024-03-26T06:18:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa36b400640 1 -- 172.21.15.63:0/3410492452 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c003d30 con 0x7fa37415dca0 2024-03-26T06:18:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.051+0000 7fa36b400640 1 -- 172.21.15.63:0/3410492452 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00aa90 con 0x7fa37415dca0 2024-03-26T06:18:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.052+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa374145580 con 0x7fa37415dca0 2024-03-26T06:18:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.052+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa374145e20 con 0x7fa37415dca0 2024-03-26T06:18:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.053+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa374145750 con 0x7fa37415dca0 2024-03-26T06:18:18.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.054+0000 7fa36b400640 1 -- 172.21.15.63:0/3410492452 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa36c00ac30 con 0x7fa37415dca0 2024-03-26T06:18:18.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.055+0000 7fa36b400640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa35006bbd0 0x7fa35006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.055+0000 7fa36b400640 1 -- 172.21.15.63:0/3410492452 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa36c08adc0 con 0x7fa37415dca0 2024-03-26T06:18:18.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.055+0000 7fa373400640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa35006bbd0 0x7fa35006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.056+0000 7fa373400640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa35006bbd0 0x7fa35006e090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa364036000 tx=0x7fa36403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:18.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.060+0000 7fa36b400640 1 -- 172.21.15.63:0/3410492452 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa36c0594a0 con 0x7fa37415dca0 2024-03-26T06:18:18.103 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:18:18.109 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:18:18.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.265+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa37404f0c0 con 0x7fa37415dca0 2024-03-26T06:18:18.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.266+0000 7fa36b400640 1 -- 172.21.15.63:0/3410492452 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa36c058da0 con 0x7fa37415dca0 2024-03-26T06:18:18.267 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T06:18:18.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa35006bbd0 msgr2=0x7fa35006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa35006bbd0 0x7fa35006e090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa364036000 tx=0x7fa36403b040 comp rx=0 tx=0).stop 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37415dca0 msgr2=0x7fa374146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37415dca0 0x7fa374146340 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00c7a0 tx=0x7fa36c00cc60 comp rx=0 tx=0).stop 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 shutdown_connections 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa35006bbd0 0x7fa35006e090 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37415dca0 0x7fa374146340 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3740d3840 0x7fa3740c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 --2- 172.21.15.63:0/3410492452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3740b9320 0x7fa3741448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 >> 172.21.15.63:0/3410492452 conn(0x7fa37406c570 msgr2=0x7fa37415c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 shutdown_connections 2024-03-26T06:18:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.269+0000 7fa378e00640 1 -- 172.21.15.63:0/3410492452 wait complete. 2024-03-26T06:18:18.289 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:18:18.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.557+0000 7fb3aee00640 1 Processor -- start 2024-03-26T06:18:18.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.557+0000 7fb3aee00640 1 -- start start 2024-03-26T06:18:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.559+0000 7fb3aee00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb3a8071e50 0x7fb3a815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.559+0000 7fb3aee00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3a8072230 0x7fb3a815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.559+0000 7fb3aee00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a806d450 con 0x7fb3a80cb980 2024-03-26T06:18:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.559+0000 7fb3aee00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a806dd80 con 0x7fb3a8072230 2024-03-26T06:18:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.559+0000 7fb3aee00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a806d730 con 0x7fb3a8071e50 2024-03-26T06:18:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.559+0000 7fb39f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3a8072230 0x7fb3a815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.559+0000 7fb39f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3a8072230 0x7fb3a815e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36478/0 (socket says 172.21.15.63:36478) 2024-03-26T06:18:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.559+0000 7fb39f400640 1 -- 172.21.15.63:0/2955790726 learned_addr learned my addr 172.21.15.63:0/2955790726 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.559+0000 7fb3ace00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb3a80cb980 0x7fb3a80cbdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35672/0 (socket says 172.21.15.63:35672) 2024-03-26T06:18:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.560+0000 7fb3a7e00640 1 --2- 172.21.15.63:0/2955790726 >> v2:172.21.15.204:3300/0 conn(0x7fb3a8071e50 0x7fb3a815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.560+0000 7fb39f400640 1 -- 172.21.15.63:0/2955790726 >> v2:172.21.15.204:3300/0 conn(0x7fb3a8071e50 msgr2=0x7fb3a815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.560+0000 7fb39f400640 1 --2- 172.21.15.63:0/2955790726 >> v2:172.21.15.204:3300/0 conn(0x7fb3a8071e50 0x7fb3a815dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.560+0000 7fb39f400640 1 -- 172.21.15.63:0/2955790726 >> v1:172.21.15.63:6789/0 conn(0x7fb3a80cb980 legacy=0x7fb3a80cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.560+0000 7fb39f400640 1 -- 172.21.15.63:0/2955790726 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a806da10 con 0x7fb3a8072230 2024-03-26T06:18:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.560+0000 7fb3a7400640 1 -- 172.21.15.63:0/2955790726 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793682893 0 0) 0x7fb3a806d450 con 0x7fb3a80cb980 2024-03-26T06:18:18.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.561+0000 7fb39f400640 1 --2- 172.21.15.63:0/2955790726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8072230 0x7fb3a815e1a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80b24a0 tx=0x7fb39002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe8af958b1e4ecf server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:18.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.561+0000 7fb3a7400640 1 -- 172.21.15.63:0/2955790726 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39002cb20 con 0x7fb3a8072230 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.561+0000 7fb3a7400640 1 -- 172.21.15.63:0/2955790726 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39002ccc0 con 0x7fb3a8072230 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.561+0000 7fb3a7400640 1 -- 172.21.15.63:0/2955790726 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390034610 con 0x7fb3a8072230 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.562+0000 7fb3aee00640 1 -- 172.21.15.63:0/2955790726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8072230 msgr2=0x7fb3a815e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.562+0000 7fb3aee00640 1 --2- 172.21.15.63:0/2955790726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8072230 0x7fb3a815e1a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80b24a0 tx=0x7fb39002bf80 comp rx=0 tx=0).stop 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.562+0000 7fb3aee00640 1 -- 172.21.15.63:0/2955790726 shutdown_connections 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.562+0000 7fb3aee00640 1 --2- 172.21.15.63:0/2955790726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8072230 0x7fb3a815e1a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.562+0000 7fb3aee00640 1 --2- 172.21.15.63:0/2955790726 >> v2:172.21.15.204:3300/0 conn(0x7fb3a8071e50 0x7fb3a815dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.562+0000 7fb3aee00640 1 -- 172.21.15.63:0/2955790726 >> 172.21.15.63:0/2955790726 conn(0x7fb3a806ac90 msgr2=0x7fb3a806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.562+0000 7fb3aee00640 1 -- 172.21.15.63:0/2955790726 shutdown_connections 2024-03-26T06:18:18.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.562+0000 7fb3aee00640 1 -- 172.21.15.63:0/2955790726 wait complete. 2024-03-26T06:18:18.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.564+0000 7fb3aee00640 1 Processor -- start 2024-03-26T06:18:18.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.564+0000 7fb3aee00640 1 -- start start 2024-03-26T06:18:18.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.565+0000 7fb3aee00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8071e50 0x7fb3a813ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.565+0000 7fb3aee00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3a8072230 0x7fb3a8156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.565+0000 7fb3aee00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3a80cb980 0x7fb3a80b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.565+0000 7fb3aee00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a806e1f0 con 0x7fb3a8071e50 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.565+0000 7fb3aee00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a815e6e0 con 0x7fb3a8072230 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.565+0000 7fb3aee00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a806e370 con 0x7fb3a80cb980 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.565+0000 7fb3a7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8071e50 0x7fb3a813ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.565+0000 7fb3a7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8071e50 0x7fb3a813ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36494/0 (socket says 172.21.15.63:36494) 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.565+0000 7fb3a7e00640 1 -- 172.21.15.63:0/1226393386 learned_addr learned my addr 172.21.15.63:0/1226393386 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3ace00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3a80cb980 0x7fb3a80b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3a7e00640 1 -- 172.21.15.63:0/1226393386 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3a80cb980 msgr2=0x7fb3a80b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb39f400640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3a8072230 0x7fb3a8156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3a7e00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3a80cb980 0x7fb3a80b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3a7e00640 1 -- 172.21.15.63:0/1226393386 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3a8072230 msgr2=0x7fb3a8156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3a7e00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3a8072230 0x7fb3a8156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3a7e00640 1 -- 172.21.15.63:0/1226393386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8150310 con 0x7fb3a8071e50 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3ace00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3a80cb980 0x7fb3a80b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3a7e00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8071e50 0x7fb3a813ab30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb39800d830 tx=0x7fb39800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3a4c00640 1 -- 172.21.15.63:0/1226393386 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39800b6c0 con 0x7fb3a8071e50 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3a4c00640 1 -- 172.21.15.63:0/1226393386 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb398019070 con 0x7fb3a8071e50 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3a4c00640 1 -- 172.21.15.63:0/1226393386 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39800ba80 con 0x7fb3a8071e50 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a81505f0 con 0x7fb3a8071e50 2024-03-26T06:18:18.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.566+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a8150bb0 con 0x7fb3a8071e50 2024-03-26T06:18:18.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.567+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a8074730 con 0x7fb3a8071e50 2024-03-26T06:18:18.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.568+0000 7fb3a4c00640 1 -- 172.21.15.63:0/1226393386 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb39801e460 con 0x7fb3a8071e50 2024-03-26T06:18:18.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.570+0000 7fb3a4c00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb38406bbd0 0x7fb38406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:18.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.570+0000 7fb3a4c00640 1 -- 172.21.15.63:0/1226393386 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb39808b550 con 0x7fb3a8071e50 2024-03-26T06:18:18.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.570+0000 7fb39f400640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb38406bbd0 0x7fb38406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:18.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.571+0000 7fb39f400640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb38406bbd0 0x7fb38406e090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb390035000 tx=0x7fb390030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:18.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.575+0000 7fb3a4c00640 1 -- 172.21.15.63:0/1226393386 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb398059c40 con 0x7fb3a8071e50 2024-03-26T06:18:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.816+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3a806ef10 con 0x7fb3a8071e50 2024-03-26T06:18:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.817+0000 7fb3a4c00640 1 -- 172.21.15.63:0/1226393386 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4937 (secure 0 0 0) 0x7fb398059540 con 0x7fb3a8071e50 2024-03-26T06:18:18.819 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:18.819 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:20.131439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-26T06:18:18.819 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-03-26T06:18:18.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb38406bbd0 msgr2=0x7fb38406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb38406bbd0 0x7fb38406e090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb390035000 tx=0x7fb390030000 comp rx=0 tx=0).stop 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8071e50 msgr2=0x7fb3a813ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8071e50 0x7fb3a813ab30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb39800d830 tx=0x7fb39800dcf0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 shutdown_connections 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb38406bbd0 0x7fb38406e090 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3a80cb980 0x7fb3a80b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3a8072230 0x7fb3a8156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 --2- 172.21.15.63:0/1226393386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a8071e50 0x7fb3a813ab30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.820+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 >> 172.21.15.63:0/1226393386 conn(0x7fb3a806ac90 msgr2=0x7fb3a8071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.821+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 shutdown_connections 2024-03-26T06:18:18.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:18.821+0000 7fb3aee00640 1 -- 172.21.15.63:0/1226393386 wait complete. 2024-03-26T06:18:18.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:19.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.059+0000 7f5590c00640 1 Processor -- start 2024-03-26T06:18:19.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.059+0000 7f5590c00640 1 -- start start 2024-03-26T06:18:19.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.060+0000 7f5590c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f558c0b4c50 0x7f558c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.060+0000 7f5590c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c0b5030 0x7f558c15f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.060+0000 7f5590c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f558c15f880 0x7f558c144b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.060+0000 7f5590c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c0cc070 con 0x7f558c0b4c50 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.060+0000 7f5590c00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c15fde0 con 0x7f558c15f880 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.060+0000 7f5590c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c1600c0 con 0x7f558c0b5030 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f558c0b4c50 0x7f558c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f558c0b4c50 0x7f558c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36510/0 (socket says 172.21.15.63:36510) 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558b400640 1 -- 172.21.15.63:0/1505537742 learned_addr learned my addr 172.21.15.63:0/1505537742 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558be00640 1 --2- 172.21.15.63:0/1505537742 >> v2:172.21.15.204:3300/0 conn(0x7f558c15f880 0x7f558c144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558aa00640 1 --2- 172.21.15.63:0/1505537742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c0b5030 0x7f558c15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558b400640 1 -- 172.21.15.63:0/1505537742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c0b5030 msgr2=0x7f558c15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:19.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558b400640 1 --2- 172.21.15.63:0/1505537742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c0b5030 0x7f558c15f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558b400640 1 -- 172.21.15.63:0/1505537742 >> v2:172.21.15.204:3300/0 conn(0x7f558c15f880 msgr2=0x7f558c144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:19.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558b400640 1 --2- 172.21.15.63:0/1505537742 >> v2:172.21.15.204:3300/0 conn(0x7f558c15f880 0x7f558c144b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.061+0000 7f558b400640 1 -- 172.21.15.63:0/1505537742 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c0cc310 con 0x7f558c0b4c50 2024-03-26T06:18:19.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.062+0000 7f558b400640 1 --2- 172.21.15.63:0/1505537742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 0x7f558c0ccaf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f558c0cd4c0 tx=0x7f557c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d8a99afd6f20fd server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:19.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f558a000640 1 -- 172.21.15.63:0/1505537742 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c034070 con 0x7f558c0b4c50 2024-03-26T06:18:19.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f558a000640 1 -- 172.21.15.63:0/1505537742 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c030860 con 0x7f558c0b4c50 2024-03-26T06:18:19.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f558a000640 1 -- 172.21.15.63:0/1505537742 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c030c30 con 0x7f558c0b4c50 2024-03-26T06:18:19.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f5590c00640 1 -- 172.21.15.63:0/1505537742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 msgr2=0x7f558c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f5590c00640 1 --2- 172.21.15.63:0/1505537742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 0x7f558c0ccaf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f558c0cd4c0 tx=0x7f557c02b9a0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f5590c00640 1 -- 172.21.15.63:0/1505537742 shutdown_connections 2024-03-26T06:18:19.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f5590c00640 1 --2- 172.21.15.63:0/1505537742 >> v2:172.21.15.204:3300/0 conn(0x7f558c15f880 0x7f558c144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f5590c00640 1 --2- 172.21.15.63:0/1505537742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c0b5030 0x7f558c15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f5590c00640 1 --2- 172.21.15.63:0/1505537742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 0x7f558c0ccaf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f5590c00640 1 -- 172.21.15.63:0/1505537742 >> 172.21.15.63:0/1505537742 conn(0x7f558c0b13d0 msgr2=0x7f558c0b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:19.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f5590c00640 1 -- 172.21.15.63:0/1505537742 shutdown_connections 2024-03-26T06:18:19.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.063+0000 7f5590c00640 1 -- 172.21.15.63:0/1505537742 wait complete. 2024-03-26T06:18:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.065+0000 7f5590c00640 1 Processor -- start 2024-03-26T06:18:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.065+0000 7f5590c00640 1 -- start start 2024-03-26T06:18:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.066+0000 7f5590c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 0x7f558c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.066+0000 7f5590c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f558c0b5030 0x7f558c136f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.066+0000 7f5590c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c15f880 0x7f558c0a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.066+0000 7f5590c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c145090 con 0x7f558c0b4c50 2024-03-26T06:18:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.066+0000 7f5590c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c06eb70 con 0x7f558c0b5030 2024-03-26T06:18:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.066+0000 7f5590c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c145210 con 0x7f558c15f880 2024-03-26T06:18:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.066+0000 7f558b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 0x7f558c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.066+0000 7f558b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 0x7f558c0affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36518/0 (socket says 172.21.15.63:36518) 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.066+0000 7f558b400640 1 -- 172.21.15.63:0/2762980328 learned_addr learned my addr 172.21.15.63:0/2762980328 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.067+0000 7f558be00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c15f880 0x7f558c0a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.067+0000 7f558b400640 1 -- 172.21.15.63:0/2762980328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c15f880 msgr2=0x7f558c0a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.067+0000 7f558b400640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c15f880 0x7f558c0a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.067+0000 7f558b400640 1 -- 172.21.15.63:0/2762980328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f558c0b5030 msgr2=0x7f558c136f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.067+0000 7f558aa00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f558c0b5030 0x7f558c136f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.067+0000 7f558b400640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f558c0b5030 0x7f558c136f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.067+0000 7f558b400640 1 -- 172.21.15.63:0/2762980328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c1e6da0 con 0x7f558c0b4c50 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.067+0000 7f558be00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c15f880 0x7f558c0a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.067+0000 7f558b400640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 0x7f558c0affa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f557c000c00 tx=0x7f557c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.068+0000 7f5583400640 1 -- 172.21.15.63:0/2762980328 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c048070 con 0x7f558c0b4c50 2024-03-26T06:18:19.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.068+0000 7f5583400640 1 -- 172.21.15.63:0/2762980328 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c039d90 con 0x7f558c0b4c50 2024-03-26T06:18:19.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.068+0000 7f5583400640 1 -- 172.21.15.63:0/2762980328 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c034040 con 0x7f558c0b4c50 2024-03-26T06:18:19.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.068+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558c1e7080 con 0x7f558c0b4c50 2024-03-26T06:18:19.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.068+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558c1e7640 con 0x7f558c0b4c50 2024-03-26T06:18:19.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.069+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558c04f050 con 0x7f558c0b4c50 2024-03-26T06:18:19.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.070+0000 7f5583400640 1 -- 172.21.15.63:0/2762980328 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f557c04b070 con 0x7f558c0b4c50 2024-03-26T06:18:19.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.071+0000 7f5583400640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f556c06bbd0 0x7f556c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.071+0000 7f5583400640 1 -- 172.21.15.63:0/2762980328 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f557c0ad0f0 con 0x7f558c0b4c50 2024-03-26T06:18:19.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.071+0000 7f558aa00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f556c06bbd0 0x7f556c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.072+0000 7f558aa00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f556c06bbd0 0x7f556c06e090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f558c0cb400 tx=0x7f5578008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:19.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.075+0000 7f5583400640 1 -- 172.21.15.63:0/2762980328 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f557c07b900 con 0x7f558c0b4c50 2024-03-26T06:18:19.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.278+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f558c1444e0 con 0x7f558c0b4c50 2024-03-26T06:18:19.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.281+0000 7f5583400640 1 -- 172.21.15.63:0/2762980328 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7f557c07b200 con 0x7f558c0b4c50 2024-03-26T06:18:19.283 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:19.283 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:19.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.283+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f556c06bbd0 msgr2=0x7f556c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.283+0000 7f5590c00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f556c06bbd0 0x7f556c06e090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f558c0cb400 tx=0x7f5578008040 comp rx=0 tx=0).stop 2024-03-26T06:18:19.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.283+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 msgr2=0x7f558c0affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.283+0000 7f5590c00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 0x7f558c0affa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f557c000c00 tx=0x7f557c004730 comp rx=0 tx=0).stop 2024-03-26T06:18:19.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.284+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 shutdown_connections 2024-03-26T06:18:19.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.284+0000 7f5590c00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f556c06bbd0 0x7f556c06e090 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.284+0000 7f5590c00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f558c15f880 0x7f558c0a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.284+0000 7f5590c00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f558c0b5030 0x7f558c136f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.284+0000 7f5590c00640 1 --2- 172.21.15.63:0/2762980328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f558c0b4c50 0x7f558c0affa0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.284+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 >> 172.21.15.63:0/2762980328 conn(0x7f558c0b13d0 msgr2=0x7f558c0b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:19.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.284+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 shutdown_connections 2024-03-26T06:18:19.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.284+0000 7f5590c00640 1 -- 172.21.15.63:0/2762980328 wait complete. 2024-03-26T06:18:19.304 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-26T06:18:19.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:18:19.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.495+0000 7fe50f200640 1 Processor -- start 2024-03-26T06:18:19.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.495+0000 7fe50f200640 1 -- start start 2024-03-26T06:18:19.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.496+0000 7fe50f200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 0x7fe5100ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50f200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe510144b50 0x7fe510144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50f200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5100cc070 con 0x7fe5100b5030 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50f200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51015fde0 con 0x7fe510144b50 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50f200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101600c0 con 0x7fe5100b4c50 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50e800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe510144b50 0x7fe510144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50e800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe510144b50 0x7fe510144fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36528/0 (socket says 172.21.15.63:36528) 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50e800640 1 -- 172.21.15.63:0/1123427731 learned_addr learned my addr 172.21.15.63:0/1123427731 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50de00640 1 --2- 172.21.15.63:0/1123427731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 0x7fe5100ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50e800640 1 -- 172.21.15.63:0/1123427731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 msgr2=0x7fe5100ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50e800640 1 --2- 172.21.15.63:0/1123427731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 0x7fe5100ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50e800640 1 -- 172.21.15.63:0/1123427731 >> v1:172.21.15.204:6789/0 conn(0x7fe5100b5030 legacy=0x7fe51015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50e800640 1 -- 172.21.15.63:0/1123427731 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100cc310 con 0x7fe510144b50 2024-03-26T06:18:19.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.497+0000 7fe50de00640 1 --2- 172.21.15.63:0/1123427731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 0x7fe5100ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.498+0000 7fe50e800640 1 --2- 172.21.15.63:0/1123427731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe510144b50 0x7fe510144fe0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe508009e50 tx=0x7fe50802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8edec01d49a690 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50d400640 1 -- 172.21.15.63:0/1123427731 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50802caf0 con 0x7fe510144b50 2024-03-26T06:18:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50d400640 1 -- 172.21.15.63:0/1123427731 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50802cc90 con 0x7fe510144b50 2024-03-26T06:18:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50d400640 1 -- 172.21.15.63:0/1123427731 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508034610 con 0x7fe510144b50 2024-03-26T06:18:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50f200640 1 -- 172.21.15.63:0/1123427731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe510144b50 msgr2=0x7fe510144fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50f200640 1 --2- 172.21.15.63:0/1123427731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe510144b50 0x7fe510144fe0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe508009e50 tx=0x7fe50802bf50 comp rx=0 tx=0).stop 2024-03-26T06:18:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50f200640 1 -- 172.21.15.63:0/1123427731 shutdown_connections 2024-03-26T06:18:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50f200640 1 --2- 172.21.15.63:0/1123427731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe510144b50 0x7fe510144fe0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50f200640 1 --2- 172.21.15.63:0/1123427731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 0x7fe5100ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50f200640 1 -- 172.21.15.63:0/1123427731 >> 172.21.15.63:0/1123427731 conn(0x7fe5100b13d0 msgr2=0x7fe5100b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:19.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50f200640 1 -- 172.21.15.63:0/1123427731 shutdown_connections 2024-03-26T06:18:19.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.499+0000 7fe50f200640 1 -- 172.21.15.63:0/1123427731 wait complete. 2024-03-26T06:18:19.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.501+0000 7fe50f200640 1 Processor -- start 2024-03-26T06:18:19.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.501+0000 7fe50f200640 1 -- start start 2024-03-26T06:18:19.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.502+0000 7fe50f200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 0x7fe5100c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.502+0000 7fe50f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5100b5030 0x7fe51015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.502+0000 7fe50f200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe510144b50 0x7fe5100cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.502+0000 7fe50f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51015fa50 con 0x7fe5100b5030 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.502+0000 7fe50f200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51006eb70 con 0x7fe510144b50 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.502+0000 7fe50f200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51006d280 con 0x7fe5100b4c50 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.502+0000 7fe507e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5100b5030 0x7fe51015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.502+0000 7fe507e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5100b5030 0x7fe51015adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36540/0 (socket says 172.21.15.63:36540) 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.502+0000 7fe507e00640 1 -- 172.21.15.63:0/667889502 learned_addr learned my addr 172.21.15.63:0/667889502 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe507e00640 1 -- 172.21.15.63:0/667889502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 msgr2=0x7fe5100c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe507e00640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 0x7fe5100c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe507e00640 1 -- 172.21.15.63:0/667889502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe510144b50 msgr2=0x7fe5100cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe507e00640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe510144b50 0x7fe5100cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe507e00640 1 -- 172.21.15.63:0/667889502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51015b300 con 0x7fe5100b5030 2024-03-26T06:18:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe507e00640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5100b5030 0x7fe51015adc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800c440 tx=0x7fe4f800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe506000640 1 -- 172.21.15.63:0/667889502 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8017070 con 0x7fe5100b5030 2024-03-26T06:18:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe506000640 1 -- 172.21.15.63:0/667889502 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f80035f0 con 0x7fe5100b5030 2024-03-26T06:18:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe506000640 1 -- 172.21.15.63:0/667889502 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80039e0 con 0x7fe5100b5030 2024-03-26T06:18:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5100cb5b0 con 0x7fe5100b5030 2024-03-26T06:18:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.503+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5100c9d20 con 0x7fe5100b5030 2024-03-26T06:18:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.504+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe51004f050 con 0x7fe5100b5030 2024-03-26T06:18:19.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.505+0000 7fe506000640 1 -- 172.21.15.63:0/667889502 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe4f8003b80 con 0x7fe5100b5030 2024-03-26T06:18:19.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.506+0000 7fe506000640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe4ec06bbd0 0x7fe4ec06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.506+0000 7fe506000640 1 -- 172.21.15.63:0/667889502 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe4f808a230 con 0x7fe5100b5030 2024-03-26T06:18:19.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.506+0000 7fe50de00640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe4ec06bbd0 0x7fe4ec06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.507+0000 7fe50de00640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe4ec06bbd0 0x7fe4ec06e090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe500006fd0 tx=0x7fe500008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:19.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.511+0000 7fe506000640 1 -- 172.21.15.63:0/667889502 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe4f80587f0 con 0x7fe5100b5030 2024-03-26T06:18:19.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.748+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5100b0e60 con 0x7fe5100b5030 2024-03-26T06:18:19.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.749+0000 7fe506000640 1 -- 172.21.15.63:0/667889502 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4937 (secure 0 0 0) 0x7fe4f80010c0 con 0x7fe5100b5030 2024-03-26T06:18:19.751 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:19.751 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:20.131439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-26T06:18:19.751 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe4ec06bbd0 msgr2=0x7fe4ec06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe4ec06bbd0 0x7fe4ec06e090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe500006fd0 tx=0x7fe500008040 comp rx=0 tx=0).stop 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5100b5030 msgr2=0x7fe51015adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5100b5030 0x7fe51015adc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800c440 tx=0x7fe4f800c900 comp rx=0 tx=0).stop 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 shutdown_connections 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe4ec06bbd0 0x7fe4ec06e090 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe510144b50 0x7fe5100cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5100b5030 0x7fe51015adc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 --2- 172.21.15.63:0/667889502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5100b4c50 0x7fe5100c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.752+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 >> 172.21.15.63:0/667889502 conn(0x7fe5100b13d0 msgr2=0x7fe51015f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:19.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.753+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 shutdown_connections 2024-03-26T06:18:19.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.753+0000 7fe50f200640 1 -- 172.21.15.63:0/667889502 wait complete. 2024-03-26T06:18:19.772 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:18:19.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.981+0000 7f4b85000640 1 Processor -- start 2024-03-26T06:18:19.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.981+0000 7f4b85000640 1 -- start start 2024-03-26T06:18:19.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.982+0000 7f4b85000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b800b5030 0x7f4b800ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.982+0000 7f4b85000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4b80144b50 0x7f4b80144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.982+0000 7f4b85000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b800cc070 con 0x7f4b800b4c50 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.982+0000 7f4b85000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8015fde0 con 0x7f4b800b5030 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.982+0000 7f4b85000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b801600c0 con 0x7f4b80144b50 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.983+0000 7f4b7ea00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b800b5030 0x7f4b800ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.983+0000 7f4b7ea00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b800b5030 0x7f4b800ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36550/0 (socket says 172.21.15.63:36550) 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.983+0000 7f4b7ea00640 1 -- 172.21.15.63:0/1634350235 learned_addr learned my addr 172.21.15.63:0/1634350235 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.983+0000 7f4b7ea00640 1 -- 172.21.15.63:0/1634350235 >> v2:172.21.15.204:3300/0 conn(0x7f4b80144b50 msgr2=0x7f4b80144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.983+0000 7f4b7fe00640 1 --2- 172.21.15.63:0/1634350235 >> v2:172.21.15.204:3300/0 conn(0x7f4b80144b50 0x7f4b80144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.983+0000 7f4b7ea00640 1 --2- 172.21.15.63:0/1634350235 >> v2:172.21.15.204:3300/0 conn(0x7f4b80144b50 0x7f4b80144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.983+0000 7f4b7ea00640 1 -- 172.21.15.63:0/1634350235 >> v1:172.21.15.204:6789/0 conn(0x7f4b800b4c50 legacy=0x7f4b8015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:19.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.983+0000 7f4b7ea00640 1 -- 172.21.15.63:0/1634350235 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800cc310 con 0x7f4b800b5030 2024-03-26T06:18:19.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.983+0000 7f4b7fe00640 1 --2- 172.21.15.63:0/1634350235 >> v2:172.21.15.204:3300/0 conn(0x7f4b80144b50 0x7f4b80144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:19.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.984+0000 7f4b7ea00640 1 --2- 172.21.15.63:0/1634350235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b800b5030 0x7f4b800ccaf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009870 tx=0x7f4b6c02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dc9e9760ee6bee server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:19.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.984+0000 7f4b7e000640 1 -- 172.21.15.63:0/1634350235 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c034070 con 0x7f4b800b5030 2024-03-26T06:18:19.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b7e000640 1 -- 172.21.15.63:0/1634350235 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c030850 con 0x7f4b800b5030 2024-03-26T06:18:19.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b7e000640 1 -- 172.21.15.63:0/1634350235 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c030c20 con 0x7f4b800b5030 2024-03-26T06:18:19.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b85000640 1 -- 172.21.15.63:0/1634350235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b800b5030 msgr2=0x7f4b800ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b85000640 1 --2- 172.21.15.63:0/1634350235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b800b5030 0x7f4b800ccaf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009870 tx=0x7f4b6c02b990 comp rx=0 tx=0).stop 2024-03-26T06:18:19.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b85000640 1 -- 172.21.15.63:0/1634350235 shutdown_connections 2024-03-26T06:18:19.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b85000640 1 --2- 172.21.15.63:0/1634350235 >> v2:172.21.15.204:3300/0 conn(0x7f4b80144b50 0x7f4b80144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b85000640 1 --2- 172.21.15.63:0/1634350235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b800b5030 0x7f4b800ccaf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b85000640 1 -- 172.21.15.63:0/1634350235 >> 172.21.15.63:0/1634350235 conn(0x7f4b800b13d0 msgr2=0x7f4b800b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:19.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b85000640 1 -- 172.21.15.63:0/1634350235 shutdown_connections 2024-03-26T06:18:19.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.985+0000 7f4b85000640 1 -- 172.21.15.63:0/1634350235 wait complete. 2024-03-26T06:18:19.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.987+0000 7f4b85000640 1 Processor -- start 2024-03-26T06:18:19.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.987+0000 7f4b85000640 1 -- start start 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.988+0000 7f4b85000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800b4c50 0x7f4b800ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.988+0000 7f4b85000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b800b5030 0x7f4b8015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.988+0000 7f4b85000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b80144b50 0x7f4b8015e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.988+0000 7f4b85000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8015fa50 con 0x7f4b80144b50 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.988+0000 7f4b85000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8006eb70 con 0x7f4b800b4c50 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.988+0000 7f4b85000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8006d280 con 0x7f4b800b5030 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.988+0000 7f4b7fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b80144b50 0x7f4b8015e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.988+0000 7f4b7fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b80144b50 0x7f4b8015e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36552/0 (socket says 172.21.15.63:36552) 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.988+0000 7f4b7fe00640 1 -- 172.21.15.63:0/2975322760 learned_addr learned my addr 172.21.15.63:0/2975322760 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b7ea00640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b800b5030 0x7f4b8015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b7fe00640 1 -- 172.21.15.63:0/2975322760 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b800b5030 msgr2=0x7f4b8015e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b7fe00640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b800b5030 0x7f4b8015e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b7fe00640 1 -- 172.21.15.63:0/2975322760 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800b4c50 msgr2=0x7f4b800ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b7f400640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800b4c50 0x7f4b800ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b7fe00640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800b4c50 0x7f4b800ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b7fe00640 1 -- 172.21.15.63:0/2975322760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b801e7cf0 con 0x7f4b80144b50 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b7f400640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800b4c50 0x7f4b800ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b7fe00640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b80144b50 0x7f4b8015e850 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c7c0 tx=0x7f4b7800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b77400640 1 -- 172.21.15.63:0/2975322760 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78015020 con 0x7f4b80144b50 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b77400640 1 -- 172.21.15.63:0/2975322760 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78004230 con 0x7f4b80144b50 2024-03-26T06:18:19.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b77400640 1 -- 172.21.15.63:0/2975322760 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78007620 con 0x7f4b80144b50 2024-03-26T06:18:19.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b801e7fd0 con 0x7f4b80144b50 2024-03-26T06:18:19.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.989+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b801e8590 con 0x7f4b80144b50 2024-03-26T06:18:19.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.990+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b80067ce0 con 0x7f4b80144b50 2024-03-26T06:18:19.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.991+0000 7f4b77400640 1 -- 172.21.15.63:0/2975322760 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4b78018020 con 0x7f4b80144b50 2024-03-26T06:18:19.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.992+0000 7f4b77400640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4b6006bbd0 0x7f4b6006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:19.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.992+0000 7f4b77400640 1 -- 172.21.15.63:0/2975322760 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4b7808af90 con 0x7f4b80144b50 2024-03-26T06:18:19.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.992+0000 7f4b7f400640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4b6006bbd0 0x7f4b6006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:19.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.993+0000 7f4b7f400640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4b6006bbd0 0x7f4b6006e090 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b70004520 tx=0x7f4b70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:19.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:19.997+0000 7f4b77400640 1 -- 172.21.15.63:0/2975322760 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f4b80067ce0 con 0x7f4b80144b50 2024-03-26T06:18:20.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.227+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b8004f050 con 0x7f4b80144b50 2024-03-26T06:18:20.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.228+0000 7f4b77400640 1 -- 172.21.15.63:0/2975322760 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4937 (secure 0 0 0) 0x7f4b7801f020 con 0x7f4b80144b50 2024-03-26T06:18:20.230 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:20.230 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1591547506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":1591547506},{"type":"v1","addr":"172.21.15.63:6837","nonce":1591547506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1602543025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1602543025},{"type":"v1","addr":"172.21.15.204:6833","nonce":1602543025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/3021652525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":3021652525},{"type":"v1","addr":"172.21.15.63:6836","nonce":3021652525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:16:57.955344+0000","modified":"2024-03-26T06:17:20.131439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/135702470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":135702470},{"type":"v1","addr":"172.21.15.204:6835","nonce":135702470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-26T06:18:20.230 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-03-26T06:18:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.230+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4b6006bbd0 msgr2=0x7f4b6006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.230+0000 7f4b85000640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4b6006bbd0 0x7f4b6006e090 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b70004520 tx=0x7f4b70009040 comp rx=0 tx=0).stop 2024-03-26T06:18:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.230+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b80144b50 msgr2=0x7f4b8015e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.230+0000 7f4b85000640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b80144b50 0x7f4b8015e850 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c7c0 tx=0x7f4b7800cc80 comp rx=0 tx=0).stop 2024-03-26T06:18:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.231+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 shutdown_connections 2024-03-26T06:18:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.231+0000 7f4b85000640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4b6006bbd0 0x7f4b6006e090 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.231+0000 7f4b85000640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b80144b50 0x7f4b8015e850 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.231+0000 7f4b85000640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b800b5030 0x7f4b8015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.231+0000 7f4b85000640 1 --2- 172.21.15.63:0/2975322760 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800b4c50 0x7f4b800ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.231+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 >> 172.21.15.63:0/2975322760 conn(0x7f4b800b13d0 msgr2=0x7f4b80071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.231+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 shutdown_connections 2024-03-26T06:18:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.231+0000 7f4b85000640 1 -- 172.21.15.63:0/2975322760 wait complete. 2024-03-26T06:18:20.250 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:20.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.464+0000 7f634f200640 1 Processor -- start 2024-03-26T06:18:20.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.464+0000 7f634f200640 1 -- start start 2024-03-26T06:18:20.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.466+0000 7f634f200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f635015a600 0x7f635006ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.466+0000 7f634f200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f63500ccbd0 0x7f63500b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.466+0000 7f634f200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635015a9e0 con 0x7f635006f160 2024-03-26T06:18:20.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.466+0000 7f634f200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635006f5a0 con 0x7f63500ccbd0 2024-03-26T06:18:20.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.466+0000 7f634f200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635015e1c0 con 0x7f635015a600 2024-03-26T06:18:20.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.466+0000 7f634de00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f635015a600 0x7f635006ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.466+0000 7f634de00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f635015a600 0x7f635006ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:35072/0 (socket says 172.21.15.63:35072) 2024-03-26T06:18:20.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.466+0000 7f634de00640 1 -- 172.21.15.63:0/2768460360 learned_addr learned my addr 172.21.15.63:0/2768460360 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:20.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.467+0000 7f634e800640 1 --2- 172.21.15.63:0/2768460360 >> v2:172.21.15.204:3300/0 conn(0x7f63500ccbd0 0x7f63500b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.467+0000 7f634de00640 1 -- 172.21.15.63:0/2768460360 >> v2:172.21.15.204:3300/0 conn(0x7f63500ccbd0 msgr2=0x7f63500b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:20.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.467+0000 7f634de00640 1 --2- 172.21.15.63:0/2768460360 >> v2:172.21.15.204:3300/0 conn(0x7f63500ccbd0 0x7f63500b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.467+0000 7f634de00640 1 -- 172.21.15.63:0/2768460360 >> v1:172.21.15.204:6789/0 conn(0x7f635006f160 legacy=0x7f63500cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.467+0000 7f634de00640 1 -- 172.21.15.63:0/2768460360 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635015e4a0 con 0x7f635015a600 2024-03-26T06:18:20.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.469+0000 7f634de00640 1 --2- 172.21.15.63:0/2768460360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f635015a600 0x7f635006ec20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f634000bb10 tx=0x7f634002e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1db8b7d79d790c94 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:20.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.469+0000 7f634d400640 1 -- 172.21.15.63:0/2768460360 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634003b070 con 0x7f635015a600 2024-03-26T06:18:20.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.469+0000 7f634d400640 1 -- 172.21.15.63:0/2768460360 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6340036440 con 0x7f635015a600 2024-03-26T06:18:20.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.469+0000 7f634d400640 1 -- 172.21.15.63:0/2768460360 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340036810 con 0x7f635015a600 2024-03-26T06:18:20.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.470+0000 7f634f200640 1 -- 172.21.15.63:0/2768460360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f635015a600 msgr2=0x7f635006ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.470+0000 7f634f200640 1 --2- 172.21.15.63:0/2768460360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f635015a600 0x7f635006ec20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f634000bb10 tx=0x7f634002e150 comp rx=0 tx=0).stop 2024-03-26T06:18:20.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.470+0000 7f634f200640 1 -- 172.21.15.63:0/2768460360 shutdown_connections 2024-03-26T06:18:20.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.470+0000 7f634f200640 1 --2- 172.21.15.63:0/2768460360 >> v2:172.21.15.204:3300/0 conn(0x7f63500ccbd0 0x7f63500b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.470+0000 7f634f200640 1 --2- 172.21.15.63:0/2768460360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f635015a600 0x7f635006ec20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.470+0000 7f634f200640 1 -- 172.21.15.63:0/2768460360 >> 172.21.15.63:0/2768460360 conn(0x7f63500b13d0 msgr2=0x7f63500b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:20.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.470+0000 7f634f200640 1 -- 172.21.15.63:0/2768460360 shutdown_connections 2024-03-26T06:18:20.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.470+0000 7f634f200640 1 -- 172.21.15.63:0/2768460360 wait complete. 2024-03-26T06:18:20.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.472+0000 7f634f200640 1 Processor -- start 2024-03-26T06:18:20.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.472+0000 7f634f200640 1 -- start start 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.473+0000 7f634f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f635006f160 0x7f6350155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.473+0000 7f634f200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63500ccbd0 0x7f63501507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634f200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f635015a600 0x7f63501458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635015ed40 con 0x7f635006f160 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634f200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635015ea60 con 0x7f635015a600 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634f200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63500b3c70 con 0x7f63500ccbd0 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f635006f160 0x7f6350155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f635006f160 0x7f6350155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36558/0 (socket says 172.21.15.63:36558) 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634de00640 1 -- 172.21.15.63:0/2078544802 learned_addr learned my addr 172.21.15.63:0/2078544802 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:20.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634de00640 1 -- 172.21.15.63:0/2078544802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63500ccbd0 msgr2=0x7f63501507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634de00640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63500ccbd0 0x7f63501507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634de00640 1 -- 172.21.15.63:0/2078544802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f635015a600 msgr2=0x7f63501458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634de00640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f635015a600 0x7f63501458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634de00640 1 -- 172.21.15.63:0/2078544802 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63500c8ca0 con 0x7f635006f160 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.474+0000 7f634de00640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f635006f160 0x7f6350155a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f634000b2c0 tx=0x7f63400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.475+0000 7f6346000640 1 -- 172.21.15.63:0/2078544802 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634003b030 con 0x7f635006f160 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.475+0000 7f6346000640 1 -- 172.21.15.63:0/2078544802 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634003d050 con 0x7f635006f160 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.475+0000 7f6346000640 1 -- 172.21.15.63:0/2078544802 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63400347f0 con 0x7f635006f160 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.475+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63500c8f80 con 0x7f635006f160 2024-03-26T06:18:20.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.475+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6350150d00 con 0x7f635006f160 2024-03-26T06:18:20.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.476+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635004f050 con 0x7f635006f160 2024-03-26T06:18:20.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.478+0000 7f6346000640 1 -- 172.21.15.63:0/2078544802 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6340048060 con 0x7f635006f160 2024-03-26T06:18:20.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.479+0000 7f6346000640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.479+0000 7f6346000640 1 -- 172.21.15.63:0/2078544802 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f63400ac750 con 0x7f635006f160 2024-03-26T06:18:20.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.479+0000 7f6347e00640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.480+0000 7f6347e00640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6338000f60 tx=0x7f63380079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:20.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.484+0000 7f6346000640 1 -- 172.21.15.63:0/2078544802 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f634007ae30 con 0x7f635006f160 2024-03-26T06:18:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.681+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63501563c0 con 0x7f635006f160 2024-03-26T06:18:20.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.684+0000 7f6346000640 1 -- 172.21.15.63:0/2078544802 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18854 (secure 0 0 0) 0x7f634007a730 con 0x7f635006f160 2024-03-26T06:18:20.686 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:20.686 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:17:39.736430+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:16:56.306346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-26T06:16:56.978584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-26T06:17:00.587176+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 msgr2=0x7f632c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6338000f60 tx=0x7f63380079b0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f635006f160 msgr2=0x7f6350155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f635006f160 0x7f6350155a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f634000b2c0 tx=0x7f63400046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 shutdown_connections 2024-03-26T06:18:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f632c06bbd0 0x7f632c06e090 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f635015a600 0x7f63501458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63500ccbd0 0x7f63501507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 --2- 172.21.15.63:0/2078544802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f635006f160 0x7f6350155a30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 >> 172.21.15.63:0/2078544802 conn(0x7f63500b13d0 msgr2=0x7f635006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 shutdown_connections 2024-03-26T06:18:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.687+0000 7f634f200640 1 -- 172.21.15.63:0/2078544802 wait complete. 2024-03-26T06:18:20.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-26T06:18:20.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.929+0000 7fe272200640 1 Processor -- start 2024-03-26T06:18:20.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.929+0000 7fe272200640 1 -- start start 2024-03-26T06:18:20.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.930+0000 7fe272200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0cea40 0x7fe26c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe272200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe26c06e280 0x7fe26c06e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe272200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c143cb0 con 0x7fe26c1438d0 2024-03-26T06:18:20.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe272200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c0ccef0 con 0x7fe26c06e280 2024-03-26T06:18:20.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe272200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c06ebf0 con 0x7fe26c0cea40 2024-03-26T06:18:20.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe270e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe26c1438d0 0x7fe26c0ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43606/0 (socket says 172.21.15.63:43606) 2024-03-26T06:18:20.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe270e00640 1 -- 172.21.15.63:0/1657129241 learned_addr learned my addr 172.21.15.63:0/1657129241 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:20.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959237702 0 0) 0x7fe26c143cb0 con 0x7fe26c1438d0 2024-03-26T06:18:20.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe250003520 con 0x7fe26c1438d0 2024-03-26T06:18:20.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe271800640 1 --2- 172.21.15.63:0/1657129241 >> v2:172.21.15.204:3300/0 conn(0x7fe26c06e280 0x7fe26c06e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.931+0000 7fe26be00640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0cea40 0x7fe26c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 35556473 0 0) 0x7fe250003520 con 0x7fe26c1438d0 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0cea40 msgr2=0x7fe26c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0cea40 0x7fe26c15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 >> v2:172.21.15.204:3300/0 conn(0x7fe26c06e280 msgr2=0x7fe26c06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 --2- 172.21.15.63:0/1657129241 >> v2:172.21.15.204:3300/0 conn(0x7fe26c06e280 0x7fe26c06e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c0ceed0 con 0x7fe26c1438d0 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fe25c001670 con 0x7fe26c1438d0 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 >> v1:172.21.15.63:6789/0 conn(0x7fe26c1438d0 legacy=0x7fe26c0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2500039b0 0x7fe250003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe250004800 0x7fe250004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2500051c0 0x7fe25000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c0ccef0 con 0x7fe2500039b0 2024-03-26T06:18:20.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c06ebf0 con 0x7fe250004800 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25000bf00 con 0x7fe2500051c0 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe271800640 1 --2- 172.21.15.63:0/1657129241 >> v2:172.21.15.204:3300/0 conn(0x7fe26c06e280 0x7fe26c06e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.932+0000 7fe270e00640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2500039b0 0x7fe250003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.933+0000 7fe270e00640 1 -- 172.21.15.63:0/1657129241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2500051c0 msgr2=0x7fe25000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.933+0000 7fe270e00640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2500051c0 0x7fe25000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.933+0000 7fe270e00640 1 -- 172.21.15.63:0/1657129241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe250004800 msgr2=0x7fe250004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.933+0000 7fe270e00640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe250004800 0x7fe250004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.933+0000 7fe270e00640 1 -- 172.21.15.63:0/1657129241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe250003520 con 0x7fe2500039b0 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.934+0000 7fe270e00640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2500039b0 0x7fe250003dd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe25c007cf0 tx=0x7fe250005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c68d138395e7dc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.934+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c007d30 con 0x7fe2500039b0 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.934+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c032070 con 0x7fe2500039b0 2024-03-26T06:18:20.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.934+0000 7fe26b400640 1 -- 172.21.15.63:0/1657129241 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0058d0 con 0x7fe2500039b0 2024-03-26T06:18:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.935+0000 7fe272200640 1 -- 172.21.15.63:0/1657129241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2500039b0 msgr2=0x7fe250003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.935+0000 7fe272200640 1 --2- 172.21.15.63:0/1657129241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2500039b0 0x7fe250003dd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe25c007cf0 tx=0x7fe250005830 comp rx=0 tx=0).stop 2024-03-26T06:18:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.935+0000 7fe271800640 1 -- 172.21.15.63:0/1657129241 reap_dead start 2024-03-26T06:18:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.935+0000 7fe272200640 1 -- 172.21.15.63:0/1657129241 shutdown_connections 2024-03-26T06:18:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.935+0000 7fe272200640 1 -- 172.21.15.63:0/1657129241 >> 172.21.15.63:0/1657129241 conn(0x7fe26c0670b0 msgr2=0x7fe26c0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.935+0000 7fe272200640 1 -- 172.21.15.63:0/1657129241 shutdown_connections 2024-03-26T06:18:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.935+0000 7fe272200640 1 -- 172.21.15.63:0/1657129241 wait complete. 2024-03-26T06:18:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.937+0000 7fe272200640 1 Processor -- start 2024-03-26T06:18:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.937+0000 7fe272200640 1 -- start start 2024-03-26T06:18:20.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe272200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2500039b0 0x7fe26c1f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe272200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c1f3300 0x7fe26c15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe272200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe26c15c6c0 0x7fe26c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe272200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c15e5a0 con 0x7fe26c1f3300 2024-03-26T06:18:20.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe272200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c15e2c0 con 0x7fe26c15c6c0 2024-03-26T06:18:20.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe272200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c15e880 con 0x7fe2500039b0 2024-03-26T06:18:20.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe26be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c1f3300 0x7fe26c15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe26be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c1f3300 0x7fe26c15ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42318/0 (socket says 172.21.15.63:42318) 2024-03-26T06:18:20.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe26be00640 1 -- 172.21.15.63:0/1140279326 learned_addr learned my addr 172.21.15.63:0/1140279326 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:20.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe270e00640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2500039b0 0x7fe26c1f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe26be00640 1 -- 172.21.15.63:0/1140279326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2500039b0 msgr2=0x7fe26c1f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe26be00640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2500039b0 0x7fe26c1f3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe26be00640 1 -- 172.21.15.63:0/1140279326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe26c15c6c0 msgr2=0x7fe26c15cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe26be00640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe26c15c6c0 0x7fe26c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.938+0000 7fe26be00640 1 -- 172.21.15.63:0/1140279326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c15b590 con 0x7fe26c1f3300 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.939+0000 7fe26be00640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c1f3300 0x7fe26c15ac90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe25800e7a0 tx=0x7fe25800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.939+0000 7fe268c00640 1 -- 172.21.15.63:0/1140279326 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258017070 con 0x7fe26c1f3300 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.939+0000 7fe268c00640 1 -- 172.21.15.63:0/1140279326 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25800c940 con 0x7fe26c1f3300 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.939+0000 7fe268c00640 1 -- 172.21.15.63:0/1140279326 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25800cd10 con 0x7fe26c1f3300 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.939+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c15b870 con 0x7fe26c1f3300 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.939+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c1f4560 con 0x7fe26c1f3300 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.940+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c04f0c0 con 0x7fe26c1f3300 2024-03-26T06:18:20.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.941+0000 7fe268c00640 1 -- 172.21.15.63:0/1140279326 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe25801a070 con 0x7fe26c1f3300 2024-03-26T06:18:20.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.942+0000 7fe268c00640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe24c06bc00 0x7fe24c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:20.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.942+0000 7fe268c00640 1 -- 172.21.15.63:0/1140279326 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe25808b0b0 con 0x7fe26c1f3300 2024-03-26T06:18:20.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.942+0000 7fe270e00640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe24c06bc00 0x7fe24c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:20.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.943+0000 7fe270e00640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe24c06bc00 0x7fe24c06e0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe25c036000 tx=0x7fe25c007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:20.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:20.947+0000 7fe268c00640 1 -- 172.21.15.63:0/1140279326 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe258059790 con 0x7fe26c1f3300 2024-03-26T06:18:21.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.187+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe26c06dc60 con 0x7fe26c1f3300 2024-03-26T06:18:21.190 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-03-26T06:18:21.189+0000 7f8bc6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-26T06:18:21.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.193+0000 7fe268c00640 1 -- 172.21.15.63:0/1140279326 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe258059090 con 0x7fe26c1f3300 2024-03-26T06:18:21.194 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-26T06:18:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe24c06bc00 msgr2=0x7fe24c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe24c06bc00 0x7fe24c06e0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe25c036000 tx=0x7fe25c007000 comp rx=0 tx=0).stop 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c1f3300 msgr2=0x7fe26c15ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c1f3300 0x7fe26c15ac90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe25800e7a0 tx=0x7fe25800ec60 comp rx=0 tx=0).stop 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 shutdown_connections 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe24c06bc00 0x7fe24c06e0c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe26c15c6c0 0x7fe26c15cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c1f3300 0x7fe26c15ac90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 --2- 172.21.15.63:0/1140279326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2500039b0 0x7fe26c1f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 >> 172.21.15.63:0/1140279326 conn(0x7fe26c0670b0 msgr2=0x7fe26c0ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.197+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 shutdown_connections 2024-03-26T06:18:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.198+0000 7fe272200640 1 -- 172.21.15.63:0/1140279326 wait complete. 2024-03-26T06:18:21.218 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-26T06:18:21.234 INFO:tasks.ceph.mds.d.smithi204.stderr: -6140> 2024-03-26T06:17:04.178+0000 7f3ee8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-26T06:18:21.310 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-03-26T06:18:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.429+0000 7f74d7e00640 1 Processor -- start 2024-03-26T06:18:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.429+0000 7f74d7e00640 1 -- start start 2024-03-26T06:18:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.431+0000 7f74d7e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015dd30 0x7f74d015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.431+0000 7f74d7e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74d00cfc40 0x7f74d00cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.431+0000 7f74d7e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d015e890 con 0x7f74d015e410 2024-03-26T06:18:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.431+0000 7f74d7e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d00cd530 con 0x7f74d00cfc40 2024-03-26T06:18:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.431+0000 7f74d7e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d015f3b0 con 0x7f74d015dd30 2024-03-26T06:18:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.431+0000 7f74d5e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74d00cfc40 0x7f74d00cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.431+0000 7f74d5e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74d00cfc40 0x7f74d00cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42332/0 (socket says 172.21.15.63:42332) 2024-03-26T06:18:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.431+0000 7f74d5e00640 1 -- 172.21.15.63:0/123303054 learned_addr learned my addr 172.21.15.63:0/123303054 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.431+0000 7f74d5400640 1 --2- 172.21.15.63:0/123303054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015dd30 0x7f74d015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:21.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.432+0000 7f74d5e00640 1 -- 172.21.15.63:0/123303054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015dd30 msgr2=0x7f74d015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:21.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.432+0000 7f74d5e00640 1 --2- 172.21.15.63:0/123303054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015dd30 0x7f74d015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.432+0000 7f74d5e00640 1 -- 172.21.15.63:0/123303054 >> v1:172.21.15.204:6789/0 conn(0x7f74d015e410 legacy=0x7f74d00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:21.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.432+0000 7f74d5e00640 1 -- 172.21.15.63:0/123303054 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d015c420 con 0x7f74d00cfc40 2024-03-26T06:18:21.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.433+0000 7f74d5e00640 1 --2- 172.21.15.63:0/123303054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d00cfc40 0x7f74d00cdc80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009870 tx=0x7f74c802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f788655e595078dc server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:21.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.433+0000 7f74cfe00640 1 -- 172.21.15.63:0/123303054 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8035020 con 0x7f74d00cfc40 2024-03-26T06:18:21.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.433+0000 7f74cfe00640 1 -- 172.21.15.63:0/123303054 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c8031640 con 0x7f74d00cfc40 2024-03-26T06:18:21.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.433+0000 7f74cfe00640 1 -- 172.21.15.63:0/123303054 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c802d040 con 0x7f74d00cfc40 2024-03-26T06:18:21.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.434+0000 7f74d7e00640 1 -- 172.21.15.63:0/123303054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d00cfc40 msgr2=0x7f74d00cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:21.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.434+0000 7f74d7e00640 1 --2- 172.21.15.63:0/123303054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d00cfc40 0x7f74d00cdc80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009870 tx=0x7f74c802b8f0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.434+0000 7f74d7e00640 1 -- 172.21.15.63:0/123303054 shutdown_connections 2024-03-26T06:18:21.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.434+0000 7f74d7e00640 1 --2- 172.21.15.63:0/123303054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d00cfc40 0x7f74d00cdc80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.434+0000 7f74d7e00640 1 --2- 172.21.15.63:0/123303054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015dd30 0x7f74d015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.434+0000 7f74d7e00640 1 -- 172.21.15.63:0/123303054 >> 172.21.15.63:0/123303054 conn(0x7f74d006ac90 msgr2=0x7f74d006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:21.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.434+0000 7f74d7e00640 1 -- 172.21.15.63:0/123303054 shutdown_connections 2024-03-26T06:18:21.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.434+0000 7f74d7e00640 1 -- 172.21.15.63:0/123303054 wait complete. 2024-03-26T06:18:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.436+0000 7f74d7e00640 1 Processor -- start 2024-03-26T06:18:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.436+0000 7f74d7e00640 1 -- start start 2024-03-26T06:18:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.437+0000 7f74d7e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74d00cfc40 0x7f74d01f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.437+0000 7f74d7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d015dd30 0x7f74d014e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.437+0000 7f74d7e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015e410 0x7f74d014bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.437+0000 7f74d7e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d015edf0 con 0x7f74d015dd30 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.437+0000 7f74d7e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00cd7f0 con 0x7f74d00cfc40 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.437+0000 7f74d7e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d015f0d0 con 0x7f74d015e410 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.437+0000 7f74d4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d015dd30 0x7f74d014e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.437+0000 7f74d4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d015dd30 0x7f74d014e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42336/0 (socket says 172.21.15.63:42336) 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.437+0000 7f74d4a00640 1 -- 172.21.15.63:0/2768639783 learned_addr learned my addr 172.21.15.63:0/2768639783 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d5400640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74d00cfc40 0x7f74d01f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d5e00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015e410 0x7f74d014bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d4a00640 1 -- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015e410 msgr2=0x7f74d014bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d4a00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015e410 0x7f74d014bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d4a00640 1 -- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74d00cfc40 msgr2=0x7f74d01f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d4a00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74d00cfc40 0x7f74d01f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d4a00640 1 -- 172.21.15.63:0/2768639783 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d00ca910 con 0x7f74d015dd30 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d5e00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015e410 0x7f74d014bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d5400640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74d00cfc40 0x7f74d01f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:21.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d4a00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d015dd30 0x7f74d014e6b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00c430 tx=0x7f74bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:21.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74cd600640 1 -- 172.21.15.63:0/2768639783 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc011790 con 0x7f74d015dd30 2024-03-26T06:18:21.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74cd600640 1 -- 172.21.15.63:0/2768639783 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc017070 con 0x7f74d015dd30 2024-03-26T06:18:21.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74cd600640 1 -- 172.21.15.63:0/2768639783 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc011bb0 con 0x7f74d015dd30 2024-03-26T06:18:21.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.438+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d014c330 con 0x7f74d015dd30 2024-03-26T06:18:21.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.439+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d014f100 con 0x7f74d015dd30 2024-03-26T06:18:21.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.440+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d00cd110 con 0x7f74d015dd30 2024-03-26T06:18:21.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.441+0000 7f74cd600640 1 -- 172.21.15.63:0/2768639783 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f74bc01c460 con 0x7f74d015dd30 2024-03-26T06:18:21.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.442+0000 7f74cd600640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f74b006bbd0 0x7f74b006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:21.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.442+0000 7f74cd600640 1 -- 172.21.15.63:0/2768639783 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f74bc08ad60 con 0x7f74d015dd30 2024-03-26T06:18:21.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.442+0000 7f74d5400640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f74b006bbd0 0x7f74b006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.443+0000 7f74d5400640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f74b006bbd0 0x7f74b006e090 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f74c0007330 tx=0x7f74c000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:21.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.446+0000 7f74cd600640 1 -- 172.21.15.63:0/2768639783 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f74d00cd110 con 0x7f74d015dd30 2024-03-26T06:18:21.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:21.691+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f74d0074730 con 0x7f74d015dd30 2024-03-26T06:18:22.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.204+0000 7f74cd600640 1 -- 172.21.15.63:0/2768639783 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f74bc08a020 con 0x7f74d015dd30 2024-03-26T06:18:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.207+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f74b006bbd0 msgr2=0x7f74b006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.207+0000 7f74d7e00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f74b006bbd0 0x7f74b006e090 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f74c0007330 tx=0x7f74c000b040 comp rx=0 tx=0).stop 2024-03-26T06:18:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.207+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d015dd30 msgr2=0x7f74d014e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.207+0000 7f74d7e00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d015dd30 0x7f74d014e6b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00c430 tx=0x7f74bc00c8f0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.208+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 shutdown_connections 2024-03-26T06:18:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.208+0000 7f74d7e00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f74b006bbd0 0x7f74b006e090 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.208+0000 7f74d7e00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74d015e410 0x7f74d014bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.208+0000 7f74d7e00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74d015dd30 0x7f74d014e6b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.208+0000 7f74d7e00640 1 --2- 172.21.15.63:0/2768639783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74d00cfc40 0x7f74d01f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.208+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 >> 172.21.15.63:0/2768639783 conn(0x7f74d006ac90 msgr2=0x7f74d006db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.208+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 shutdown_connections 2024-03-26T06:18:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.208+0000 7f74d7e00640 1 -- 172.21.15.63:0/2768639783 wait complete. 2024-03-26T06:18:22.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-26T06:18:22.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.456+0000 7f3db2600640 1 Processor -- start 2024-03-26T06:18:22.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.456+0000 7f3db2600640 1 -- start start 2024-03-26T06:18:22.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.457+0000 7f3db2600640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3dac1596d0 0x7f3dac0715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:22.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.457+0000 7f3db2600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac0ce340 0x7f3dac071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:22.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.457+0000 7f3db2600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3dac15bf90 0x7f3dac15c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:22.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.457+0000 7f3db2600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac0a8670 con 0x7f3dac15bf90 2024-03-26T06:18:22.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.457+0000 7f3db2600640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac15ccc0 con 0x7f3dac1596d0 2024-03-26T06:18:22.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.457+0000 7f3db2600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac0cd860 con 0x7f3dac0ce340 2024-03-26T06:18:22.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3dabe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3dac15bf90 0x7f3dac15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:22.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3dabe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3dac15bf90 0x7f3dac15c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42338/0 (socket says 172.21.15.63:42338) 2024-03-26T06:18:22.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3dabe00640 1 -- 172.21.15.63:0/4236683360 learned_addr learned my addr 172.21.15.63:0/4236683360 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:22.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3da3e00640 1 --2- 172.21.15.63:0/4236683360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac0ce340 0x7f3dac071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:22.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3dab400640 1 --2- 172.21.15.63:0/4236683360 >> v2:172.21.15.204:3300/0 conn(0x7f3dac1596d0 0x7f3dac0715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:22.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3dabe00640 1 -- 172.21.15.63:0/4236683360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac0ce340 msgr2=0x7f3dac071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:22.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3dabe00640 1 --2- 172.21.15.63:0/4236683360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac0ce340 0x7f3dac071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3dabe00640 1 -- 172.21.15.63:0/4236683360 >> v2:172.21.15.204:3300/0 conn(0x7f3dac1596d0 msgr2=0x7f3dac0715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:22.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3dabe00640 1 --2- 172.21.15.63:0/4236683360 >> v2:172.21.15.204:3300/0 conn(0x7f3dac1596d0 0x7f3dac0715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3dabe00640 1 -- 172.21.15.63:0/4236683360 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0cdb40 con 0x7f3dac15bf90 2024-03-26T06:18:22.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.458+0000 7f3da3e00640 1 --2- 172.21.15.63:0/4236683360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac0ce340 0x7f3dac071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:22.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.459+0000 7f3dabe00640 1 --2- 172.21.15.63:0/4236683360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac15bf90 0x7f3dac15c420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3dac06fa20 tx=0x7f3da402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0442871146f116 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3daaa00640 1 -- 172.21.15.63:0/4236683360 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da402cb00 con 0x7f3dac15bf90 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3daaa00640 1 -- 172.21.15.63:0/4236683360 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da402cca0 con 0x7f3dac15bf90 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3daaa00640 1 -- 172.21.15.63:0/4236683360 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4034610 con 0x7f3dac15bf90 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3db2600640 1 -- 172.21.15.63:0/4236683360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac15bf90 msgr2=0x7f3dac15c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3db2600640 1 --2- 172.21.15.63:0/4236683360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac15bf90 0x7f3dac15c420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3dac06fa20 tx=0x7f3da402bf60 comp rx=0 tx=0).stop 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3db2600640 1 -- 172.21.15.63:0/4236683360 shutdown_connections 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3db2600640 1 --2- 172.21.15.63:0/4236683360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac15bf90 0x7f3dac15c420 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3db2600640 1 --2- 172.21.15.63:0/4236683360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac0ce340 0x7f3dac071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3db2600640 1 --2- 172.21.15.63:0/4236683360 >> v2:172.21.15.204:3300/0 conn(0x7f3dac1596d0 0x7f3dac0715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3db2600640 1 -- 172.21.15.63:0/4236683360 >> 172.21.15.63:0/4236683360 conn(0x7f3dac0b18c0 msgr2=0x7f3dac0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:22.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3db2600640 1 -- 172.21.15.63:0/4236683360 shutdown_connections 2024-03-26T06:18:22.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.460+0000 7f3db2600640 1 -- 172.21.15.63:0/4236683360 wait complete. 2024-03-26T06:18:22.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.462+0000 7f3db2600640 1 Processor -- start 2024-03-26T06:18:22.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.462+0000 7f3db2600640 1 -- start start 2024-03-26T06:18:22.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.463+0000 7f3db2600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac0ce340 0x7f3dac157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:22.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.463+0000 7f3db2600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1596d0 0x7f3dac14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:22.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.463+0000 7f3db2600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dac15bf90 0x7f3dac14b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:22.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.463+0000 7f3db2600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac0cc330 con 0x7f3dac0ce340 2024-03-26T06:18:22.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.463+0000 7f3db2600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac15c960 con 0x7f3dac15bf90 2024-03-26T06:18:22.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.463+0000 7f3db2600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac0cc4b0 con 0x7f3dac1596d0 2024-03-26T06:18:22.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.463+0000 7f3dab400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac0ce340 0x7f3dac157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:22.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.463+0000 7f3dab400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac0ce340 0x7f3dac157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42352/0 (socket says 172.21.15.63:42352) 2024-03-26T06:18:22.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.463+0000 7f3dab400640 1 -- 172.21.15.63:0/2585295613 learned_addr learned my addr 172.21.15.63:0/2585295613 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3da3e00640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1596d0 0x7f3dac14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3dabe00640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dac15bf90 0x7f3dac14b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3dab400640 1 -- 172.21.15.63:0/2585295613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1596d0 msgr2=0x7f3dac14af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3dab400640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1596d0 0x7f3dac14af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3dab400640 1 -- 172.21.15.63:0/2585295613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dac15bf90 msgr2=0x7f3dac14b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3dab400640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dac15bf90 0x7f3dac14b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3dab400640 1 -- 172.21.15.63:0/2585295613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0b3910 con 0x7f3dac0ce340 2024-03-26T06:18:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3dab400640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac0ce340 0x7f3dac157dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00c7f0 tx=0x7f3d9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3da3400640 1 -- 172.21.15.63:0/2585295613 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c015070 con 0x7f3dac0ce340 2024-03-26T06:18:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3da3400640 1 -- 172.21.15.63:0/2585295613 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c004240 con 0x7f3dac0ce340 2024-03-26T06:18:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3da3400640 1 -- 172.21.15.63:0/2585295613 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c007620 con 0x7f3dac0ce340 2024-03-26T06:18:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.464+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dac0b3bf0 con 0x7f3dac0ce340 2024-03-26T06:18:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.465+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dac0b41b0 con 0x7f3dac0ce340 2024-03-26T06:18:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.465+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dac074810 con 0x7f3dac0ce340 2024-03-26T06:18:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.466+0000 7f3da3400640 1 -- 172.21.15.63:0/2585295613 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3d9c0079d0 con 0x7f3dac0ce340 2024-03-26T06:18:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.467+0000 7f3da3400640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d8806bbd0 0x7f3d8806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.467+0000 7f3da3400640 1 -- 172.21.15.63:0/2585295613 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f3d9c08aff0 con 0x7f3dac0ce340 2024-03-26T06:18:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.468+0000 7f3da3e00640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d8806bbd0 0x7f3d8806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.468+0000 7f3da3e00640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d8806bbd0 0x7f3d8806e090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3dac15c780 tx=0x7f3d94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:22.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.472+0000 7f3da3400640 1 -- 172.21.15.63:0/2585295613 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f3d9c0596b0 con 0x7f3dac0ce340 2024-03-26T06:18:22.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:22.675+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3dac0cbfa0 con 0x7f3dac0ce340 2024-03-26T06:18:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.208+0000 7f3da3400640 1 -- 172.21.15.63:0/2585295613 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3d9c058fb0 con 0x7f3dac0ce340 2024-03-26T06:18:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-03-26T06:18:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d8806bbd0 msgr2=0x7f3d8806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d8806bbd0 0x7f3d8806e090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3dac15c780 tx=0x7f3d94008040 comp rx=0 tx=0).stop 2024-03-26T06:18:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac0ce340 msgr2=0x7f3dac157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac0ce340 0x7f3dac157dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00c7f0 tx=0x7f3d9c00ccb0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 shutdown_connections 2024-03-26T06:18:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d8806bbd0 0x7f3d8806e090 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dac15bf90 0x7f3dac14b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1596d0 0x7f3dac14af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 --2- 172.21.15.63:0/2585295613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dac0ce340 0x7f3dac157dd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.212+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 >> 172.21.15.63:0/2585295613 conn(0x7f3dac0b18c0 msgr2=0x7f3dac159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.213+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 shutdown_connections 2024-03-26T06:18:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.213+0000 7f3db2600640 1 -- 172.21.15.63:0/2585295613 wait complete. 2024-03-26T06:18:23.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-26T06:18:23.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.442+0000 7fc13de00640 1 Processor -- start 2024-03-26T06:18:23.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.442+0000 7fc13de00640 1 -- start start 2024-03-26T06:18:23.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.444+0000 7fc13de00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc13815b060 0x7fc1380713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:23.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.444+0000 7fc13de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc138071930 0x7fc13806d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:23.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.444+0000 7fc13de00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13815e610 con 0x7fc1380b4240 2024-03-26T06:18:23.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.444+0000 7fc13de00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13815e8f0 con 0x7fc138071930 2024-03-26T06:18:23.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.444+0000 7fc13de00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13815a860 con 0x7fc13815b060 2024-03-26T06:18:23.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.444+0000 7fc137400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc138071930 0x7fc13806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:23.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.444+0000 7fc137400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc138071930 0x7fc13806d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42364/0 (socket says 172.21.15.63:42364) 2024-03-26T06:18:23.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.444+0000 7fc137400640 1 -- 172.21.15.63:0/2354087041 learned_addr learned my addr 172.21.15.63:0/2354087041 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:23.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.444+0000 7fc136a00640 1 --1- 172.21.15.63:0/2354087041 >> v1:172.21.15.63:6789/0 conn(0x7fc1380b4240 0x7fc13815db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43622/0 (socket says 172.21.15.63:43622) 2024-03-26T06:18:23.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.445+0000 7fc12fe00640 1 --2- 172.21.15.63:0/2354087041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc13815b060 0x7fc1380713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:23.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.445+0000 7fc137400640 1 -- 172.21.15.63:0/2354087041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc13815b060 msgr2=0x7fc1380713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:23.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.445+0000 7fc137400640 1 --2- 172.21.15.63:0/2354087041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc13815b060 0x7fc1380713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.445+0000 7fc137400640 1 -- 172.21.15.63:0/2354087041 >> v1:172.21.15.63:6789/0 conn(0x7fc1380b4240 legacy=0x7fc13815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:23.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.445+0000 7fc137400640 1 -- 172.21.15.63:0/2354087041 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13815ab40 con 0x7fc138071930 2024-03-26T06:18:23.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.445+0000 7fc136000640 1 -- 172.21.15.63:0/2354087041 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179500695 0 0) 0x7fc13815e610 con 0x7fc1380b4240 2024-03-26T06:18:23.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.445+0000 7fc12fe00640 1 --2- 172.21.15.63:0/2354087041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc13815b060 0x7fc1380713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:23.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.446+0000 7fc137400640 1 --2- 172.21.15.63:0/2354087041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc138071930 0x7fc13806d420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc130009e50 tx=0x7fc13002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2391aef2d4a35161 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:23.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.446+0000 7fc136000640 1 -- 172.21.15.63:0/2354087041 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13002cb00 con 0x7fc138071930 2024-03-26T06:18:23.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.446+0000 7fc136000640 1 -- 172.21.15.63:0/2354087041 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13002cca0 con 0x7fc138071930 2024-03-26T06:18:23.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.446+0000 7fc136000640 1 -- 172.21.15.63:0/2354087041 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130034610 con 0x7fc138071930 2024-03-26T06:18:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.447+0000 7fc13de00640 1 -- 172.21.15.63:0/2354087041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc138071930 msgr2=0x7fc13806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.447+0000 7fc13de00640 1 --2- 172.21.15.63:0/2354087041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc138071930 0x7fc13806d420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc130009e50 tx=0x7fc13002bf60 comp rx=0 tx=0).stop 2024-03-26T06:18:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.447+0000 7fc13de00640 1 -- 172.21.15.63:0/2354087041 shutdown_connections 2024-03-26T06:18:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.447+0000 7fc13de00640 1 --2- 172.21.15.63:0/2354087041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc138071930 0x7fc13806d420 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.447+0000 7fc13de00640 1 --2- 172.21.15.63:0/2354087041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc13815b060 0x7fc1380713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.447+0000 7fc13de00640 1 -- 172.21.15.63:0/2354087041 >> 172.21.15.63:0/2354087041 conn(0x7fc1380cf670 msgr2=0x7fc1380cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.447+0000 7fc13de00640 1 -- 172.21.15.63:0/2354087041 shutdown_connections 2024-03-26T06:18:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.447+0000 7fc13de00640 1 -- 172.21.15.63:0/2354087041 wait complete. 2024-03-26T06:18:23.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.449+0000 7fc13de00640 1 Processor -- start 2024-03-26T06:18:23.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.449+0000 7fc13de00640 1 -- start start 2024-03-26T06:18:23.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.450+0000 7fc13de00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc138071930 0x7fc1381f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:23.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.450+0000 7fc13de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1380b4240 0x7fc1381538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:23.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.450+0000 7fc13de00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc13815b060 0x7fc138153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:23.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.450+0000 7fc13de00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13815e2a0 con 0x7fc1380b4240 2024-03-26T06:18:23.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.450+0000 7fc13de00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13815a550 con 0x7fc13815b060 2024-03-26T06:18:23.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.450+0000 7fc13de00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380b4620 con 0x7fc138071930 2024-03-26T06:18:23.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.450+0000 7fc12fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1380b4240 0x7fc1381538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:23.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.450+0000 7fc12fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1380b4240 0x7fc1381538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42380/0 (socket says 172.21.15.63:42380) 2024-03-26T06:18:23.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.450+0000 7fc12fe00640 1 -- 172.21.15.63:0/3770718364 learned_addr learned my addr 172.21.15.63:0/3770718364 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc136a00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc138071930 0x7fc1381f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc137400640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc13815b060 0x7fc138153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc12fe00640 1 -- 172.21.15.63:0/3770718364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc138071930 msgr2=0x7fc1381f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc12fe00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc138071930 0x7fc1381f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc12fe00640 1 -- 172.21.15.63:0/3770718364 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc13815b060 msgr2=0x7fc138153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc12fe00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc13815b060 0x7fc138153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc12fe00640 1 -- 172.21.15.63:0/3770718364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1380ce550 con 0x7fc1380b4240 2024-03-26T06:18:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc136a00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc138071930 0x7fc1381f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc12fe00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1380b4240 0x7fc1381538b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc12000c820 tx=0x7fc12000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc12f400640 1 -- 172.21.15.63:0/3770718364 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120015070 con 0x7fc1380b4240 2024-03-26T06:18:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc12f400640 1 -- 172.21.15.63:0/3770718364 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc120007a30 con 0x7fc1380b4240 2024-03-26T06:18:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc12f400640 1 -- 172.21.15.63:0/3770718364 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120007de0 con 0x7fc1380b4240 2024-03-26T06:18:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1380ce830 con 0x7fc1380b4240 2024-03-26T06:18:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.451+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1380cedf0 con 0x7fc1380b4240 2024-03-26T06:18:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.453+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc138074810 con 0x7fc1380b4240 2024-03-26T06:18:23.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.453+0000 7fc12f400640 1 -- 172.21.15.63:0/3770718364 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc120018070 con 0x7fc1380b4240 2024-03-26T06:18:23.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.454+0000 7fc12f400640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc11406bbd0 0x7fc11406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:23.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.454+0000 7fc12f400640 1 -- 172.21.15.63:0/3770718364 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6383+0+0 (secure 0 0 0) 0x7fc12008abd0 con 0x7fc1380b4240 2024-03-26T06:18:23.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.455+0000 7fc136a00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc11406bbd0 0x7fc11406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:23.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.455+0000 7fc136a00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc11406bbd0 0x7fc11406e090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc128000f60 tx=0x7fc128009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:23.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.459+0000 7fc12f400640 1 -- 172.21.15.63:0/3770718364 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc120059420 con 0x7fc1380b4240 2024-03-26T06:18:23.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:23.662+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc138071710 con 0x7fc1380b4240 2024-03-26T06:18:24.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.220+0000 7fc12f400640 1 -- 172.21.15.63:0/3770718364 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc120058d20 con 0x7fc1380b4240 2024-03-26T06:18:24.222 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-03-26T06:18:24.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc11406bbd0 msgr2=0x7fc11406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:24.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc11406bbd0 0x7fc11406e090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc128000f60 tx=0x7fc128009040 comp rx=0 tx=0).stop 2024-03-26T06:18:24.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1380b4240 msgr2=0x7fc1381538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:24.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1380b4240 0x7fc1381538b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc12000c820 tx=0x7fc12000cce0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 shutdown_connections 2024-03-26T06:18:24.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc11406bbd0 0x7fc11406e090 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc13815b060 0x7fc138153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1380b4240 0x7fc1381538b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 --2- 172.21.15.63:0/3770718364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc138071930 0x7fc1381f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 >> 172.21.15.63:0/3770718364 conn(0x7fc1380cf670 msgr2=0x7fc138073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:24.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 shutdown_connections 2024-03-26T06:18:24.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.225+0000 7fc13de00640 1 -- 172.21.15.63:0/3770718364 wait complete. 2024-03-26T06:18:24.252 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-26T06:18:24.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.473+0000 7fd641c00640 1 Processor -- start 2024-03-26T06:18:24.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.473+0000 7fd641c00640 1 -- start start 2024-03-26T06:18:24.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.475+0000 7fd641c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd63c0715e0 0x7fd63c071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:24.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.475+0000 7fd641c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c0adfe0 0x7fd63c0ae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:24.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.475+0000 7fd641c00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c147770 con 0x7fd63c147390 2024-03-26T06:18:24.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.475+0000 7fd641c00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c1624e0 con 0x7fd63c0715e0 2024-03-26T06:18:24.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.475+0000 7fd641c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c1618d0 con 0x7fd63c0adfe0 2024-03-26T06:18:24.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.476+0000 7fd63a000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd63c0715e0 0x7fd63c071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:24.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.476+0000 7fd63a000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd63c0715e0 0x7fd63c071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:50558/0 (socket says 172.21.15.63:50558) 2024-03-26T06:18:24.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.476+0000 7fd63aa00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fd63c147390 0x7fd63c06ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:47310/0 (socket says 172.21.15.63:47310) 2024-03-26T06:18:24.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.476+0000 7fd63a000640 1 -- 172.21.15.63:0/1979742226 learned_addr learned my addr 172.21.15.63:0/1979742226 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:24.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.476+0000 7fd63b400640 1 --2- 172.21.15.63:0/1979742226 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c0adfe0 0x7fd63c0ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:24.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.477+0000 7fd639600640 1 -- 172.21.15.63:0/1979742226 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586239471 0 0) 0x7fd63c147770 con 0x7fd63c147390 2024-03-26T06:18:24.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.477+0000 7fd639600640 1 -- 172.21.15.63:0/1979742226 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd620003520 con 0x7fd63c147390 2024-03-26T06:18:24.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.477+0000 7fd63b400640 1 -- 172.21.15.63:0/1979742226 >> v2:172.21.15.204:3300/0 conn(0x7fd63c0715e0 msgr2=0x7fd63c071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:24.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.477+0000 7fd63b400640 1 --2- 172.21.15.63:0/1979742226 >> v2:172.21.15.204:3300/0 conn(0x7fd63c0715e0 0x7fd63c071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.477+0000 7fd63b400640 1 -- 172.21.15.63:0/1979742226 >> v1:172.21.15.204:6789/0 conn(0x7fd63c147390 legacy=0x7fd63c06ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.477+0000 7fd63b400640 1 -- 172.21.15.63:0/1979742226 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c161bb0 con 0x7fd63c0adfe0 2024-03-26T06:18:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.478+0000 7fd63b400640 1 --2- 172.21.15.63:0/1979742226 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c0adfe0 0x7fd63c0ae450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd634009d90 tx=0x7fd63402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb4b94b1d0f3e55b server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd639600640 1 -- 172.21.15.63:0/1979742226 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634039070 con 0x7fd63c0adfe0 2024-03-26T06:18:24.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd639600640 1 -- 172.21.15.63:0/1979742226 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63402cc60 con 0x7fd63c0adfe0 2024-03-26T06:18:24.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd639600640 1 -- 172.21.15.63:0/1979742226 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634034660 con 0x7fd63c0adfe0 2024-03-26T06:18:24.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd641c00640 1 -- 172.21.15.63:0/1979742226 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c0adfe0 msgr2=0x7fd63c0ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:24.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd641c00640 1 --2- 172.21.15.63:0/1979742226 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c0adfe0 0x7fd63c0ae450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd634009d90 tx=0x7fd63402beb0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd641c00640 1 -- 172.21.15.63:0/1979742226 shutdown_connections 2024-03-26T06:18:24.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd641c00640 1 --2- 172.21.15.63:0/1979742226 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c0adfe0 0x7fd63c0ae450 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd641c00640 1 --2- 172.21.15.63:0/1979742226 >> v2:172.21.15.204:3300/0 conn(0x7fd63c0715e0 0x7fd63c071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd641c00640 1 -- 172.21.15.63:0/1979742226 >> 172.21.15.63:0/1979742226 conn(0x7fd63c0b18c0 msgr2=0x7fd63c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:24.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd641c00640 1 -- 172.21.15.63:0/1979742226 shutdown_connections 2024-03-26T06:18:24.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.479+0000 7fd641c00640 1 -- 172.21.15.63:0/1979742226 wait complete. 2024-03-26T06:18:24.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.481+0000 7fd641c00640 1 Processor -- start 2024-03-26T06:18:24.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.481+0000 7fd641c00640 1 -- start start 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.482+0000 7fd641c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd63c0715e0 0x7fd63c143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.482+0000 7fd641c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd63c0adfe0 0x7fd63c145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.482+0000 7fd641c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c147390 0x7fd63c141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.482+0000 7fd641c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c15efa0 con 0x7fd63c0715e0 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.482+0000 7fd641c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c162170 con 0x7fd63c0adfe0 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.482+0000 7fd641c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c15f120 con 0x7fd63c147390 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd63c0715e0 0x7fd63c143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd63c0715e0 0x7fd63c143060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42396/0 (socket says 172.21.15.63:42396) 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63aa00640 1 -- 172.21.15.63:0/2160820292 learned_addr learned my addr 172.21.15.63:0/2160820292 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63b400640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c147390 0x7fd63c141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63a000640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd63c0adfe0 0x7fd63c145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63aa00640 1 -- 172.21.15.63:0/2160820292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c147390 msgr2=0x7fd63c141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63aa00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c147390 0x7fd63c141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63aa00640 1 -- 172.21.15.63:0/2160820292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd63c0adfe0 msgr2=0x7fd63c145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63aa00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd63c0adfe0 0x7fd63c145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63aa00640 1 -- 172.21.15.63:0/2160820292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c1436f0 con 0x7fd63c0715e0 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.483+0000 7fd63aa00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd63c0715e0 0x7fd63c143060 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00c3c0 tx=0x7fd62c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.484+0000 7fd632a00640 1 -- 172.21.15.63:0/2160820292 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0074e0 con 0x7fd63c0715e0 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.484+0000 7fd632a00640 1 -- 172.21.15.63:0/2160820292 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c007680 con 0x7fd63c0715e0 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.484+0000 7fd632a00640 1 -- 172.21.15.63:0/2160820292 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0049e0 con 0x7fd63c0715e0 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.484+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c1439d0 con 0x7fd63c0715e0 2024-03-26T06:18:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.484+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c143f90 con 0x7fd63c0715e0 2024-03-26T06:18:24.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.485+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c074810 con 0x7fd63c0715e0 2024-03-26T06:18:24.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.486+0000 7fd632a00640 1 -- 172.21.15.63:0/2160820292 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd62c01a020 con 0x7fd63c0715e0 2024-03-26T06:18:24.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.487+0000 7fd632a00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd61c06bbd0 0x7fd61c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:24.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.487+0000 7fd632a00640 1 -- 172.21.15.63:0/2160820292 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd62c08a260 con 0x7fd63c0715e0 2024-03-26T06:18:24.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.487+0000 7fd63a000640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd61c06bbd0 0x7fd61c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:24.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.488+0000 7fd63a000640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd61c06bbd0 0x7fd61c06e090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0b0510 tx=0x7fd628008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:24.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.492+0000 7fd632a00640 1 -- 172.21.15.63:0/2160820292 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fd62c010300 con 0x7fd63c0715e0 2024-03-26T06:18:24.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:24.703+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd63c06e6f0 con 0x7fd63c0715e0 2024-03-26T06:18:25.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.224+0000 7fd632a00640 1 -- 172.21.15.63:0/2160820292 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fd62c058d50 con 0x7fd63c0715e0 2024-03-26T06:18:25.226 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data_ec' removed 2024-03-26T06:18:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.227+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd61c06bbd0 msgr2=0x7fd61c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.227+0000 7fd641c00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd61c06bbd0 0x7fd61c06e090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0b0510 tx=0x7fd628008040 comp rx=0 tx=0).stop 2024-03-26T06:18:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.228+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd63c0715e0 msgr2=0x7fd63c143060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.228+0000 7fd641c00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd63c0715e0 0x7fd63c143060 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00c3c0 tx=0x7fd62c00c880 comp rx=0 tx=0).stop 2024-03-26T06:18:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.228+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 shutdown_connections 2024-03-26T06:18:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.228+0000 7fd641c00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fd61c06bbd0 0x7fd61c06e090 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.228+0000 7fd641c00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd63c147390 0x7fd63c141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.228+0000 7fd641c00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd63c0adfe0 0x7fd63c145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.228+0000 7fd641c00640 1 --2- 172.21.15.63:0/2160820292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd63c0715e0 0x7fd63c143060 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.228+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 >> 172.21.15.63:0/2160820292 conn(0x7fd63c0b18c0 msgr2=0x7fd63c06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.228+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 shutdown_connections 2024-03-26T06:18:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.229+0000 7fd641c00640 1 -- 172.21.15.63:0/2160820292 wait complete. 2024-03-26T06:18:25.261 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-26T06:18:25.261 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-26T06:18:25.262 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-26T06:18:25.262 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T06:18:25.262 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-26T06:18:25.262 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-26T06:18:25.262 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-26T06:18:25.262 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T06:18:25.263 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-26T06:18:25.263 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-26T06:18:25.263 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-26T06:18:25.263 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T06:18:25.263 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-26T06:18:25.263 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-26T06:18:25.263 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-26T06:18:25.263 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T06:18:25.283 INFO:tasks.ceph.mds.a:Stopped 2024-03-26T06:18:25.283 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-26T06:18:25.285 INFO:tasks.ceph.mds.c:Stopped 2024-03-26T06:18:25.285 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-26T06:18:25.286 INFO:tasks.ceph.mds.d:Stopped 2024-03-26T06:18:25.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-26T06:18:25.288 INFO:tasks.ceph.mds.b:Stopped 2024-03-26T06:18:25.288 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-26T06:18:25.331 INFO:tasks.ceph.mds.a:Started 2024-03-26T06:18:25.332 DEBUG:teuthology.parallel:result is None 2024-03-26T06:18:25.337 INFO:tasks.ceph.mds.c:Started 2024-03-26T06:18:25.337 DEBUG:teuthology.parallel:result is None 2024-03-26T06:18:25.337 INFO:tasks.ceph.mds.d:Started 2024-03-26T06:18:25.338 DEBUG:teuthology.parallel:result is None 2024-03-26T06:18:25.341 INFO:tasks.ceph.mds.b:Started 2024-03-26T06:18:25.342 DEBUG:teuthology.parallel:result is None 2024-03-26T06:18:25.343 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-26T06:18:25.487 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-03-26T06:18:25.490 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-03-26T06:18:25.490 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-03-26T06:18:25.492 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2024-03-26T06:18:25.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.531+0000 7fbafb200640 1 Processor -- start 2024-03-26T06:18:25.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.531+0000 7fbafb200640 1 -- start start 2024-03-26T06:18:25.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.532+0000 7fbafb200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40d1e90 0x7fbaf406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:25.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.532+0000 7fbafb200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbaf40cfe90 0x7fbaf40cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:25.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.532+0000 7fbafb200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf406d1f0 con 0x7fbaf415dc70 2024-03-26T06:18:25.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.532+0000 7fbafb200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf40cc480 con 0x7fbaf40cfe90 2024-03-26T06:18:25.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.532+0000 7fbafb200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf40d0310 con 0x7fbaf40d1e90 2024-03-26T06:18:25.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.533+0000 7fbaf3400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40d1e90 0x7fbaf406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:25.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.533+0000 7fbaf9200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbaf40cfe90 0x7fbaf40cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:25.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.533+0000 7fbaf3400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40d1e90 0x7fbaf406c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:34498/0 (socket says 172.21.15.63:34498) 2024-03-26T06:18:25.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.533+0000 7fbaf3e00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fbaf415dc70 0x7fbaf40d1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:47330/0 (socket says 172.21.15.63:47330) 2024-03-26T06:18:25.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.533+0000 7fbaf3400640 1 -- 172.21.15.63:0/407989256 learned_addr learned my addr 172.21.15.63:0/407989256 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:25.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.533+0000 7fbaf3400640 1 -- 172.21.15.63:0/407989256 >> v2:172.21.15.204:3300/0 conn(0x7fbaf40cfe90 msgr2=0x7fbaf40cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:25.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.533+0000 7fbaf3400640 1 --2- 172.21.15.63:0/407989256 >> v2:172.21.15.204:3300/0 conn(0x7fbaf40cfe90 0x7fbaf40cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:25.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.533+0000 7fbaf3400640 1 -- 172.21.15.63:0/407989256 >> v1:172.21.15.204:6789/0 conn(0x7fbaf415dc70 legacy=0x7fbaf40d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:25.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.533+0000 7fbaf3400640 1 -- 172.21.15.63:0/407989256 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf406c950 con 0x7fbaf40d1e90 2024-03-26T06:18:25.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.534+0000 7fbaf3400640 1 --2- 172.21.15.63:0/407989256 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40d1e90 0x7fbaf406c270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009870 tx=0x7fbae002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=258722aeffd03d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:25.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbaf2a00640 1 -- 172.21.15.63:0/407989256 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0034070 con 0x7fbaf40d1e90 2024-03-26T06:18:25.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbaf2a00640 1 -- 172.21.15.63:0/407989256 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae0030840 con 0x7fbaf40d1e90 2024-03-26T06:18:25.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbaf2a00640 1 -- 172.21.15.63:0/407989256 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0030c10 con 0x7fbaf40d1e90 2024-03-26T06:18:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbafb200640 1 -- 172.21.15.63:0/407989256 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40d1e90 msgr2=0x7fbaf406c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbafb200640 1 --2- 172.21.15.63:0/407989256 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40d1e90 0x7fbaf406c270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009870 tx=0x7fbae002b980 comp rx=0 tx=0).stop 2024-03-26T06:18:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbafb200640 1 -- 172.21.15.63:0/407989256 shutdown_connections 2024-03-26T06:18:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbafb200640 1 --2- 172.21.15.63:0/407989256 >> v2:172.21.15.204:3300/0 conn(0x7fbaf40cfe90 0x7fbaf40cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbafb200640 1 --2- 172.21.15.63:0/407989256 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40d1e90 0x7fbaf406c270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbafb200640 1 -- 172.21.15.63:0/407989256 >> 172.21.15.63:0/407989256 conn(0x7fbaf4071000 msgr2=0x7fbaf40713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbafb200640 1 -- 172.21.15.63:0/407989256 shutdown_connections 2024-03-26T06:18:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.535+0000 7fbafb200640 1 -- 172.21.15.63:0/407989256 wait complete. 2024-03-26T06:18:25.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.537+0000 7fbafb200640 1 Processor -- start 2024-03-26T06:18:25.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.537+0000 7fbafb200640 1 -- start start 2024-03-26T06:18:25.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbafb200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40cfe90 0x7fbaf4153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbafb200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbaf40d1e90 0x7fbaf40c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbafb200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaf415dc70 0x7fbaf40ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbafb200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf415e050 con 0x7fbaf415dc70 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbafb200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf406cf10 con 0x7fbaf40d1e90 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbafb200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf40ce390 con 0x7fbaf40cfe90 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbaf9200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaf415dc70 0x7fbaf40ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbaf9200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaf415dc70 0x7fbaf40ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42438/0 (socket says 172.21.15.63:42438) 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbaf9200640 1 -- 172.21.15.63:0/878584324 learned_addr learned my addr 172.21.15.63:0/878584324 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbaf3400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbaf40d1e90 0x7fbaf40c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.538+0000 7fbaf3e00640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40cfe90 0x7fbaf4153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:25.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.539+0000 7fbaf9200640 1 -- 172.21.15.63:0/878584324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40cfe90 msgr2=0x7fbaf4153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:25.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.539+0000 7fbaf9200640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40cfe90 0x7fbaf4153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.539+0000 7fbaf9200640 1 -- 172.21.15.63:0/878584324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbaf40d1e90 msgr2=0x7fbaf40c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.539+0000 7fbaf9200640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbaf40d1e90 0x7fbaf40c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.539+0000 7fbaf9200640 1 -- 172.21.15.63:0/878584324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf40c6e60 con 0x7fbaf415dc70 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.539+0000 7fbaf3400640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbaf40d1e90 0x7fbaf40c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.539+0000 7fbaf9200640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaf415dc70 0x7fbaf40ca390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00efc0 tx=0x7fbaec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.539+0000 7fbaebe00640 1 -- 172.21.15.63:0/878584324 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec018020 con 0x7fbaf415dc70 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.540+0000 7fbaebe00640 1 -- 172.21.15.63:0/878584324 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec014480 con 0x7fbaf415dc70 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.540+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf40c5dc0 con 0x7fbaf415dc70 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.540+0000 7fbaebe00640 1 -- 172.21.15.63:0/878584324 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec014870 con 0x7fbaf415dc70 2024-03-26T06:18:25.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.540+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf40c6380 con 0x7fbaf415dc70 2024-03-26T06:18:25.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.541+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf406df30 con 0x7fbaf415dc70 2024-03-26T06:18:25.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.542+0000 7fbaebe00640 1 -- 172.21.15.63:0/878584324 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbaec005d10 con 0x7fbaf415dc70 2024-03-26T06:18:25.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.543+0000 7fbaebe00640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbad406bc00 0x7fbad406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:25.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.543+0000 7fbaebe00640 1 -- 172.21.15.63:0/878584324 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fbaec08b2d0 con 0x7fbaf415dc70 2024-03-26T06:18:25.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.543+0000 7fbaf3e00640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbad406bc00 0x7fbad406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:25.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.544+0000 7fbaf3e00640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbad406bc00 0x7fbad406e0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbae4007fd0 tx=0x7fbae4007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:25.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.547+0000 7fbaebe00640 1 -- 172.21.15.63:0/878584324 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fbaec022070 con 0x7fbaf415dc70 2024-03-26T06:18:25.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:25.760+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbaf4071f00 con 0x7fbaf415dc70 2024-03-26T06:18:26.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.260+0000 7fbaebe00640 1 -- 172.21.15.63:0/878584324 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbaec010040 con 0x7fbaf415dc70 2024-03-26T06:18:26.261 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blocklist entries 2024-03-26T06:18:26.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbad406bc00 msgr2=0x7fbad406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbad406bc00 0x7fbad406e0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbae4007fd0 tx=0x7fbae4007e80 comp rx=0 tx=0).stop 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaf415dc70 msgr2=0x7fbaf40ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaf415dc70 0x7fbaf40ca390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00efc0 tx=0x7fbaec00c490 comp rx=0 tx=0).stop 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 shutdown_connections 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbad406bc00 0x7fbad406e0c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaf415dc70 0x7fbaf40ca390 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbaf40d1e90 0x7fbaf40c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 --2- 172.21.15.63:0/878584324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbaf40cfe90 0x7fbaf4153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.264+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 >> 172.21.15.63:0/878584324 conn(0x7fbaf4071000 msgr2=0x7fbaf40b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.265+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 shutdown_connections 2024-03-26T06:18:26.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.265+0000 7fbafb200640 1 -- 172.21.15.63:0/878584324 wait complete. 2024-03-26T06:18:26.287 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-26T06:18:26.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.495+0000 7f4491e00640 1 Processor -- start 2024-03-26T06:18:26.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.496+0000 7f4491e00640 1 -- start start 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.497+0000 7f4491e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f448c15d9a0 0x7f448c0b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.497+0000 7f4491e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0d1c10 0x7f448c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.497+0000 7f4491e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0b97c0 con 0x7f448c0d3250 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.497+0000 7f4491e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c0d21b0 con 0x7f448c15d9a0 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.497+0000 7f4491e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0d2490 con 0x7f448c0d1c10 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.497+0000 7f4490a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f448c15d9a0 0x7f448c0b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.497+0000 7f4490a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f448c15d9a0 0x7f448c0b9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42446/0 (socket says 172.21.15.63:42446) 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.497+0000 7f4490a00640 1 -- 172.21.15.63:0/4124278571 learned_addr learned my addr 172.21.15.63:0/4124278571 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.498+0000 7f4490a00640 1 -- 172.21.15.63:0/4124278571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0d1c10 msgr2=0x7f448c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.498+0000 7f4490a00640 1 --2- 172.21.15.63:0/4124278571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0d1c10 0x7f448c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.498+0000 7f4490a00640 1 -- 172.21.15.63:0/4124278571 >> v1:172.21.15.204:6789/0 conn(0x7f448c0d3250 legacy=0x7f448c0b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.498+0000 7f4490a00640 1 -- 172.21.15.63:0/4124278571 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0d2770 con 0x7f448c15d9a0 2024-03-26T06:18:26.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.499+0000 7f4490a00640 1 --2- 172.21.15.63:0/4124278571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c15d9a0 0x7f448c0b9280 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4480009870 tx=0x7f448002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bb19edfc5c08c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:26.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.499+0000 7f448b400640 1 -- 172.21.15.63:0/4124278571 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800317c0 con 0x7f448c15d9a0 2024-03-26T06:18:26.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.499+0000 7f448b400640 1 -- 172.21.15.63:0/4124278571 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480037070 con 0x7f448c15d9a0 2024-03-26T06:18:26.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.499+0000 7f448b400640 1 -- 172.21.15.63:0/4124278571 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480031b80 con 0x7f448c15d9a0 2024-03-26T06:18:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.500+0000 7f4491e00640 1 -- 172.21.15.63:0/4124278571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c15d9a0 msgr2=0x7f448c0b9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.500+0000 7f4491e00640 1 --2- 172.21.15.63:0/4124278571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c15d9a0 0x7f448c0b9280 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4480009870 tx=0x7f448002b860 comp rx=0 tx=0).stop 2024-03-26T06:18:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.500+0000 7f4491e00640 1 -- 172.21.15.63:0/4124278571 shutdown_connections 2024-03-26T06:18:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.500+0000 7f4491e00640 1 --2- 172.21.15.63:0/4124278571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0d1c10 0x7f448c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.500+0000 7f4491e00640 1 --2- 172.21.15.63:0/4124278571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c15d9a0 0x7f448c0b9280 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.500+0000 7f4491e00640 1 -- 172.21.15.63:0/4124278571 >> 172.21.15.63:0/4124278571 conn(0x7f448c06bfa0 msgr2=0x7f448c06c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:26.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.500+0000 7f4491e00640 1 -- 172.21.15.63:0/4124278571 shutdown_connections 2024-03-26T06:18:26.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.500+0000 7f4491e00640 1 -- 172.21.15.63:0/4124278571 wait complete. 2024-03-26T06:18:26.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.502+0000 7f4491e00640 1 Processor -- start 2024-03-26T06:18:26.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.502+0000 7f4491e00640 1 -- start start 2024-03-26T06:18:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4491e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c0d1c10 0x7f448c151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4491e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0d3250 0x7f448c160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4491e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c15d9a0 0x7f448c15df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4491e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c15dd80 con 0x7f448c0d1c10 2024-03-26T06:18:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4491e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0d2d30 con 0x7f448c15d9a0 2024-03-26T06:18:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4491e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0cea50 con 0x7f448c0d3250 2024-03-26T06:18:26.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4490a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c0d1c10 0x7f448c151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:26.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4490a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c0d1c10 0x7f448c151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42458/0 (socket says 172.21.15.63:42458) 2024-03-26T06:18:26.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4490a00640 1 -- 172.21.15.63:0/4142268944 learned_addr learned my addr 172.21.15.63:0/4142268944 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4490a00640 1 -- 172.21.15.63:0/4142268944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0d3250 msgr2=0x7f448c160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4490a00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0d3250 0x7f448c160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4490a00640 1 -- 172.21.15.63:0/4142268944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c15d9a0 msgr2=0x7f448c15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4490a00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c15d9a0 0x7f448c15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.503+0000 7f4490a00640 1 -- 172.21.15.63:0/4142268944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c160d60 con 0x7f448c0d1c10 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.504+0000 7f4490a00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c0d1c10 0x7f448c151640 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4480009870 tx=0x7f44800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.504+0000 7f4488c00640 1 -- 172.21.15.63:0/4142268944 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480032860 con 0x7f448c0d1c10 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.504+0000 7f4488c00640 1 -- 172.21.15.63:0/4142268944 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480032a00 con 0x7f448c0d1c10 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.504+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c0b54d0 con 0x7f448c0d1c10 2024-03-26T06:18:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.504+0000 7f4488c00640 1 -- 172.21.15.63:0/4142268944 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480032dd0 con 0x7f448c0d1c10 2024-03-26T06:18:26.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.504+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c0cabf0 con 0x7f448c0d1c10 2024-03-26T06:18:26.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.505+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c04f050 con 0x7f448c0d1c10 2024-03-26T06:18:26.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.506+0000 7f4488c00640 1 -- 172.21.15.63:0/4142268944 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f448004c060 con 0x7f448c0d1c10 2024-03-26T06:18:26.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.507+0000 7f4488c00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f446c06bbd0 0x7f446c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:26.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.507+0000 7f4488c00640 1 -- 172.21.15.63:0/4142268944 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f44800ac210 con 0x7f448c0d1c10 2024-03-26T06:18:26.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.508+0000 7f448be00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f446c06bbd0 0x7f446c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:26.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.508+0000 7f448be00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f446c06bbd0 0x7f446c06e090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f448c1f6dc0 tx=0x7f4478006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:26.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.512+0000 7f4488c00640 1 -- 172.21.15.63:0/4142268944 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f4480040070 con 0x7f448c0d1c10 2024-03-26T06:18:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.787+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f448c0ce3e0 con 0x7f448c0d1c10 2024-03-26T06:18:26.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.789+0000 7f4488c00640 1 -- 172.21.15.63:0/4142268944 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v7) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f448007ae20 con 0x7f448c0d1c10 2024-03-26T06:18:26.790 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:26.790 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-03-26T06:18:26.790 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAXaAJmBVVWKhAAT1KNyKkZa6VZglb9O9GylQ==", 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2024-03-26T06:18:26.791 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAYaAJmORQiEhAAqnvCxGGyRl3YPvmQZWEacg==", 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.c", 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAYaAJm2JgpARAAEB8SEQYJHidzhLYUaynqDg==", 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-03-26T06:18:26.792 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.d", 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAYaAJmuQjxIhAA2dASwPXPs1OeW/fcVd4IXQ==", 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-03-26T06:18:26.793 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.794 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.794 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2024-03-26T06:18:26.794 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAdaAJmMOa7FxAAE+zHG5r3ClD8oasscYhdkQ==", 2024-03-26T06:18:26.794 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.794 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-03-26T06:18:26.795 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-03-26T06:18:26.795 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.795 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2024-03-26T06:18:26.796 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAgaAJmoJ0/IxAAv3JVVTA3ov1m4tkye6PH+Q==", 2024-03-26T06:18:26.796 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.796 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-03-26T06:18:26.796 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-03-26T06:18:26.796 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAkaAJmT45tAhAAetc8t/7p8R2jwHZGUlZddw==", 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.797 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAnaAJms28BDRAAUlph7wTKeUNDFA144/AdaQ==", 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.798 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAuaAJmzYTXCBAAbzANshsbxrBzOIaa/BqSJQ==", 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAxaAJmwHozIRAADlessuWynNcoe/QkRHqYbg==", 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-03-26T06:18:26.799 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQA0aAJmwY7FKRAAg2NLHn4/41R3lKHOYovajA==", 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQA3aAJmxF9cMxAAaKVUplY07a9GkxaXuV3dlw==", 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAYaAJmRB44MRAAZ6mfBf153b2nT0G6Lkv1MA==", 2024-03-26T06:18:26.801 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAZaAJmqZV7DBAATop9QomwIPfws5mxTjWTUA==", 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-03-26T06:18:26.802 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAZaAJmZUs1ARAAbSWJu9BKZJ9+ilp/i2e5VQ==", 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAZaAJmCroiFxAAqJ2QS3ciaguaWep1cAqB1Q==", 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg==", 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.804 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2024-03-26T06:18:26.805 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-03-26T06:18:26.805 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-03-26T06:18:26.805 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.805 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.806 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mds", 2024-03-26T06:18:26.806 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBAaAJmUi6FKhAA5+eNkJPmYY7gPKN5cpaU8w==", 2024-03-26T06:18:26.806 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.806 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mds" 2024-03-26T06:18:26.806 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.806 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mgr", 2024-03-26T06:18:26.807 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBAaAJm2DyFKhAAeDdgvChuuZ/lPCXtt2ERng==", 2024-03-26T06:18:26.807 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-26T06:18:26.807 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.807 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-osd", 2024-03-26T06:18:26.807 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBAaAJmb0iFKhAAhAvWlwoXautg0DHCgQeTVg==", 2024-03-26T06:18:26.808 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-osd" 2024-03-26T06:18:26.808 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.808 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd", 2024-03-26T06:18:26.808 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBAaAJmNVGFKhAACyil334jM/wF3PCvVpFAAg==", 2024-03-26T06:18:26.808 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-26T06:18:26.809 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.809 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-26T06:18:26.809 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBAaAJmzlmFKhAAocd1+Lu9x8ZurX+Z29Y05Q==", 2024-03-26T06:18:26.809 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-26T06:18:26.809 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.810 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rgw", 2024-03-26T06:18:26.810 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBAaAJm3GKFKhAAlJQA/4EW9zoxGHPwPYf3HQ==", 2024-03-26T06:18:26.810 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-26T06:18:26.810 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.811 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2024-03-26T06:18:26.811 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAXaAJmJDMIHhAAXLC3wuPcP2kYFDmRGt7uEw==", 2024-03-26T06:18:26.811 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2024-03-26T06:18:26.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2024-03-26T06:18:26.811 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.811 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-03-26T06:18:26.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:26.812 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2024-03-26T06:18:26.812 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAXaAJmCi7+EhAA5QxyT7e0hbekB1pJrwreJQ==", 2024-03-26T06:18:26.812 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-03-26T06:18:26.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2024-03-26T06:18:26.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2024-03-26T06:18:26.812 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-03-26T06:18:26.813 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.813 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:26.813 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-03-26T06:18:26.813 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-03-26T06:18:26.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f446c06bbd0 msgr2=0x7f446c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:26.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f446c06bbd0 0x7f446c06e090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f448c1f6dc0 tx=0x7f4478006c90 comp rx=0 tx=0).stop 2024-03-26T06:18:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c0d1c10 msgr2=0x7f448c151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c0d1c10 0x7f448c151640 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4480009870 tx=0x7f44800046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 shutdown_connections 2024-03-26T06:18:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f446c06bbd0 0x7f446c06e090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c15d9a0 0x7f448c15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0d3250 0x7f448c160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 --2- 172.21.15.63:0/4142268944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f448c0d1c10 0x7f448c151640 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 >> 172.21.15.63:0/4142268944 conn(0x7f448c06bfa0 msgr2=0x7f448c0c7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 shutdown_connections 2024-03-26T06:18:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:26.792+0000 7f4491e00640 1 -- 172.21.15.63:0/4142268944 wait complete. 2024-03-26T06:18:26.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-26T06:18:27.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.041+0000 7fe3d9a00640 1 Processor -- start 2024-03-26T06:18:27.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.042+0000 7fe3d9a00640 1 -- start start 2024-03-26T06:18:27.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.043+0000 7fe3d9a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d413e650 0x7fe3d406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.043+0000 7fe3d9a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe3d406d270 0x7fe3d4071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.043+0000 7fe3d9a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3d413eca0 0x7fe3d4071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.043+0000 7fe3d9a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d415f410 con 0x7fe3d413eca0 2024-03-26T06:18:27.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.043+0000 7fe3d9a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d415f6f0 con 0x7fe3d406d270 2024-03-26T06:18:27.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.043+0000 7fe3d9a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d415f9d0 con 0x7fe3d413e650 2024-03-26T06:18:27.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3d9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3d413eca0 0x7fe3d4071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3d9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3d413eca0 0x7fe3d4071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42462/0 (socket says 172.21.15.63:42462) 2024-03-26T06:18:27.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3d9000640 1 -- 172.21.15.63:0/982042768 learned_addr learned my addr 172.21.15.63:0/982042768 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:27.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3d3e00640 1 --2- 172.21.15.63:0/982042768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d413e650 0x7fe3d406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3cbe00640 1 --2- 172.21.15.63:0/982042768 >> v2:172.21.15.204:3300/0 conn(0x7fe3d406d270 0x7fe3d4071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3d9000640 1 -- 172.21.15.63:0/982042768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d413e650 msgr2=0x7fe3d406daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:27.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3d9000640 1 --2- 172.21.15.63:0/982042768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d413e650 0x7fe3d406daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3d9000640 1 -- 172.21.15.63:0/982042768 >> v2:172.21.15.204:3300/0 conn(0x7fe3d406d270 msgr2=0x7fe3d4071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:27.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3d9000640 1 --2- 172.21.15.63:0/982042768 >> v2:172.21.15.204:3300/0 conn(0x7fe3d406d270 0x7fe3d4071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.044+0000 7fe3d9000640 1 -- 172.21.15.63:0/982042768 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d415fcb0 con 0x7fe3d413eca0 2024-03-26T06:18:27.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.045+0000 7fe3d9000640 1 --2- 172.21.15.63:0/982042768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 0x7fe3d4071680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40b4910 tx=0x7fe3cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3496c3dc5c39f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:27.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d3400640 1 -- 172.21.15.63:0/982042768 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc02ca70 con 0x7fe3d413eca0 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d3400640 1 -- 172.21.15.63:0/982042768 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc02cc10 con 0x7fe3d413eca0 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d3400640 1 -- 172.21.15.63:0/982042768 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0343f0 con 0x7fe3d413eca0 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d9a00640 1 -- 172.21.15.63:0/982042768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 msgr2=0x7fe3d4071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/982042768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 0x7fe3d4071680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40b4910 tx=0x7fe3cc02bed0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d9a00640 1 -- 172.21.15.63:0/982042768 shutdown_connections 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/982042768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 0x7fe3d4071680 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/982042768 >> v2:172.21.15.204:3300/0 conn(0x7fe3d406d270 0x7fe3d4071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/982042768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d413e650 0x7fe3d406daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d9a00640 1 -- 172.21.15.63:0/982042768 >> 172.21.15.63:0/982042768 conn(0x7fe3d40670b0 msgr2=0x7fe3d40b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.046+0000 7fe3d9a00640 1 -- 172.21.15.63:0/982042768 shutdown_connections 2024-03-26T06:18:27.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.047+0000 7fe3d9a00640 1 -- 172.21.15.63:0/982042768 wait complete. 2024-03-26T06:18:27.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.048+0000 7fe3d9a00640 1 Processor -- start 2024-03-26T06:18:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.048+0000 7fe3d9a00640 1 -- start start 2024-03-26T06:18:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.049+0000 7fe3d9a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d406d270 0x7fe3d40af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.049+0000 7fe3d9a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3d413e650 0x7fe3d415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.049+0000 7fe3d9a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 0x7fe3d4158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.049+0000 7fe3d9a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d406e670 con 0x7fe3d413eca0 2024-03-26T06:18:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.049+0000 7fe3d9a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d406e030 con 0x7fe3d413e650 2024-03-26T06:18:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.049+0000 7fe3d9a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d406e7f0 con 0x7fe3d406d270 2024-03-26T06:18:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 0x7fe3d4158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 0x7fe3d4158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42464/0 (socket says 172.21.15.63:42464) 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d9000640 1 -- 172.21.15.63:0/1744366024 learned_addr learned my addr 172.21.15.63:0/1744366024 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d3e00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d406d270 0x7fe3d40af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3cbe00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3d413e650 0x7fe3d415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d9000640 1 -- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d406d270 msgr2=0x7fe3d40af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d9000640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d406d270 0x7fe3d40af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d9000640 1 -- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3d413e650 msgr2=0x7fe3d415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d9000640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3d413e650 0x7fe3d415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d9000640 1 -- 172.21.15.63:0/1744366024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d40b0770 con 0x7fe3d413eca0 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3cbe00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3d413e650 0x7fe3d415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d3e00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d406d270 0x7fe3d40af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:27.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.050+0000 7fe3d9000640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 0x7fe3d4158670 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc036040 tx=0x7fe3cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:27.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.051+0000 7fe3d0c00640 1 -- 172.21.15.63:0/1744366024 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc043020 con 0x7fe3d413eca0 2024-03-26T06:18:27.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.051+0000 7fe3d0c00640 1 -- 172.21.15.63:0/1744366024 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc03e450 con 0x7fe3d413eca0 2024-03-26T06:18:27.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.051+0000 7fe3d0c00640 1 -- 172.21.15.63:0/1744366024 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc009510 con 0x7fe3d413eca0 2024-03-26T06:18:27.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.051+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d40af610 con 0x7fe3d413eca0 2024-03-26T06:18:27.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.051+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d40afbd0 con 0x7fe3d413eca0 2024-03-26T06:18:27.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.052+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d404f0c0 con 0x7fe3d413eca0 2024-03-26T06:18:27.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.053+0000 7fe3d0c00640 1 -- 172.21.15.63:0/1744366024 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe3cc005d10 con 0x7fe3d413eca0 2024-03-26T06:18:27.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.054+0000 7fe3d0c00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe3b006bbd0 0x7fe3b006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.054+0000 7fe3d0c00640 1 -- 172.21.15.63:0/1744366024 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe3cc0ad430 con 0x7fe3d413eca0 2024-03-26T06:18:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.054+0000 7fe3d3e00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe3b006bbd0 0x7fe3b006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.055+0000 7fe3d3e00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe3b006bbd0 0x7fe3b006e090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4006fd0 tx=0x7fe3c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:27.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.059+0000 7fe3d0c00640 1 -- 172.21.15.63:0/1744366024 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe3d40b0770 con 0x7fe3d413eca0 2024-03-26T06:18:27.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.333+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe3d40717c0 con 0x7fe3d413eca0 2024-03-26T06:18:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.337+0000 7fe3d0c00640 1 -- 172.21.15.63:0/1744366024 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe3cc07c1f0 con 0x7fe3d413eca0 2024-03-26T06:18:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.339+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe3b006bbd0 msgr2=0x7fe3b006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.339+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe3b006bbd0 0x7fe3b006e090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4006fd0 tx=0x7fe3c4008040 comp rx=0 tx=0).stop 2024-03-26T06:18:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 msgr2=0x7fe3d4158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 0x7fe3d4158670 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc036040 tx=0x7fe3cc004a40 comp rx=0 tx=0).stop 2024-03-26T06:18:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 shutdown_connections 2024-03-26T06:18:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fe3b006bbd0 0x7fe3b006e090 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d413eca0 0x7fe3d4158670 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3d413e650 0x7fe3d415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 --2- 172.21.15.63:0/1744366024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3d406d270 0x7fe3d40af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 >> 172.21.15.63:0/1744366024 conn(0x7fe3d40670b0 msgr2=0x7fe3d40b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 shutdown_connections 2024-03-26T06:18:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.340+0000 7fe3d9a00640 1 -- 172.21.15.63:0/1744366024 wait complete. 2024-03-26T06:18:27.359 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-26T06:18:27.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.574+0000 7fbd93200640 1 Processor -- start 2024-03-26T06:18:27.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.574+0000 7fbd93200640 1 -- start start 2024-03-26T06:18:27.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.575+0000 7fbd93200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd9406b3a0 0x7fbd9415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.575+0000 7fbd93200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9415e0b0 con 0x7fbd94157db0 2024-03-26T06:18:27.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.575+0000 7fbd93200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd940c6ff0 con 0x7fbd94158190 2024-03-26T06:18:27.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.575+0000 7fbd93200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9415e320 con 0x7fbd9406b3a0 2024-03-26T06:18:27.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.576+0000 7fbd91400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd9406b3a0 0x7fbd9415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.576+0000 7fbd91400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd9406b3a0 0x7fbd9415eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42466/0 (socket says 172.21.15.63:42466) 2024-03-26T06:18:27.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.576+0000 7fbd91400640 1 -- 172.21.15.63:0/3385502637 learned_addr learned my addr 172.21.15.63:0/3385502637 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:27.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.576+0000 7fbd91400640 1 -- 172.21.15.63:0/3385502637 >> v1:172.21.15.204:6789/0 conn(0x7fbd94158190 legacy=0x7fbd940af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:27.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.576+0000 7fbd91400640 1 -- 172.21.15.63:0/3385502637 >> v1:172.21.15.63:6789/0 conn(0x7fbd94157db0 legacy=0x7fbd9406ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.576+0000 7fbd91400640 1 -- 172.21.15.63:0/3385502637 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9415e600 con 0x7fbd9406b3a0 2024-03-26T06:18:27.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.577+0000 7fbd91400640 1 --2- 172.21.15.63:0/3385502637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 0x7fbd9415eb20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009870 tx=0x7fbd7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c0f543114af704 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:27.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.578+0000 7fbd90a00640 1 -- 172.21.15.63:0/3385502637 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c035020 con 0x7fbd9406b3a0 2024-03-26T06:18:27.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.578+0000 7fbd90a00640 1 -- 172.21.15.63:0/3385502637 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c031870 con 0x7fbd9406b3a0 2024-03-26T06:18:27.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.578+0000 7fbd90a00640 1 -- 172.21.15.63:0/3385502637 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c031c40 con 0x7fbd9406b3a0 2024-03-26T06:18:27.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.578+0000 7fbd93200640 1 -- 172.21.15.63:0/3385502637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 msgr2=0x7fbd9415eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.578+0000 7fbd93200640 1 --2- 172.21.15.63:0/3385502637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 0x7fbd9415eb20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009870 tx=0x7fbd7c02b910 comp rx=0 tx=0).stop 2024-03-26T06:18:27.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.578+0000 7fbd93200640 1 -- 172.21.15.63:0/3385502637 shutdown_connections 2024-03-26T06:18:27.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.578+0000 7fbd93200640 1 --2- 172.21.15.63:0/3385502637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 0x7fbd9415eb20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.578+0000 7fbd93200640 1 -- 172.21.15.63:0/3385502637 >> 172.21.15.63:0/3385502637 conn(0x7fbd94099a70 msgr2=0x7fbd940b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:27.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.579+0000 7fbd93200640 1 -- 172.21.15.63:0/3385502637 shutdown_connections 2024-03-26T06:18:27.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.579+0000 7fbd93200640 1 -- 172.21.15.63:0/3385502637 wait complete. 2024-03-26T06:18:27.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.580+0000 7fbd93200640 1 Processor -- start 2024-03-26T06:18:27.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.580+0000 7fbd93200640 1 -- start start 2024-03-26T06:18:27.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.581+0000 7fbd93200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 0x7fbd940b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.581+0000 7fbd93200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd94157db0 0x7fbd940c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.581+0000 7fbd93200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd94158190 0x7fbd94159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.581+0000 7fbd93200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940c6a70 con 0x7fbd9406b3a0 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.581+0000 7fbd93200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940b2ea0 con 0x7fbd94157db0 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.581+0000 7fbd93200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940c6bf0 con 0x7fbd94158190 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.581+0000 7fbd91e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 0x7fbd940b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 0x7fbd940b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42480/0 (socket says 172.21.15.63:42480) 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91e00640 1 -- 172.21.15.63:0/2816014595 learned_addr learned my addr 172.21.15.63:0/2816014595 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd92800640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd94158190 0x7fbd94159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91400640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd94157db0 0x7fbd940c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91e00640 1 -- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd94158190 msgr2=0x7fbd94159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91e00640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd94158190 0x7fbd94159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91e00640 1 -- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd94157db0 msgr2=0x7fbd940c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91e00640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd94157db0 0x7fbd940c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91e00640 1 -- 172.21.15.63:0/2816014595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9415b1c0 con 0x7fbd9406b3a0 2024-03-26T06:18:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd92800640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd94158190 0x7fbd94159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:27.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91400640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd94157db0 0x7fbd940c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:27.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.582+0000 7fbd91e00640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 0x7fbd940b5a50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400c3c0 tx=0x7fbd8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:27.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.583+0000 7fbd8a000640 1 -- 172.21.15.63:0/2816014595 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd840052d0 con 0x7fbd9406b3a0 2024-03-26T06:18:27.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.583+0000 7fbd8a000640 1 -- 172.21.15.63:0/2816014595 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd84005490 con 0x7fbd9406b3a0 2024-03-26T06:18:27.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.583+0000 7fbd8a000640 1 -- 172.21.15.63:0/2816014595 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84007260 con 0x7fbd9406b3a0 2024-03-26T06:18:27.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.583+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9415aee0 con 0x7fbd9406b3a0 2024-03-26T06:18:27.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.583+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd940b3830 con 0x7fbd9406b3a0 2024-03-26T06:18:27.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.584+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9404f0c0 con 0x7fbd9406b3a0 2024-03-26T06:18:27.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.585+0000 7fbd8a000640 1 -- 172.21.15.63:0/2816014595 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbd84007400 con 0x7fbd9406b3a0 2024-03-26T06:18:27.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.586+0000 7fbd8a000640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbd7006bbd0 0x7fbd7006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:27.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.586+0000 7fbd8a000640 1 -- 172.21.15.63:0/2816014595 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fbd84089da0 con 0x7fbd9406b3a0 2024-03-26T06:18:27.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.586+0000 7fbd91400640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbd7006bbd0 0x7fbd7006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:27.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.587+0000 7fbd91400640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbd7006bbd0 0x7fbd7006e090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c036000 tx=0x7fbd7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:27.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.590+0000 7fbd8a000640 1 -- 172.21.15.63:0/2816014595 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fbd84058a40 con 0x7fbd9406b3a0 2024-03-26T06:18:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.865+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fbd9409a0c0 con 0x7fbd9406b3a0 2024-03-26T06:18:27.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.870+0000 7fbd8a000640 1 -- 172.21.15.63:0/2816014595 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbd84058340 con 0x7fbd9406b3a0 2024-03-26T06:18:27.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.872+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbd7006bbd0 msgr2=0x7fbd7006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.872+0000 7fbd93200640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbd7006bbd0 0x7fbd7006e090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c036000 tx=0x7fbd7c008030 comp rx=0 tx=0).stop 2024-03-26T06:18:27.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 msgr2=0x7fbd940b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:27.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 0x7fbd940b5a50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400c3c0 tx=0x7fbd8400c880 comp rx=0 tx=0).stop 2024-03-26T06:18:27.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 shutdown_connections 2024-03-26T06:18:27.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbd7006bbd0 0x7fbd7006e090 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd94158190 0x7fbd94159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd94157db0 0x7fbd940c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 --2- 172.21.15.63:0/2816014595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9406b3a0 0x7fbd940b5a50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:27.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 >> 172.21.15.63:0/2816014595 conn(0x7fbd94099a70 msgr2=0x7fbd940cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:27.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 shutdown_connections 2024-03-26T06:18:27.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:27.873+0000 7fbd93200640 1 -- 172.21.15.63:0/2816014595 wait complete. 2024-03-26T06:18:27.895 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-26T06:18:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.116+0000 7f85a4a00640 1 Processor -- start 2024-03-26T06:18:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.117+0000 7f85a4a00640 1 -- start start 2024-03-26T06:18:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.118+0000 7f85a4a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85a006d270 0x7f85a0071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.118+0000 7f85a4a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f85a013eca0 0x7f85a0071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.118+0000 7f85a4a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a015f410 con 0x7f85a013e650 2024-03-26T06:18:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.118+0000 7f85a4a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a015f6f0 con 0x7f85a006d270 2024-03-26T06:18:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.118+0000 7f85a4a00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a015f9d0 con 0x7f85a013eca0 2024-03-26T06:18:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.119+0000 7f8597e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85a006d270 0x7f85a0071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.119+0000 7f8597e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85a006d270 0x7f85a0071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42496/0 (socket says 172.21.15.63:42496) 2024-03-26T06:18:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.119+0000 7f8597e00640 1 -- 172.21.15.63:0/2271221876 learned_addr learned my addr 172.21.15.63:0/2271221876 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.119+0000 7f859fe00640 1 --2- 172.21.15.63:0/2271221876 >> v2:172.21.15.204:3300/0 conn(0x7f85a013eca0 0x7f85a0071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.119+0000 7f8597e00640 1 -- 172.21.15.63:0/2271221876 >> v2:172.21.15.204:3300/0 conn(0x7f85a013eca0 msgr2=0x7f85a0071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.119+0000 7f8597e00640 1 --2- 172.21.15.63:0/2271221876 >> v2:172.21.15.204:3300/0 conn(0x7f85a013eca0 0x7f85a0071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.119+0000 7f8597e00640 1 -- 172.21.15.63:0/2271221876 >> v1:172.21.15.204:6789/0 conn(0x7f85a013e650 legacy=0x7f85a006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.119+0000 7f8597e00640 1 -- 172.21.15.63:0/2271221876 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a015fcb0 con 0x7f85a006d270 2024-03-26T06:18:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.119+0000 7f859fe00640 1 --2- 172.21.15.63:0/2271221876 >> v2:172.21.15.204:3300/0 conn(0x7f85a013eca0 0x7f85a0071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.121+0000 7f8597e00640 1 --2- 172.21.15.63:0/2271221876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a006d270 0x7f85a0071140 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8588009870 tx=0x7f858802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47dabfbb35596d5b server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.121+0000 7f859ea00640 1 -- 172.21.15.63:0/2271221876 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588035020 con 0x7f85a006d270 2024-03-26T06:18:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.121+0000 7f859ea00640 1 -- 172.21.15.63:0/2271221876 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858802d040 con 0x7f85a006d270 2024-03-26T06:18:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.121+0000 7f859ea00640 1 -- 172.21.15.63:0/2271221876 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588031a80 con 0x7f85a006d270 2024-03-26T06:18:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.121+0000 7f85a4a00640 1 -- 172.21.15.63:0/2271221876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a006d270 msgr2=0x7f85a0071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.121+0000 7f85a4a00640 1 --2- 172.21.15.63:0/2271221876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a006d270 0x7f85a0071140 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8588009870 tx=0x7f858802b900 comp rx=0 tx=0).stop 2024-03-26T06:18:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.122+0000 7f85a4a00640 1 -- 172.21.15.63:0/2271221876 shutdown_connections 2024-03-26T06:18:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.122+0000 7f85a4a00640 1 --2- 172.21.15.63:0/2271221876 >> v2:172.21.15.204:3300/0 conn(0x7f85a013eca0 0x7f85a0071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.122+0000 7f85a4a00640 1 --2- 172.21.15.63:0/2271221876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a006d270 0x7f85a0071140 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.122+0000 7f85a4a00640 1 -- 172.21.15.63:0/2271221876 >> 172.21.15.63:0/2271221876 conn(0x7f85a00670b0 msgr2=0x7f85a00b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.122+0000 7f85a4a00640 1 -- 172.21.15.63:0/2271221876 shutdown_connections 2024-03-26T06:18:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.122+0000 7f85a4a00640 1 -- 172.21.15.63:0/2271221876 wait complete. 2024-03-26T06:18:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.123+0000 7f85a4a00640 1 Processor -- start 2024-03-26T06:18:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.124+0000 7f85a4a00640 1 -- start start 2024-03-26T06:18:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.124+0000 7f85a4a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85a006d270 0x7f85a01f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.124+0000 7f85a4a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85a013e650 0x7f85a013ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.124+0000 7f85a4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a013eca0 0x7f85a01f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f85a4a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0140eb0 con 0x7f85a013eca0 2024-03-26T06:18:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f85a4a00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0140d30 con 0x7f85a006d270 2024-03-26T06:18:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f85a4a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0141030 con 0x7f85a013e650 2024-03-26T06:18:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f859fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a013eca0 0x7f85a01f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f859fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a013eca0 0x7f85a01f7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42504/0 (socket says 172.21.15.63:42504) 2024-03-26T06:18:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f859fe00640 1 -- 172.21.15.63:0/3941351006 learned_addr learned my addr 172.21.15.63:0/3941351006 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f859f400640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85a006d270 0x7f85a01f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f8597e00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85a013e650 0x7f85a013ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f859fe00640 1 -- 172.21.15.63:0/3941351006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85a013e650 msgr2=0x7f85a013ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f859fe00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85a013e650 0x7f85a013ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f859fe00640 1 -- 172.21.15.63:0/3941351006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85a006d270 msgr2=0x7f85a01f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f859fe00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85a006d270 0x7f85a01f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.125+0000 7f859fe00640 1 -- 172.21.15.63:0/3941351006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a01f70d0 con 0x7f85a013eca0 2024-03-26T06:18:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.126+0000 7f859fe00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a013eca0 0x7f85a01f7890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f859800cd50 tx=0x7f859800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.126+0000 7f8597400640 1 -- 172.21.15.63:0/3941351006 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800f680 con 0x7f85a013eca0 2024-03-26T06:18:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.126+0000 7f8597400640 1 -- 172.21.15.63:0/3941351006 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859800f840 con 0x7f85a013eca0 2024-03-26T06:18:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.126+0000 7f8597400640 1 -- 172.21.15.63:0/3941351006 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800fc30 con 0x7f85a013eca0 2024-03-26T06:18:28.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.126+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a01f4040 con 0x7f85a013eca0 2024-03-26T06:18:28.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.126+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a01f45f0 con 0x7f85a013eca0 2024-03-26T06:18:28.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.127+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a004f0c0 con 0x7f85a013eca0 2024-03-26T06:18:28.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.128+0000 7f8597400640 1 -- 172.21.15.63:0/3941351006 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f85980213f0 con 0x7f85a013eca0 2024-03-26T06:18:28.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.129+0000 7f8597400640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f857c06bc00 0x7f857c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.129+0000 7f8597400640 1 -- 172.21.15.63:0/3941351006 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f859808b6b0 con 0x7f85a013eca0 2024-03-26T06:18:28.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.129+0000 7f859f400640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f857c06bc00 0x7f857c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.130+0000 7f859f400640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f857c06bc00 0x7f857c06e0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8590007fd0 tx=0x7f8590009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:28.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.134+0000 7f8597400640 1 -- 172.21.15.63:0/3941351006 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8598014030 con 0x7f85a013eca0 2024-03-26T06:18:28.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.411+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f85a0071cc0 con 0x7f85a013eca0 2024-03-26T06:18:28.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.416+0000 7f8597400640 1 -- 172.21.15.63:0/3941351006 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8598059c70 con 0x7f85a013eca0 2024-03-26T06:18:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f857c06bc00 msgr2=0x7f857c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f857c06bc00 0x7f857c06e0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8590007fd0 tx=0x7f8590009040 comp rx=0 tx=0).stop 2024-03-26T06:18:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a013eca0 msgr2=0x7f85a01f7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a013eca0 0x7f85a01f7890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f859800cd50 tx=0x7f859800a650 comp rx=0 tx=0).stop 2024-03-26T06:18:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 shutdown_connections 2024-03-26T06:18:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f857c06bc00 0x7f857c06e0c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a013eca0 0x7f85a01f7890 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85a013e650 0x7f85a013ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 --2- 172.21.15.63:0/3941351006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85a006d270 0x7f85a01f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.418+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 >> 172.21.15.63:0/3941351006 conn(0x7f85a00670b0 msgr2=0x7f85a00af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:28.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.419+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 shutdown_connections 2024-03-26T06:18:28.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.419+0000 7f85a4a00640 1 -- 172.21.15.63:0/3941351006 wait complete. 2024-03-26T06:18:28.440 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-26T06:18:28.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.664+0000 7f0ccc400640 1 Processor -- start 2024-03-26T06:18:28.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.664+0000 7f0ccc400640 1 -- start start 2024-03-26T06:18:28.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.666+0000 7f0ccc400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0cc4157f90 0x7f0cc40acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.666+0000 7f0ccc400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0cc40ae570 0x7f0cc40ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.666+0000 7f0ccc400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc415efb0 con 0x7f0cc40b32e0 2024-03-26T06:18:28.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.666+0000 7f0ccc400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc415e3a0 con 0x7f0cc4157f90 2024-03-26T06:18:28.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.666+0000 7f0ccc400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc415e680 con 0x7f0cc40ae570 2024-03-26T06:18:28.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.666+0000 7f0cc9a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0cc4157f90 0x7f0cc40acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.666+0000 7f0cc9a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0cc4157f90 0x7f0cc40acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42516/0 (socket says 172.21.15.63:42516) 2024-03-26T06:18:28.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.666+0000 7f0cc9a00640 1 -- 172.21.15.63:0/886794049 learned_addr learned my addr 172.21.15.63:0/886794049 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:28.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.667+0000 7f0cc9000640 1 --2- 172.21.15.63:0/886794049 >> v2:172.21.15.204:3300/0 conn(0x7f0cc40ae570 0x7f0cc40ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.667+0000 7f0cc9a00640 1 -- 172.21.15.63:0/886794049 >> v2:172.21.15.204:3300/0 conn(0x7f0cc40ae570 msgr2=0x7f0cc40ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:28.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.667+0000 7f0cc9a00640 1 --2- 172.21.15.63:0/886794049 >> v2:172.21.15.204:3300/0 conn(0x7f0cc40ae570 0x7f0cc40ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.667+0000 7f0cc9a00640 1 -- 172.21.15.63:0/886794049 >> v1:172.21.15.204:6789/0 conn(0x7f0cc40b32e0 legacy=0x7f0cc4161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:28.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.667+0000 7f0cc9a00640 1 -- 172.21.15.63:0/886794049 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc415e960 con 0x7f0cc4157f90 2024-03-26T06:18:28.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.668+0000 7f0cc9a00640 1 --2- 172.21.15.63:0/886794049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4157f90 0x7f0cc40acc70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0cc406f800 tx=0x7f0cb802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97b60593ffa71d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:28.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.669+0000 7f0cc3e00640 1 -- 172.21.15.63:0/886794049 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8035020 con 0x7f0cc4157f90 2024-03-26T06:18:28.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.669+0000 7f0cc3e00640 1 -- 172.21.15.63:0/886794049 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb8031870 con 0x7f0cc4157f90 2024-03-26T06:18:28.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.669+0000 7f0cc3e00640 1 -- 172.21.15.63:0/886794049 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8031c40 con 0x7f0cc4157f90 2024-03-26T06:18:28.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.669+0000 7f0ccc400640 1 -- 172.21.15.63:0/886794049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4157f90 msgr2=0x7f0cc40acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.670+0000 7f0ccc400640 1 --2- 172.21.15.63:0/886794049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4157f90 0x7f0cc40acc70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0cc406f800 tx=0x7f0cb802b910 comp rx=0 tx=0).stop 2024-03-26T06:18:28.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.670+0000 7f0ccc400640 1 -- 172.21.15.63:0/886794049 shutdown_connections 2024-03-26T06:18:28.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.670+0000 7f0ccc400640 1 --2- 172.21.15.63:0/886794049 >> v2:172.21.15.204:3300/0 conn(0x7f0cc40ae570 0x7f0cc40ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.670+0000 7f0ccc400640 1 --2- 172.21.15.63:0/886794049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4157f90 0x7f0cc40acc70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.670+0000 7f0ccc400640 1 -- 172.21.15.63:0/886794049 >> 172.21.15.63:0/886794049 conn(0x7f0cc406ac90 msgr2=0x7f0cc406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:28.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.670+0000 7f0ccc400640 1 -- 172.21.15.63:0/886794049 shutdown_connections 2024-03-26T06:18:28.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.670+0000 7f0ccc400640 1 -- 172.21.15.63:0/886794049 wait complete. 2024-03-26T06:18:28.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.672+0000 7f0ccc400640 1 Processor -- start 2024-03-26T06:18:28.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.672+0000 7f0ccc400640 1 -- start start 2024-03-26T06:18:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0ccc400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc40ae570 0x7f0cc414eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0ccc400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cc40b32e0 0x7f0cc4154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0ccc400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cc4157f90 0x7f0cc41601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0ccc400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc415e050 con 0x7f0cc40ae570 2024-03-26T06:18:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0ccc400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40ad1b0 con 0x7f0cc40b32e0 2024-03-26T06:18:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0ccc400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4158370 con 0x7f0cc4157f90 2024-03-26T06:18:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0cc9a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc40ae570 0x7f0cc414eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0cc9a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc40ae570 0x7f0cc414eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42524/0 (socket says 172.21.15.63:42524) 2024-03-26T06:18:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0cc9a00640 1 -- 172.21.15.63:0/724252766 learned_addr learned my addr 172.21.15.63:0/724252766 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:28.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.673+0000 7f0cc9000640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cc40b32e0 0x7f0cc4154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cca400640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cc4157f90 0x7f0cc41601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cc9a00640 1 -- 172.21.15.63:0/724252766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cc4157f90 msgr2=0x7f0cc41601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cc9a00640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cc4157f90 0x7f0cc41601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cc9a00640 1 -- 172.21.15.63:0/724252766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cc40b32e0 msgr2=0x7f0cc4154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cc9a00640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cc40b32e0 0x7f0cc4154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cc9a00640 1 -- 172.21.15.63:0/724252766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4151d50 con 0x7f0cc40ae570 2024-03-26T06:18:28.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cc9a00640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc40ae570 0x7f0cc414eae0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0cb802b950 tx=0x7f0cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:28.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cc1600640 1 -- 172.21.15.63:0/724252766 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8040070 con 0x7f0cc40ae570 2024-03-26T06:18:28.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cc1600640 1 -- 172.21.15.63:0/724252766 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb8030d00 con 0x7f0cc40ae570 2024-03-26T06:18:28.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0cc1600640 1 -- 172.21.15.63:0/724252766 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8035040 con 0x7f0cc40ae570 2024-03-26T06:18:28.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.674+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc4152030 con 0x7f0cc40ae570 2024-03-26T06:18:28.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.675+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc414f9e0 con 0x7f0cc40ae570 2024-03-26T06:18:28.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.676+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc4074730 con 0x7f0cc40ae570 2024-03-26T06:18:28.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.677+0000 7f0cc1600640 1 -- 172.21.15.63:0/724252766 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0cb804b060 con 0x7f0cc40ae570 2024-03-26T06:18:28.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.677+0000 7f0cc1600640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0ca406bbd0 0x7f0ca406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:28.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.677+0000 7f0cc1600640 1 -- 172.21.15.63:0/724252766 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0cb80ac6b0 con 0x7f0cc40ae570 2024-03-26T06:18:28.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.678+0000 7f0cc9000640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0ca406bbd0 0x7f0ca406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:28.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.678+0000 7f0cc9000640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0ca406bbd0 0x7f0ca406e090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4156580 tx=0x7f0cb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:28.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.682+0000 7f0cc1600640 1 -- 172.21.15.63:0/724252766 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f0cb807b2c0 con 0x7f0cc40ae570 2024-03-26T06:18:28.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.956+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f0cc41624e0 con 0x7f0cc40ae570 2024-03-26T06:18:28.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.961+0000 7f0cc1600640 1 -- 172.21.15.63:0/724252766 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0cb807abc0 con 0x7f0cc40ae570 2024-03-26T06:18:28.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0ca406bbd0 msgr2=0x7f0ca406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0ca406bbd0 0x7f0ca406e090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4156580 tx=0x7f0cb0008040 comp rx=0 tx=0).stop 2024-03-26T06:18:28.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc40ae570 msgr2=0x7f0cc414eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:28.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc40ae570 0x7f0cc414eae0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0cb802b950 tx=0x7f0cb80046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 shutdown_connections 2024-03-26T06:18:28.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f0ca406bbd0 0x7f0ca406e090 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cc4157f90 0x7f0cc41601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cc40b32e0 0x7f0cc4154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 --2- 172.21.15.63:0/724252766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc40ae570 0x7f0cc414eae0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:28.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.963+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 >> 172.21.15.63:0/724252766 conn(0x7f0cc406ac90 msgr2=0x7f0cc406e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:28.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.964+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 shutdown_connections 2024-03-26T06:18:28.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:28.964+0000 7f0ccc400640 1 -- 172.21.15.63:0/724252766 wait complete. 2024-03-26T06:18:28.983 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-26T06:18:29.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.200+0000 7f4e0fe00640 1 Processor -- start 2024-03-26T06:18:29.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.200+0000 7f4e0fe00640 1 -- start start 2024-03-26T06:18:29.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0fe00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4e10143b00 0x7f4e100ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0fe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4e10072b20 0x7f4e100ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0fe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 0x7f4e1015e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0fe00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e100cf050 con 0x7f4e10072b20 2024-03-26T06:18:29.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0fe00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e100b2770 con 0x7f4e10143b00 2024-03-26T06:18:29.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0fe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100b2a50 con 0x7f4e10143fd0 2024-03-26T06:18:29.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0e000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4e10072b20 0x7f4e100ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0e000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4e10072b20 0x7f4e100ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42530/0 (socket says 172.21.15.63:42530) 2024-03-26T06:18:29.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0e000640 1 -- 172.21.15.63:0/1105932936 learned_addr learned my addr 172.21.15.63:0/1105932936 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:29.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.202+0000 7f4e0ea00640 1 --2- 172.21.15.63:0/1105932936 >> v2:172.21.15.204:3300/0 conn(0x7f4e10143b00 0x7f4e100ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.203+0000 7f4e0f400640 1 --2- 172.21.15.63:0/1105932936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 0x7f4e1015e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.203+0000 7f4e0e000640 1 -- 172.21.15.63:0/1105932936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 msgr2=0x7f4e1015e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.203+0000 7f4e0e000640 1 --2- 172.21.15.63:0/1105932936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 0x7f4e1015e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.203+0000 7f4e0e000640 1 -- 172.21.15.63:0/1105932936 >> v2:172.21.15.204:3300/0 conn(0x7f4e10143b00 msgr2=0x7f4e100ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.203+0000 7f4e0e000640 1 --2- 172.21.15.63:0/1105932936 >> v2:172.21.15.204:3300/0 conn(0x7f4e10143b00 0x7f4e100ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.203+0000 7f4e0e000640 1 -- 172.21.15.63:0/1105932936 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100b2d30 con 0x7f4e10072b20 2024-03-26T06:18:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.203+0000 7f4e0f400640 1 --2- 172.21.15.63:0/1105932936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 0x7f4e1015e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:29.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.204+0000 7f4e0e000640 1 --2- 172.21.15.63:0/1105932936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10072b20 0x7f4e100ceb10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b2410 tx=0x7f4dfc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e0cad6f2c96acc server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:29.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.204+0000 7f4e0d600640 1 -- 172.21.15.63:0/1105932936 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc035020 con 0x7f4e10072b20 2024-03-26T06:18:29.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.204+0000 7f4e0d600640 1 -- 172.21.15.63:0/1105932936 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc031870 con 0x7f4e10072b20 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.204+0000 7f4e0d600640 1 -- 172.21.15.63:0/1105932936 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc031c40 con 0x7f4e10072b20 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.205+0000 7f4e0fe00640 1 -- 172.21.15.63:0/1105932936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10072b20 msgr2=0x7f4e100ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.205+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/1105932936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10072b20 0x7f4e100ceb10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b2410 tx=0x7f4dfc02b910 comp rx=0 tx=0).stop 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.205+0000 7f4e0fe00640 1 -- 172.21.15.63:0/1105932936 shutdown_connections 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.205+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/1105932936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 0x7f4e1015e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.205+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/1105932936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10072b20 0x7f4e100ceb10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.205+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/1105932936 >> v2:172.21.15.204:3300/0 conn(0x7f4e10143b00 0x7f4e100ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.205+0000 7f4e0fe00640 1 -- 172.21.15.63:0/1105932936 >> 172.21.15.63:0/1105932936 conn(0x7f4e100b13d0 msgr2=0x7f4e100b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.205+0000 7f4e0fe00640 1 -- 172.21.15.63:0/1105932936 shutdown_connections 2024-03-26T06:18:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.205+0000 7f4e0fe00640 1 -- 172.21.15.63:0/1105932936 wait complete. 2024-03-26T06:18:29.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.207+0000 7f4e0fe00640 1 Processor -- start 2024-03-26T06:18:29.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.207+0000 7f4e0fe00640 1 -- start start 2024-03-26T06:18:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0fe00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e10072b20 0x7f4e100cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10143b00 0x7f4e1013c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0fe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 0x7f4e1013de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0fe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100cd070 con 0x7f4e10143b00 2024-03-26T06:18:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0fe00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100ccd40 con 0x7f4e10072b20 2024-03-26T06:18:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0fe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1015e780 con 0x7f4e10143fd0 2024-03-26T06:18:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0e000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10143b00 0x7f4e1013c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0e000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10143b00 0x7f4e1013c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42534/0 (socket says 172.21.15.63:42534) 2024-03-26T06:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0e000640 1 -- 172.21.15.63:0/2281988467 learned_addr learned my addr 172.21.15.63:0/2281988467 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0ea00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e10072b20 0x7f4e100cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0e000640 1 -- 172.21.15.63:0/2281988467 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 msgr2=0x7f4e1013de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0e000640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 0x7f4e1013de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0e000640 1 -- 172.21.15.63:0/2281988467 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e10072b20 msgr2=0x7f4e100cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0e000640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e10072b20 0x7f4e100cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0e000640 1 -- 172.21.15.63:0/2281988467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100ca070 con 0x7f4e10143b00 2024-03-26T06:18:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.208+0000 7f4e0ea00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e10072b20 0x7f4e100cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.209+0000 7f4e0e000640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10143b00 0x7f4e1013c600 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc02b950 tx=0x7f4dfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.209+0000 7f4e06a00640 1 -- 172.21.15.63:0/2281988467 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc040070 con 0x7f4e10143b00 2024-03-26T06:18:29.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.209+0000 7f4e06a00640 1 -- 172.21.15.63:0/2281988467 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc030d00 con 0x7f4e10143b00 2024-03-26T06:18:29.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.209+0000 7f4e06a00640 1 -- 172.21.15.63:0/2281988467 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc035040 con 0x7f4e10143b00 2024-03-26T06:18:29.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.209+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e100ca350 con 0x7f4e10143b00 2024-03-26T06:18:29.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.210+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e100ca910 con 0x7f4e10143b00 2024-03-26T06:18:29.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.211+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e100cee70 con 0x7f4e10143b00 2024-03-26T06:18:29.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.211+0000 7f4e06a00640 1 -- 172.21.15.63:0/2281988467 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4dfc04b060 con 0x7f4e10143b00 2024-03-26T06:18:29.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.212+0000 7f4e06a00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4df006bc00 0x7f4df006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.212+0000 7f4e06a00640 1 -- 172.21.15.63:0/2281988467 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f4dfc0ac670 con 0x7f4e10143b00 2024-03-26T06:18:29.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.213+0000 7f4e0ea00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4df006bc00 0x7f4df006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.213+0000 7f4e0ea00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4df006bc00 0x7f4df006e0c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4e00006fd0 tx=0x7f4e00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:29.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.217+0000 7f4e06a00640 1 -- 172.21.15.63:0/2281988467 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f4e100cee70 con 0x7f4e10143b00 2024-03-26T06:18:29.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.491+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4e10071310 con 0x7f4e10143b00 2024-03-26T06:18:29.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.495+0000 7f4e06a00640 1 -- 172.21.15.63:0/2281988467 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4e10071310 con 0x7f4e10143b00 2024-03-26T06:18:29.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.497+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4df006bc00 msgr2=0x7f4df006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:29.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.497+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4df006bc00 0x7f4df006e0c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4e00006fd0 tx=0x7f4e00008040 comp rx=0 tx=0).stop 2024-03-26T06:18:29.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.497+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10143b00 msgr2=0x7f4e1013c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:29.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.497+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10143b00 0x7f4e1013c600 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc02b950 tx=0x7f4dfc0046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.497+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 shutdown_connections 2024-03-26T06:18:29.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.497+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f4df006bc00 0x7f4df006e0c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.497+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e10143fd0 0x7f4e1013de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.497+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e10143b00 0x7f4e1013c600 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.497+0000 7f4e0fe00640 1 --2- 172.21.15.63:0/2281988467 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e10072b20 0x7f4e100cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.498+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 >> 172.21.15.63:0/2281988467 conn(0x7f4e100b13d0 msgr2=0x7f4e100b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:29.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.498+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 shutdown_connections 2024-03-26T06:18:29.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.498+0000 7f4e0fe00640 1 -- 172.21.15.63:0/2281988467 wait complete. 2024-03-26T06:18:29.518 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-26T06:18:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.739+0000 7fa667400640 1 Processor -- start 2024-03-26T06:18:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.739+0000 7fa667400640 1 -- start start 2024-03-26T06:18:29.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.740+0000 7fa667400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa6600cfd60 0x7fa6600b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.740+0000 7fa667400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 0x7fa6600ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.740+0000 7fa667400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6600d0140 con 0x7fa660144c70 2024-03-26T06:18:29.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.740+0000 7fa667400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6600b4b10 con 0x7fa6600cfd60 2024-03-26T06:18:29.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.740+0000 7fa667400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600b3530 con 0x7fa660071a00 2024-03-26T06:18:29.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.741+0000 7fa664a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa6600cfd60 0x7fa6600b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.741+0000 7fa665400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 0x7fa6600ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.741+0000 7fa664a00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa6600cfd60 0x7fa6600b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:50688/0 (socket says 172.21.15.63:50688) 2024-03-26T06:18:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.741+0000 7fa664a00640 1 -- 172.21.15.63:0/217935990 learned_addr learned my addr 172.21.15.63:0/217935990 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.742+0000 7fa664a00640 1 -- 172.21.15.63:0/217935990 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 msgr2=0x7fa6600ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.742+0000 7fa664a00640 1 --2- 172.21.15.63:0/217935990 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 0x7fa6600ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.742+0000 7fa664a00640 1 -- 172.21.15.63:0/217935990 >> v1:172.21.15.204:6789/0 conn(0x7fa660144c70 legacy=0x7fa6600712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.742+0000 7fa664a00640 1 -- 172.21.15.63:0/217935990 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600b3810 con 0x7fa6600cfd60 2024-03-26T06:18:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.743+0000 7fa664a00640 1 --2- 172.21.15.63:0/217935990 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6600cfd60 0x7fa6600b45d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa650009870 tx=0x7fa65002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22086658a2cd854a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:29.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.744+0000 7fa65f400640 1 -- 172.21.15.63:0/217935990 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650034070 con 0x7fa6600cfd60 2024-03-26T06:18:29.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.744+0000 7fa65f400640 1 -- 172.21.15.63:0/217935990 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650030840 con 0x7fa6600cfd60 2024-03-26T06:18:29.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.744+0000 7fa65f400640 1 -- 172.21.15.63:0/217935990 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650030c10 con 0x7fa6600cfd60 2024-03-26T06:18:29.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.744+0000 7fa667400640 1 -- 172.21.15.63:0/217935990 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6600cfd60 msgr2=0x7fa6600b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:29.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.744+0000 7fa667400640 1 --2- 172.21.15.63:0/217935990 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6600cfd60 0x7fa6600b45d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa650009870 tx=0x7fa65002b980 comp rx=0 tx=0).stop 2024-03-26T06:18:29.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.745+0000 7fa667400640 1 -- 172.21.15.63:0/217935990 shutdown_connections 2024-03-26T06:18:29.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.745+0000 7fa667400640 1 --2- 172.21.15.63:0/217935990 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 0x7fa6600ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.745+0000 7fa667400640 1 --2- 172.21.15.63:0/217935990 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6600cfd60 0x7fa6600b45d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.745+0000 7fa667400640 1 -- 172.21.15.63:0/217935990 >> 172.21.15.63:0/217935990 conn(0x7fa66006ac90 msgr2=0x7fa66006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:29.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.745+0000 7fa667400640 1 -- 172.21.15.63:0/217935990 shutdown_connections 2024-03-26T06:18:29.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.745+0000 7fa667400640 1 -- 172.21.15.63:0/217935990 wait complete. 2024-03-26T06:18:29.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.747+0000 7fa667400640 1 Processor -- start 2024-03-26T06:18:29.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.747+0000 7fa667400640 1 -- start start 2024-03-26T06:18:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.748+0000 7fa667400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 0x7fa660131f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa667400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6600cfd60 0x7fa6600a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa667400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa660144c70 0x7fa6600ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa667400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600b40b0 con 0x7fa6600cfd60 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa667400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600b3dd0 con 0x7fa660144c70 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa667400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600b31c0 con 0x7fa660071a00 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa65fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6600cfd60 0x7fa6600a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa65fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6600cfd60 0x7fa6600a8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42542/0 (socket says 172.21.15.63:42542) 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa65fe00640 1 -- 172.21.15.63:0/828478399 learned_addr learned my addr 172.21.15.63:0/828478399 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa664a00640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 0x7fa660131f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa665400640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa660144c70 0x7fa6600ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa65fe00640 1 -- 172.21.15.63:0/828478399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 msgr2=0x7fa660131f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa65fe00640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 0x7fa660131f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa65fe00640 1 -- 172.21.15.63:0/828478399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa660144c70 msgr2=0x7fa6600ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa65fe00640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa660144c70 0x7fa6600ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.749+0000 7fa65fe00640 1 -- 172.21.15.63:0/828478399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66012ec70 con 0x7fa6600cfd60 2024-03-26T06:18:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.750+0000 7fa65fe00640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6600cfd60 0x7fa6600a8900 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c3c0 tx=0x7fa64800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.750+0000 7fa65cc00640 1 -- 172.21.15.63:0/828478399 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6480052d0 con 0x7fa6600cfd60 2024-03-26T06:18:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.750+0000 7fa65cc00640 1 -- 172.21.15.63:0/828478399 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa648005490 con 0x7fa6600cfd60 2024-03-26T06:18:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.750+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66012ef50 con 0x7fa6600cfd60 2024-03-26T06:18:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.750+0000 7fa65cc00640 1 -- 172.21.15.63:0/828478399 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648007260 con 0x7fa6600cfd60 2024-03-26T06:18:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.750+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66012f510 con 0x7fa6600cfd60 2024-03-26T06:18:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.751+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa660074730 con 0x7fa6600cfd60 2024-03-26T06:18:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.752+0000 7fa65cc00640 1 -- 172.21.15.63:0/828478399 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa648007400 con 0x7fa6600cfd60 2024-03-26T06:18:29.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.753+0000 7fa65cc00640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa63c06bbd0 0x7fa63c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:29.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.753+0000 7fa65cc00640 1 -- 172.21.15.63:0/828478399 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa648089ec0 con 0x7fa6600cfd60 2024-03-26T06:18:29.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.753+0000 7fa664a00640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa63c06bbd0 0x7fa63c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:29.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.754+0000 7fa664a00640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa63c06bbd0 0x7fa63c06e090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa650036000 tx=0x7fa65003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:29.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:29.757+0000 7fa65cc00640 1 -- 172.21.15.63:0/828478399 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa648058a40 con 0x7fa6600cfd60 2024-03-26T06:18:30.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.018+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fa660142790 con 0x7fa6600cfd60 2024-03-26T06:18:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.023+0000 7fa65cc00640 1 -- 172.21.15.63:0/828478399 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v13) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa648058340 con 0x7fa6600cfd60 2024-03-26T06:18:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.025+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa63c06bbd0 msgr2=0x7fa63c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.025+0000 7fa667400640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa63c06bbd0 0x7fa63c06e090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa650036000 tx=0x7fa65003b040 comp rx=0 tx=0).stop 2024-03-26T06:18:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.025+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6600cfd60 msgr2=0x7fa6600a8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.025+0000 7fa667400640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6600cfd60 0x7fa6600a8900 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c3c0 tx=0x7fa64800c880 comp rx=0 tx=0).stop 2024-03-26T06:18:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.026+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 shutdown_connections 2024-03-26T06:18:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.026+0000 7fa667400640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa63c06bbd0 0x7fa63c06e090 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.026+0000 7fa667400640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa660144c70 0x7fa6600ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.026+0000 7fa667400640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6600cfd60 0x7fa6600a8900 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.026+0000 7fa667400640 1 --2- 172.21.15.63:0/828478399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa660071a00 0x7fa660131f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.026+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 >> 172.21.15.63:0/828478399 conn(0x7fa66006ac90 msgr2=0x7fa6600712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:30.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.026+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 shutdown_connections 2024-03-26T06:18:30.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.026+0000 7fa667400640 1 -- 172.21.15.63:0/828478399 wait complete. 2024-03-26T06:18:30.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:30.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.256+0000 7fc4dbe00640 1 Processor -- start 2024-03-26T06:18:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.256+0000 7fc4dbe00640 1 -- start start 2024-03-26T06:18:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.258+0000 7fc4dbe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc0b4c50 0x7fc4dc0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.258+0000 7fc4dbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc4dc144b50 0x7fc4dc144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.258+0000 7fc4dbe00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4dc0cc070 con 0x7fc4dc0b5030 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.258+0000 7fc4dbe00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc15fde0 con 0x7fc4dc144b50 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.258+0000 7fc4dbe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc1600c0 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.258+0000 7fc4db400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc4dc144b50 0x7fc4dc144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4da000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc4dc0b5030 0x7fc4dc15f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43662/0 (socket says 172.21.15.63:43662) 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4db400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc4dc144b50 0x7fc4dc144fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42558/0 (socket says 172.21.15.63:42558) 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4da000640 1 -- 172.21.15.63:0/1034572339 learned_addr learned my addr 172.21.15.63:0/1034572339 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4daa00640 1 --2- 172.21.15.63:0/1034572339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc0b4c50 0x7fc4dc0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4db400640 1 -- 172.21.15.63:0/1034572339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc0b4c50 msgr2=0x7fc4dc0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4db400640 1 --2- 172.21.15.63:0/1034572339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc0b4c50 0x7fc4dc0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4db400640 1 -- 172.21.15.63:0/1034572339 >> v1:172.21.15.63:6789/0 conn(0x7fc4dc0b5030 legacy=0x7fc4dc15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4db400640 1 -- 172.21.15.63:0/1034572339 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc0cc310 con 0x7fc4dc144b50 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4d9600640 1 -- 172.21.15.63:0/1034572339 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526672627 0 0) 0x7fc4dc0cc070 con 0x7fc4dc0b5030 2024-03-26T06:18:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.259+0000 7fc4daa00640 1 --2- 172.21.15.63:0/1034572339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc0b4c50 0x7fc4dc0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.260+0000 7fc4db400640 1 --2- 172.21.15.63:0/1034572339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc144b50 0x7fc4dc144fe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009d90 tx=0x7fc4d402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b5b3bbb781eee6 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.260+0000 7fc4d9600640 1 -- 172.21.15.63:0/1034572339 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4039070 con 0x7fc4dc144b50 2024-03-26T06:18:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.260+0000 7fc4d9600640 1 -- 172.21.15.63:0/1034572339 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d402cce0 con 0x7fc4dc144b50 2024-03-26T06:18:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.260+0000 7fc4d9600640 1 -- 172.21.15.63:0/1034572339 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4034660 con 0x7fc4dc144b50 2024-03-26T06:18:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.261+0000 7fc4dbe00640 1 -- 172.21.15.63:0/1034572339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc144b50 msgr2=0x7fc4dc144fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.261+0000 7fc4dbe00640 1 --2- 172.21.15.63:0/1034572339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc144b50 0x7fc4dc144fe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009d90 tx=0x7fc4d402bf30 comp rx=0 tx=0).stop 2024-03-26T06:18:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.261+0000 7fc4dbe00640 1 -- 172.21.15.63:0/1034572339 shutdown_connections 2024-03-26T06:18:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.261+0000 7fc4dbe00640 1 --2- 172.21.15.63:0/1034572339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc144b50 0x7fc4dc144fe0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.261+0000 7fc4dbe00640 1 --2- 172.21.15.63:0/1034572339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc0b4c50 0x7fc4dc0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.261+0000 7fc4dbe00640 1 -- 172.21.15.63:0/1034572339 >> 172.21.15.63:0/1034572339 conn(0x7fc4dc0b13d0 msgr2=0x7fc4dc0b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:30.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.261+0000 7fc4dbe00640 1 -- 172.21.15.63:0/1034572339 shutdown_connections 2024-03-26T06:18:30.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.261+0000 7fc4dbe00640 1 -- 172.21.15.63:0/1034572339 wait complete. 2024-03-26T06:18:30.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.263+0000 7fc4dbe00640 1 Processor -- start 2024-03-26T06:18:30.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.263+0000 7fc4dbe00640 1 -- start start 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.264+0000 7fc4dbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc0b4c50 0x7fc4dc0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.264+0000 7fc4dbe00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4dc0b5030 0x7fc4dc1f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.264+0000 7fc4dbe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc144b50 0x7fc4dc1f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.264+0000 7fc4dbe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc15fa50 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.264+0000 7fc4dbe00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc06eb70 con 0x7fc4dc0b5030 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.264+0000 7fc4dbe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc06d280 con 0x7fc4dc144b50 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.264+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc0b4c50 0x7fc4dc0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.264+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc0b4c50 0x7fc4dc0c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42570/0 (socket says 172.21.15.63:42570) 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.264+0000 7fc4daa00640 1 -- 172.21.15.63:0/3206912267 learned_addr learned my addr 172.21.15.63:0/3206912267 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4daa00640 1 -- 172.21.15.63:0/3206912267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc144b50 msgr2=0x7fc4dc1f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4daa00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc144b50 0x7fc4dc1f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4daa00640 1 -- 172.21.15.63:0/3206912267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4dc0b5030 msgr2=0x7fc4dc1f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4da000640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4dc0b5030 0x7fc4dc1f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4daa00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4dc0b5030 0x7fc4dc1f3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4daa00640 1 -- 172.21.15.63:0/3206912267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc1f7120 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4da000640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4dc0b5030 0x7fc4dc1f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4daa00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc0b4c50 0x7fc4dc0c9250 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00c7f0 tx=0x7fc4cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4d2a00640 1 -- 172.21.15.63:0/3206912267 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc015070 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4d2a00640 1 -- 172.21.15.63:0/3206912267 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc007a30 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4d2a00640 1 -- 172.21.15.63:0/3206912267 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc007e00 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc1f7400 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.265+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc1f3640 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.267+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4dc1f3840 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.268+0000 7fc4d2a00640 1 -- 172.21.15.63:0/3206912267 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc4cc018070 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.268+0000 7fc4d2a00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4bc06bbd0 0x7fc4bc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.269+0000 7fc4d2a00640 1 -- 172.21.15.63:0/3206912267 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc4cc08a870 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.269+0000 7fc4da000640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4bc06bbd0 0x7fc4bc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.269+0000 7fc4da000640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4bc06bbd0 0x7fc4bc06e090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0c8620 tx=0x7fc4c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.273+0000 7fc4d2a00640 1 -- 172.21.15.63:0/3206912267 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc4dc1f3840 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.475+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4dc04f050 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.476+0000 7fc4d2a00640 1 -- 172.21.15.63:0/3206912267 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13176 (secure 0 0 0) 0x7fc4cc059510 con 0x7fc4dc0b4c50 2024-03-26T06:18:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:30.478 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":35,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:18:26.272698+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:30.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4bc06bbd0 msgr2=0x7fc4bc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4bc06bbd0 0x7fc4bc06e090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0c8620 tx=0x7fc4c8009040 comp rx=0 tx=0).stop 2024-03-26T06:18:30.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc0b4c50 msgr2=0x7fc4dc0c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc0b4c50 0x7fc4dc0c9250 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00c7f0 tx=0x7fc4cc00cbf0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 shutdown_connections 2024-03-26T06:18:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4bc06bbd0 0x7fc4bc06e090 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4dc144b50 0x7fc4dc1f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4dc0b5030 0x7fc4dc1f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 --2- 172.21.15.63:0/3206912267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4dc0b4c50 0x7fc4dc0c9250 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.479+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 >> 172.21.15.63:0/3206912267 conn(0x7fc4dc0b13d0 msgr2=0x7fc4dc144090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.480+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 shutdown_connections 2024-03-26T06:18:30.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.480+0000 7fc4dbe00640 1 -- 172.21.15.63:0/3206912267 wait complete. 2024-03-26T06:18:30.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-26T06:18:30.502 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T06:18:30.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.728+0000 7f962fe00640 1 Processor -- start 2024-03-26T06:18:30.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.728+0000 7f962fe00640 1 -- start start 2024-03-26T06:18:30.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.729+0000 7f962fe00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f963013e650 0x7f963006daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.729+0000 7f962fe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9630071850 0x7f9630140d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.729+0000 7f962fe00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963015f410 con 0x7f963006d270 2024-03-26T06:18:30.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.729+0000 7f962fe00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963015f6f0 con 0x7f9630071850 2024-03-26T06:18:30.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.729+0000 7f962fe00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963015f9d0 con 0x7f963013e650 2024-03-26T06:18:30.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.730+0000 7f962f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9630071850 0x7f9630140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.730+0000 7f962f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9630071850 0x7f9630140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42586/0 (socket says 172.21.15.63:42586) 2024-03-26T06:18:30.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.730+0000 7f962f400640 1 -- 172.21.15.63:0/453553260 learned_addr learned my addr 172.21.15.63:0/453553260 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:30.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.730+0000 7f962ea00640 1 --2- 172.21.15.63:0/453553260 >> v2:172.21.15.204:3300/0 conn(0x7f963013e650 0x7f963006daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.730+0000 7f962f400640 1 -- 172.21.15.63:0/453553260 >> v2:172.21.15.204:3300/0 conn(0x7f963013e650 msgr2=0x7f963006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.730+0000 7f962f400640 1 --2- 172.21.15.63:0/453553260 >> v2:172.21.15.204:3300/0 conn(0x7f963013e650 0x7f963006daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.730+0000 7f962f400640 1 -- 172.21.15.63:0/453553260 >> v1:172.21.15.204:6789/0 conn(0x7f963006d270 legacy=0x7f9630071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.730+0000 7f962f400640 1 -- 172.21.15.63:0/453553260 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963015fcb0 con 0x7f9630071850 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.731+0000 7f962f400640 1 --2- 172.21.15.63:0/453553260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9630071850 0x7f9630140d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9628009e50 tx=0x7f962802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4e47f1a7721214 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.732+0000 7f962d600640 1 -- 172.21.15.63:0/453553260 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962802ca80 con 0x7f9630071850 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.732+0000 7f962d600640 1 -- 172.21.15.63:0/453553260 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962802cc20 con 0x7f9630071850 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.732+0000 7f962d600640 1 -- 172.21.15.63:0/453553260 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280343f0 con 0x7f9630071850 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.732+0000 7f962fe00640 1 -- 172.21.15.63:0/453553260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9630071850 msgr2=0x7f9630140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.732+0000 7f962fe00640 1 --2- 172.21.15.63:0/453553260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9630071850 0x7f9630140d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9628009e50 tx=0x7f962802bee0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.732+0000 7f962fe00640 1 -- 172.21.15.63:0/453553260 shutdown_connections 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.732+0000 7f962fe00640 1 --2- 172.21.15.63:0/453553260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9630071850 0x7f9630140d30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.732+0000 7f962fe00640 1 --2- 172.21.15.63:0/453553260 >> v2:172.21.15.204:3300/0 conn(0x7f963013e650 0x7f963006daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.732+0000 7f962fe00640 1 -- 172.21.15.63:0/453553260 >> 172.21.15.63:0/453553260 conn(0x7f96300670b0 msgr2=0x7f96300b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:30.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.733+0000 7f962fe00640 1 -- 172.21.15.63:0/453553260 shutdown_connections 2024-03-26T06:18:30.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.733+0000 7f962fe00640 1 -- 172.21.15.63:0/453553260 wait complete. 2024-03-26T06:18:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.734+0000 7f962fe00640 1 Processor -- start 2024-03-26T06:18:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.734+0000 7f962fe00640 1 -- start start 2024-03-26T06:18:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.735+0000 7f962fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f963006d270 0x7f96300b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.735+0000 7f962fe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9630071850 0x7f9630140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.735+0000 7f962fe00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f963013e650 0x7f9630141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.735+0000 7f962fe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963013eca0 con 0x7f963006d270 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.735+0000 7f962fe00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963006e030 con 0x7f963013e650 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.735+0000 7f962fe00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963013ee20 con 0x7f9630071850 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f963006d270 0x7f96300b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f963006d270 0x7f96300b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42594/0 (socket says 172.21.15.63:42594) 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962ea00640 1 -- 172.21.15.63:0/1286030154 learned_addr learned my addr 172.21.15.63:0/1286030154 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962e000640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9630071850 0x7f9630140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962ea00640 1 -- 172.21.15.63:0/1286030154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9630071850 msgr2=0x7f9630140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962ea00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9630071850 0x7f9630140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962f400640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f963013e650 0x7f9630141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962ea00640 1 -- 172.21.15.63:0/1286030154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f963013e650 msgr2=0x7f9630141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962ea00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f963013e650 0x7f9630141150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962ea00640 1 -- 172.21.15.63:0/1286030154 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96300b31b0 con 0x7f963006d270 2024-03-26T06:18:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.736+0000 7f962ea00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f963006d270 0x7f96300b3e20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f962000c7f0 tx=0x7f962000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.737+0000 7f9626a00640 1 -- 172.21.15.63:0/1286030154 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620015070 con 0x7f963006d270 2024-03-26T06:18:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.737+0000 7f9626a00640 1 -- 172.21.15.63:0/1286030154 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620004220 con 0x7f963006d270 2024-03-26T06:18:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.737+0000 7f9626a00640 1 -- 172.21.15.63:0/1286030154 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620007620 con 0x7f963006d270 2024-03-26T06:18:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.737+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96301462b0 con 0x7f963006d270 2024-03-26T06:18:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.737+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9630146870 con 0x7f963006d270 2024-03-26T06:18:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.738+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96301460b0 con 0x7f963006d270 2024-03-26T06:18:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.739+0000 7f9626a00640 1 -- 172.21.15.63:0/1286030154 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f96200079d0 con 0x7f963006d270 2024-03-26T06:18:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.740+0000 7f9626a00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f961006bbd0 0x7f961006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.740+0000 7f9626a00640 1 -- 172.21.15.63:0/1286030154 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f962008ac60 con 0x7f963006d270 2024-03-26T06:18:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.740+0000 7f962e000640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f961006bbd0 0x7f961006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.741+0000 7f962e000640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f961006bbd0 0x7f961006e090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96301f67e0 tx=0x7f961c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:30.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.744+0000 7f9626a00640 1 -- 172.21.15.63:0/1286030154 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f9620059900 con 0x7f963006d270 2024-03-26T06:18:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.944+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f963004f0c0 con 0x7f963006d270 2024-03-26T06:18:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.945+0000 7f9626a00640 1 -- 172.21.15.63:0/1286030154 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9620059200 con 0x7f963006d270 2024-03-26T06:18:30.946 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T06:18:30.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.947+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f961006bbd0 msgr2=0x7f961006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.947+0000 7f962fe00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f961006bbd0 0x7f961006e090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96301f67e0 tx=0x7f961c009040 comp rx=0 tx=0).stop 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.947+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f963006d270 msgr2=0x7f96300b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.947+0000 7f962fe00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f963006d270 0x7f96300b3e20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f962000c7f0 tx=0x7f962000ccb0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.948+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 shutdown_connections 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.948+0000 7f962fe00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f961006bbd0 0x7f961006e090 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.948+0000 7f962fe00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f963013e650 0x7f9630141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.948+0000 7f962fe00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9630071850 0x7f9630140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.948+0000 7f962fe00640 1 --2- 172.21.15.63:0/1286030154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f963006d270 0x7f96300b3e20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.948+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 >> 172.21.15.63:0/1286030154 conn(0x7f96300670b0 msgr2=0x7f96300b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.948+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 shutdown_connections 2024-03-26T06:18:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:30.948+0000 7f962fe00640 1 -- 172.21.15.63:0/1286030154 wait complete. 2024-03-26T06:18:30.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-26T06:18:31.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.190+0000 7fbfed400640 1 Processor -- start 2024-03-26T06:18:31.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.190+0000 7fbfed400640 1 -- start start 2024-03-26T06:18:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.191+0000 7fbfed400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbfe8145100 0x7fbfe806ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.191+0000 7fbfed400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbfe806ef70 0x7fbfe8071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.191+0000 7fbfed400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe8071c90 con 0x7fbfe8071890 2024-03-26T06:18:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.191+0000 7fbfed400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe80a86e0 con 0x7fbfe8145100 2024-03-26T06:18:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.191+0000 7fbfed400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe815bf80 con 0x7fbfe806ef70 2024-03-26T06:18:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.192+0000 7fbfe6800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbfe8145100 0x7fbfe806ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.192+0000 7fbfe6800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbfe8145100 0x7fbfe806ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39468/0 (socket says 172.21.15.63:39468) 2024-03-26T06:18:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.192+0000 7fbfe6800640 1 -- 172.21.15.63:0/680121710 learned_addr learned my addr 172.21.15.63:0/680121710 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.192+0000 7fbfe5e00640 1 --2- 172.21.15.63:0/680121710 >> v2:172.21.15.204:3300/0 conn(0x7fbfe806ef70 0x7fbfe8071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.192+0000 7fbfe6800640 1 -- 172.21.15.63:0/680121710 >> v2:172.21.15.204:3300/0 conn(0x7fbfe806ef70 msgr2=0x7fbfe8071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.192+0000 7fbfe6800640 1 --2- 172.21.15.63:0/680121710 >> v2:172.21.15.204:3300/0 conn(0x7fbfe806ef70 0x7fbfe8071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.192+0000 7fbfe6800640 1 -- 172.21.15.63:0/680121710 >> v1:172.21.15.204:6789/0 conn(0x7fbfe8071890 legacy=0x7fbfe815f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.193+0000 7fbfe6800640 1 -- 172.21.15.63:0/680121710 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe806e2f0 con 0x7fbfe8145100 2024-03-26T06:18:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.193+0000 7fbfe5e00640 1 --2- 172.21.15.63:0/680121710 >> v2:172.21.15.204:3300/0 conn(0x7fbfe806ef70 0x7fbfe8071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.194+0000 7fbfe6800640 1 --2- 172.21.15.63:0/680121710 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe8145100 0x7fbfe806ea30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80af3b0 tx=0x7fbfd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53cb01771aabafb server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.194+0000 7fbfe5400640 1 -- 172.21.15.63:0/680121710 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8035020 con 0x7fbfe8145100 2024-03-26T06:18:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.194+0000 7fbfe5400640 1 -- 172.21.15.63:0/680121710 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8031870 con 0x7fbfe8145100 2024-03-26T06:18:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.194+0000 7fbfe5400640 1 -- 172.21.15.63:0/680121710 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8031c40 con 0x7fbfe8145100 2024-03-26T06:18:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.195+0000 7fbfed400640 1 -- 172.21.15.63:0/680121710 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe8145100 msgr2=0x7fbfe806ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.195+0000 7fbfed400640 1 --2- 172.21.15.63:0/680121710 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe8145100 0x7fbfe806ea30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80af3b0 tx=0x7fbfd802b910 comp rx=0 tx=0).stop 2024-03-26T06:18:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.195+0000 7fbfed400640 1 -- 172.21.15.63:0/680121710 shutdown_connections 2024-03-26T06:18:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.195+0000 7fbfed400640 1 --2- 172.21.15.63:0/680121710 >> v2:172.21.15.204:3300/0 conn(0x7fbfe806ef70 0x7fbfe8071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.195+0000 7fbfed400640 1 --2- 172.21.15.63:0/680121710 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe8145100 0x7fbfe806ea30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.195+0000 7fbfed400640 1 -- 172.21.15.63:0/680121710 >> 172.21.15.63:0/680121710 conn(0x7fbfe806ac90 msgr2=0x7fbfe806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.195+0000 7fbfed400640 1 -- 172.21.15.63:0/680121710 shutdown_connections 2024-03-26T06:18:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.195+0000 7fbfed400640 1 -- 172.21.15.63:0/680121710 wait complete. 2024-03-26T06:18:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.197+0000 7fbfed400640 1 Processor -- start 2024-03-26T06:18:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.197+0000 7fbfed400640 1 -- start start 2024-03-26T06:18:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.198+0000 7fbfed400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe806ef70 0x7fbfe813af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.198+0000 7fbfed400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbfe8071890 0x7fbfe8143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.198+0000 7fbfed400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbfe8145100 0x7fbfe8143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.198+0000 7fbfed400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe806dd30 con 0x7fbfe806ef70 2024-03-26T06:18:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.198+0000 7fbfed400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe806da50 con 0x7fbfe8145100 2024-03-26T06:18:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.198+0000 7fbfed400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe806e010 con 0x7fbfe8071890 2024-03-26T06:18:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.198+0000 7fbfe6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe806ef70 0x7fbfe813af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.198+0000 7fbfe6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe806ef70 0x7fbfe813af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39476/0 (socket says 172.21.15.63:39476) 2024-03-26T06:18:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.198+0000 7fbfe6800640 1 -- 172.21.15.63:0/2754695437 learned_addr learned my addr 172.21.15.63:0/2754695437 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfe6800640 1 -- 172.21.15.63:0/2754695437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbfe8071890 msgr2=0x7fbfe8143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfe6800640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbfe8071890 0x7fbfe8143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfe6800640 1 -- 172.21.15.63:0/2754695437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbfe8145100 msgr2=0x7fbfe8143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:31.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfe6800640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbfe8145100 0x7fbfe8143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfe6800640 1 -- 172.21.15.63:0/2754695437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe80a9560 con 0x7fbfe806ef70 2024-03-26T06:18:31.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfe6800640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe806ef70 0x7fbfe813af80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8000c00 tx=0x7fbfd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:31.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfdea00640 1 -- 172.21.15.63:0/2754695437 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8040070 con 0x7fbfe806ef70 2024-03-26T06:18:31.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfdea00640 1 -- 172.21.15.63:0/2754695437 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd803a420 con 0x7fbfe806ef70 2024-03-26T06:18:31.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfdea00640 1 -- 172.21.15.63:0/2754695437 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8035040 con 0x7fbfe806ef70 2024-03-26T06:18:31.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.199+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe80a9840 con 0x7fbfe806ef70 2024-03-26T06:18:31.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.200+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe8140cc0 con 0x7fbfe806ef70 2024-03-26T06:18:31.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.201+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe8074730 con 0x7fbfe806ef70 2024-03-26T06:18:31.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.202+0000 7fbfdea00640 1 -- 172.21.15.63:0/2754695437 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbfd804b060 con 0x7fbfe806ef70 2024-03-26T06:18:31.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.203+0000 7fbfdea00640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbfc406bbd0 0x7fbfc406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.203+0000 7fbfdea00640 1 -- 172.21.15.63:0/2754695437 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fbfd80ac710 con 0x7fbfe806ef70 2024-03-26T06:18:31.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.203+0000 7fbfe5e00640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbfc406bbd0 0x7fbfc406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.204+0000 7fbfe5e00640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbfc406bbd0 0x7fbfc406e090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbfe815b9f0 tx=0x7fbfd00083d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:31.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.208+0000 7fbfdea00640 1 -- 172.21.15.63:0/2754695437 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fbfd807b450 con 0x7fbfe806ef70 2024-03-26T06:18:31.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.411+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbfe806d4b0 con 0x7fbfe806ef70 2024-03-26T06:18:31.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.412+0000 7fbfdea00640 1 -- 172.21.15.63:0/2754695437 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbfd807ad50 con 0x7fbfe806ef70 2024-03-26T06:18:31.414 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:31.414 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-03-26T06:18:31.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-03-26T06:18:31.414 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-03-26T06:18:31.414 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-03-26T06:18:31.414 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-03-26T06:18:31.414 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-03-26T06:18:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbfc406bbd0 msgr2=0x7fbfc406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbfc406bbd0 0x7fbfc406e090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbfe815b9f0 tx=0x7fbfd00083d0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe806ef70 msgr2=0x7fbfe813af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe806ef70 0x7fbfe813af80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8000c00 tx=0x7fbfd80046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 shutdown_connections 2024-03-26T06:18:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fbfc406bbd0 0x7fbfc406e090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbfe8145100 0x7fbfe8143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbfe8071890 0x7fbfe8143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 --2- 172.21.15.63:0/2754695437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfe806ef70 0x7fbfe813af80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 >> 172.21.15.63:0/2754695437 conn(0x7fbfe806ac90 msgr2=0x7fbfe80b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:31.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 shutdown_connections 2024-03-26T06:18:31.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.415+0000 7fbfed400640 1 -- 172.21.15.63:0/2754695437 wait complete. 2024-03-26T06:18:31.436 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-26T06:18:31.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-26T06:18:31.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.662+0000 7f1ac3200640 1 Processor -- start 2024-03-26T06:18:31.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.662+0000 7f1ac3200640 1 -- start start 2024-03-26T06:18:31.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.664+0000 7f1ac3200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1abc145140 0x7f1abc0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.664+0000 7f1ac3200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc0cef70 0x7f1abc0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.664+0000 7f1ac3200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1abc0b2c60 con 0x7f1abc145520 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.664+0000 7f1ac3200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1abc160350 con 0x7f1abc145140 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.664+0000 7f1ac3200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc15f740 con 0x7f1abc0cef70 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.664+0000 7f1abbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1abc145140 0x7f1abc0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.665+0000 7f1ab3400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1abc145520 0x7f1abc0ce860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43340/0 (socket says 172.21.15.63:43340) 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.665+0000 7f1ab3400640 1 -- 172.21.15.63:0/1946704701 learned_addr learned my addr 172.21.15.63:0/1946704701 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.665+0000 7f1ac1200640 1 --2- 172.21.15.63:0/1946704701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc0cef70 0x7f1abc0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.665+0000 7f1abbe00640 1 -- 172.21.15.63:0/1946704701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc0cef70 msgr2=0x7f1abc0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.665+0000 7f1abbe00640 1 --2- 172.21.15.63:0/1946704701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc0cef70 0x7f1abc0cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.665+0000 7f1abbe00640 1 -- 172.21.15.63:0/1946704701 >> v1:172.21.15.63:6789/0 conn(0x7f1abc145520 legacy=0x7f1abc0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.665+0000 7f1abb400640 1 -- 172.21.15.63:0/1946704701 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328728121 0 0) 0x7f1abc0b2c60 con 0x7f1abc145520 2024-03-26T06:18:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.665+0000 7f1abbe00640 1 -- 172.21.15.63:0/1946704701 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc15fa20 con 0x7f1abc145140 2024-03-26T06:18:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.666+0000 7f1abbe00640 1 --2- 172.21.15.63:0/1946704701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc145140 0x7f1abc0ccb10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0097a0 tx=0x7f1aac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431c89710095d91a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1abb400640 1 -- 172.21.15.63:0/1946704701 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac035020 con 0x7f1abc145140 2024-03-26T06:18:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1abb400640 1 -- 172.21.15.63:0/1946704701 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac031830 con 0x7f1abc145140 2024-03-26T06:18:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1abb400640 1 -- 172.21.15.63:0/1946704701 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac031c00 con 0x7f1abc145140 2024-03-26T06:18:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1ac3200640 1 -- 172.21.15.63:0/1946704701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc145140 msgr2=0x7f1abc0ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1ac3200640 1 --2- 172.21.15.63:0/1946704701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc145140 0x7f1abc0ccb10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0097a0 tx=0x7f1aac02b8d0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1ac3200640 1 -- 172.21.15.63:0/1946704701 shutdown_connections 2024-03-26T06:18:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1ac3200640 1 --2- 172.21.15.63:0/1946704701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc0cef70 0x7f1abc0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1ac3200640 1 --2- 172.21.15.63:0/1946704701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc145140 0x7f1abc0ccb10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1ac3200640 1 -- 172.21.15.63:0/1946704701 >> 172.21.15.63:0/1946704701 conn(0x7f1abc0cf670 msgr2=0x7f1abc0cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1ac3200640 1 -- 172.21.15.63:0/1946704701 shutdown_connections 2024-03-26T06:18:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.667+0000 7f1ac3200640 1 -- 172.21.15.63:0/1946704701 wait complete. 2024-03-26T06:18:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.669+0000 7f1ac3200640 1 Processor -- start 2024-03-26T06:18:31.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.669+0000 7f1ac3200640 1 -- start start 2024-03-26T06:18:31.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.670+0000 7f1ac3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc0cef70 0x7f1abc0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.670+0000 7f1ac3200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc145140 0x7f1abc13a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.670+0000 7f1ac3200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1abc145520 0x7f1abc13dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.670+0000 7f1ac3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0b3530 con 0x7f1abc0cef70 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.670+0000 7f1ac3200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc15ffe0 con 0x7f1abc145520 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.670+0000 7f1ac3200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0b36b0 con 0x7f1abc145140 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1abbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc0cef70 0x7f1abc0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1abbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc0cef70 0x7f1abc0b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39496/0 (socket says 172.21.15.63:39496) 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1abbe00640 1 -- 172.21.15.63:0/2805644824 learned_addr learned my addr 172.21.15.63:0/2805644824 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1ab3400640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc145140 0x7f1abc13a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1ac1200640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1abc145520 0x7f1abc13dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1abbe00640 1 -- 172.21.15.63:0/2805644824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc145140 msgr2=0x7f1abc13a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:31.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1abbe00640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc145140 0x7f1abc13a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1abbe00640 1 -- 172.21.15.63:0/2805644824 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1abc145520 msgr2=0x7f1abc13dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:31.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1abbe00640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1abc145520 0x7f1abc13dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:31.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.671+0000 7f1abbe00640 1 -- 172.21.15.63:0/2805644824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc0b0c40 con 0x7f1abc0cef70 2024-03-26T06:18:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.672+0000 7f1abbe00640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc0cef70 0x7f1abc0b0700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0097a0 tx=0x7f1aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.672+0000 7f1ab8c00640 1 -- 172.21.15.63:0/2805644824 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac035070 con 0x7f1abc0cef70 2024-03-26T06:18:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.672+0000 7f1ab8c00640 1 -- 172.21.15.63:0/2805644824 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac004230 con 0x7f1abc0cef70 2024-03-26T06:18:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.672+0000 7f1ab8c00640 1 -- 172.21.15.63:0/2805644824 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac03a6f0 con 0x7f1abc0cef70 2024-03-26T06:18:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.672+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc0af660 con 0x7f1abc0cef70 2024-03-26T06:18:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.672+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc0afc20 con 0x7f1abc0cef70 2024-03-26T06:18:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.673+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc074810 con 0x7f1abc0cef70 2024-03-26T06:18:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.674+0000 7f1ab8c00640 1 -- 172.21.15.63:0/2805644824 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1aac038020 con 0x7f1abc0cef70 2024-03-26T06:18:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.675+0000 7f1ab8c00640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1a9806bbd0 0x7f1a9806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.675+0000 7f1ab8c00640 1 -- 172.21.15.63:0/2805644824 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1aac0ac4b0 con 0x7f1abc0cef70 2024-03-26T06:18:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.675+0000 7f1ab3400640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1a9806bbd0 0x7f1a9806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:31.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.676+0000 7f1ab3400640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1a9806bbd0 0x7f1a9806e090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40012e0 tx=0x7f1aa4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.680+0000 7f1ab8c00640 1 -- 172.21.15.63:0/2805644824 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1aac040070 con 0x7f1abc0cef70 2024-03-26T06:18:31.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:31.880+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1abc06d530 con 0x7f1abc0cef70 2024-03-26T06:18:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.289+0000 7f1ab8c00640 1 -- 172.21.15.63:0/2805644824 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1aac07b1f0 con 0x7f1abc0cef70 2024-03-26T06:18:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-03-26T06:18:32.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.293+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1a9806bbd0 msgr2=0x7f1a9806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:32.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.293+0000 7f1ac3200640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1a9806bbd0 0x7f1a9806e090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40012e0 tx=0x7f1aa4009040 comp rx=0 tx=0).stop 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.293+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc0cef70 msgr2=0x7f1abc0b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.293+0000 7f1ac3200640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc0cef70 0x7f1abc0b0700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0097a0 tx=0x7f1aac0046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.294+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 shutdown_connections 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.294+0000 7f1ac3200640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f1a9806bbd0 0x7f1a9806e090 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.294+0000 7f1ac3200640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1abc145520 0x7f1abc13dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.294+0000 7f1ac3200640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1abc145140 0x7f1abc13a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.294+0000 7f1ac3200640 1 --2- 172.21.15.63:0/2805644824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1abc0cef70 0x7f1abc0b0700 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.294+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 >> 172.21.15.63:0/2805644824 conn(0x7f1abc0cf670 msgr2=0x7f1abc0713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.294+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 shutdown_connections 2024-03-26T06:18:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.294+0000 7f1ac3200640 1 -- 172.21.15.63:0/2805644824 wait complete. 2024-03-26T06:18:32.321 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-26T06:18:32.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.539+0000 7ff9e4800640 1 Processor -- start 2024-03-26T06:18:32.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.539+0000 7ff9e4800640 1 -- start start 2024-03-26T06:18:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.541+0000 7ff9e4800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc0cfd60 0x7ff9dc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.541+0000 7ff9e4800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9dc144c70 0x7ff9dc0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.541+0000 7ff9e4800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9dc0d0140 con 0x7ff9dc1450d0 2024-03-26T06:18:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.541+0000 7ff9e4800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9dc0b4b10 con 0x7ff9dc144c70 2024-03-26T06:18:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.541+0000 7ff9e4800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0b3530 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.541+0000 7ff9e1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9dc144c70 0x7ff9dc0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.541+0000 7ff9e1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9dc144c70 0x7ff9dc0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39504/0 (socket says 172.21.15.63:39504) 2024-03-26T06:18:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.541+0000 7ff9e1400640 1 -- 172.21.15.63:0/3655881995 learned_addr learned my addr 172.21.15.63:0/3655881995 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.542+0000 7ff9e1e00640 1 --2- 172.21.15.63:0/3655881995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc0cfd60 0x7ff9dc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.542+0000 7ff9e1400640 1 -- 172.21.15.63:0/3655881995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc0cfd60 msgr2=0x7ff9dc0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.542+0000 7ff9e1400640 1 --2- 172.21.15.63:0/3655881995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc0cfd60 0x7ff9dc0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.542+0000 7ff9e1400640 1 -- 172.21.15.63:0/3655881995 >> v1:172.21.15.63:6789/0 conn(0x7ff9dc1450d0 legacy=0x7ff9dc0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.542+0000 7ff9e1400640 1 -- 172.21.15.63:0/3655881995 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc0b3810 con 0x7ff9dc144c70 2024-03-26T06:18:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.543+0000 7ff9e1400640 1 --2- 172.21.15.63:0/3655881995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc144c70 0x7ff9dc0712f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0d0310 tx=0x7ff9cc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b06a38435cb35a server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.543+0000 7ff9e0a00640 1 -- 172.21.15.63:0/3655881995 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc034070 con 0x7ff9dc144c70 2024-03-26T06:18:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.543+0000 7ff9e0a00640 1 -- 172.21.15.63:0/3655881995 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc030840 con 0x7ff9dc144c70 2024-03-26T06:18:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.543+0000 7ff9e0a00640 1 -- 172.21.15.63:0/3655881995 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc030c10 con 0x7ff9dc144c70 2024-03-26T06:18:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.544+0000 7ff9e4800640 1 -- 172.21.15.63:0/3655881995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc144c70 msgr2=0x7ff9dc0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.544+0000 7ff9e4800640 1 --2- 172.21.15.63:0/3655881995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc144c70 0x7ff9dc0712f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0d0310 tx=0x7ff9cc02b980 comp rx=0 tx=0).stop 2024-03-26T06:18:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.544+0000 7ff9e4800640 1 -- 172.21.15.63:0/3655881995 shutdown_connections 2024-03-26T06:18:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.544+0000 7ff9e4800640 1 --2- 172.21.15.63:0/3655881995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc144c70 0x7ff9dc0712f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.544+0000 7ff9e4800640 1 --2- 172.21.15.63:0/3655881995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc0cfd60 0x7ff9dc0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.544+0000 7ff9e4800640 1 -- 172.21.15.63:0/3655881995 >> 172.21.15.63:0/3655881995 conn(0x7ff9dc06ac90 msgr2=0x7ff9dc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.544+0000 7ff9e4800640 1 -- 172.21.15.63:0/3655881995 shutdown_connections 2024-03-26T06:18:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.544+0000 7ff9e4800640 1 -- 172.21.15.63:0/3655881995 wait complete. 2024-03-26T06:18:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.546+0000 7ff9e4800640 1 Processor -- start 2024-03-26T06:18:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.546+0000 7ff9e4800640 1 -- start start 2024-03-26T06:18:32.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.547+0000 7ff9e4800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc0cfd60 0x7ff9dc13a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:32.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.547+0000 7ff9e4800640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc144c70 0x7ff9dc13e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:32.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e4800640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9dc1450d0 0x7ff9dc15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e4800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0b40b0 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e4800640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0b3dd0 con 0x7ff9dc1450d0 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e4800640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0b31c0 con 0x7ff9dc144c70 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc0cfd60 0x7ff9dc13a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc0cfd60 0x7ff9dc13a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39518/0 (socket says 172.21.15.63:39518) 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e1e00640 1 -- 172.21.15.63:0/3161482240 learned_addr learned my addr 172.21.15.63:0/3161482240 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e2800640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9dc1450d0 0x7ff9dc15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e1e00640 1 -- 172.21.15.63:0/3161482240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc144c70 msgr2=0x7ff9dc13e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e1400640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc144c70 0x7ff9dc13e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e1e00640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc144c70 0x7ff9dc13e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e1e00640 1 -- 172.21.15.63:0/3161482240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9dc1450d0 msgr2=0x7ff9dc15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:32.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e1e00640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9dc1450d0 0x7ff9dc15deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:32.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e1e00640 1 -- 172.21.15.63:0/3161482240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc13a8d0 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.548+0000 7ff9e2800640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9dc1450d0 0x7ff9dc15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:32.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.549+0000 7ff9e1e00640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc0cfd60 0x7ff9dc13a390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000d620 tx=0x7ff9d000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:32.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.549+0000 7ff9d6000640 1 -- 172.21.15.63:0/3161482240 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000b620 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.549+0000 7ff9d6000640 1 -- 172.21.15.63:0/3161482240 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d0019070 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.549+0000 7ff9d6000640 1 -- 172.21.15.63:0/3161482240 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000ba00 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.549+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9dc13f730 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.549+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9dc13ec40 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.550+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9dc074730 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.552+0000 7ff9d6000640 1 -- 172.21.15.63:0/3161482240 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff9d000bba0 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.552+0000 7ff9d6000640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9c006bbd0 0x7ff9c006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:32.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.553+0000 7ff9d6000640 1 -- 172.21.15.63:0/3161482240 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5619+0+0 (secure 0 0 0) 0x7ff9d008aee0 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.553+0000 7ff9e1400640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9c006bbd0 0x7ff9c006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:32.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.554+0000 7ff9e1400640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9c006bbd0 0x7ff9c006e090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc036000 tx=0x7ff9cc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:32.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.558+0000 7ff9d6000640 1 -- 172.21.15.63:0/3161482240 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7ff9d0059980 con 0x7ff9dc0cfd60 2024-03-26T06:18:32.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:32.763+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff9dc15f1d0 con 0x7ff9dc0cfd60 2024-03-26T06:18:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.296+0000 7ff9d6000640 1 -- 172.21.15.63:0/3161482240 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff9d0059280 con 0x7ff9dc0cfd60 2024-03-26T06:18:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-03-26T06:18:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.299+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9c006bbd0 msgr2=0x7ff9c006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.299+0000 7ff9e4800640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9c006bbd0 0x7ff9c006e090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc036000 tx=0x7ff9cc03b040 comp rx=0 tx=0).stop 2024-03-26T06:18:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.299+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc0cfd60 msgr2=0x7ff9dc13a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.299+0000 7ff9e4800640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc0cfd60 0x7ff9dc13a390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000d620 tx=0x7ff9d000dae0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.301+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 shutdown_connections 2024-03-26T06:18:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.301+0000 7ff9e4800640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff9c006bbd0 0x7ff9c006e090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.301+0000 7ff9e4800640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9dc1450d0 0x7ff9dc15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.301+0000 7ff9e4800640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9dc144c70 0x7ff9dc13e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.301+0000 7ff9e4800640 1 --2- 172.21.15.63:0/3161482240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9dc0cfd60 0x7ff9dc13a390 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.301+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 >> 172.21.15.63:0/3161482240 conn(0x7ff9dc06ac90 msgr2=0x7ff9dc0afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.301+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 shutdown_connections 2024-03-26T06:18:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.301+0000 7ff9e4800640 1 -- 172.21.15.63:0/3161482240 wait complete. 2024-03-26T06:18:33.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-26T06:18:33.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.532+0000 7f590ee00640 1 Processor -- start 2024-03-26T06:18:33.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.532+0000 7f590ee00640 1 -- start start 2024-03-26T06:18:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ee00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5908144c70 0x7f59080712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ee00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59081450d0 0x7f5908071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ee00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59080d0140 con 0x7f59080cfd60 2024-03-26T06:18:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ee00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59080b3530 con 0x7f59081450d0 2024-03-26T06:18:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ee00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080b3810 con 0x7f5908144c70 2024-03-26T06:18:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59081450d0 0x7f5908071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59081450d0 0x7f5908071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39532/0 (socket says 172.21.15.63:39532) 2024-03-26T06:18:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ce00640 1 -- 172.21.15.63:0/71456282 learned_addr learned my addr 172.21.15.63:0/71456282 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f5907400640 1 --2- 172.21.15.63:0/71456282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5908144c70 0x7f59080712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:33.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ce00640 1 -- 172.21.15.63:0/71456282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5908144c70 msgr2=0x7f59080712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:33.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ce00640 1 --2- 172.21.15.63:0/71456282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5908144c70 0x7f59080712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ce00640 1 -- 172.21.15.63:0/71456282 >> v1:172.21.15.204:6789/0 conn(0x7f59080cfd60 legacy=0x7f59080b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:33.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f590ce00640 1 -- 172.21.15.63:0/71456282 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59080b3af0 con 0x7f59081450d0 2024-03-26T06:18:33.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.535+0000 7f5907400640 1 --2- 172.21.15.63:0/71456282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5908144c70 0x7f59080712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:18:33.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.536+0000 7f590ce00640 1 --2- 172.21.15.63:0/71456282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 0x7f5908071830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5900009e50 tx=0x7f590002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6b1f17dde4088e server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.537+0000 7f5906a00640 1 -- 172.21.15.63:0/71456282 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590002cb00 con 0x7f59081450d0 2024-03-26T06:18:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.537+0000 7f5906a00640 1 -- 172.21.15.63:0/71456282 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590002cca0 con 0x7f59081450d0 2024-03-26T06:18:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.537+0000 7f5906a00640 1 -- 172.21.15.63:0/71456282 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900034610 con 0x7f59081450d0 2024-03-26T06:18:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.537+0000 7f590ee00640 1 -- 172.21.15.63:0/71456282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 msgr2=0x7f5908071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.537+0000 7f590ee00640 1 --2- 172.21.15.63:0/71456282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 0x7f5908071830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5900009e50 tx=0x7f590002bf60 comp rx=0 tx=0).stop 2024-03-26T06:18:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.537+0000 7f590ee00640 1 -- 172.21.15.63:0/71456282 shutdown_connections 2024-03-26T06:18:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.537+0000 7f590ee00640 1 --2- 172.21.15.63:0/71456282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 0x7f5908071830 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.537+0000 7f590ee00640 1 --2- 172.21.15.63:0/71456282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5908144c70 0x7f59080712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.537+0000 7f590ee00640 1 -- 172.21.15.63:0/71456282 >> 172.21.15.63:0/71456282 conn(0x7f590806ac90 msgr2=0x7f590806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.538+0000 7f590ee00640 1 -- 172.21.15.63:0/71456282 shutdown_connections 2024-03-26T06:18:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.538+0000 7f590ee00640 1 -- 172.21.15.63:0/71456282 wait complete. 2024-03-26T06:18:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.539+0000 7f590ee00640 1 Processor -- start 2024-03-26T06:18:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.539+0000 7f590ee00640 1 -- start start 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.540+0000 7f590ee00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59080cfd60 0x7f59081e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.540+0000 7f590ee00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5908144c70 0x7f59081f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.540+0000 7f590ee00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 0x7f59080b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.540+0000 7f590ee00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080b31c0 con 0x7f59081450d0 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.540+0000 7f590ee00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080b40b0 con 0x7f5908144c70 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.540+0000 7f590ee00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080ce670 con 0x7f59080cfd60 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f590ce00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 0x7f59080b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f590ce00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 0x7f59080b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39548/0 (socket says 172.21.15.63:39548) 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f590ce00640 1 -- 172.21.15.63:0/2825571967 learned_addr learned my addr 172.21.15.63:0/2825571967 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f5907e00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59080cfd60 0x7f59081e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:33.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f5907400640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5908144c70 0x7f59081f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:33.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f590ce00640 1 -- 172.21.15.63:0/2825571967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59080cfd60 msgr2=0x7f59081e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:33.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f590ce00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59080cfd60 0x7f59081e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f590ce00640 1 -- 172.21.15.63:0/2825571967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5908144c70 msgr2=0x7f59081f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:33.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f590ce00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5908144c70 0x7f59081f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:33.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f590ce00640 1 -- 172.21.15.63:0/2825571967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59081e74b0 con 0x7f59081450d0 2024-03-26T06:18:33.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.541+0000 7f590ce00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 0x7f59080b0510 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5900009e50 tx=0x7f5900004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:33.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.542+0000 7f58ffe00640 1 -- 172.21.15.63:0/2825571967 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900043020 con 0x7f59081450d0 2024-03-26T06:18:33.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.542+0000 7f58ffe00640 1 -- 172.21.15.63:0/2825571967 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590002ce50 con 0x7f59081450d0 2024-03-26T06:18:33.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.542+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59081e5ed0 con 0x7f59081450d0 2024-03-26T06:18:33.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.542+0000 7f58ffe00640 1 -- 172.21.15.63:0/2825571967 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900009510 con 0x7f59081450d0 2024-03-26T06:18:33.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.542+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59081e6490 con 0x7f59081450d0 2024-03-26T06:18:33.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.543+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5908074730 con 0x7f59081450d0 2024-03-26T06:18:33.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.544+0000 7f58ffe00640 1 -- 172.21.15.63:0/2825571967 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5900046020 con 0x7f59081450d0 2024-03-26T06:18:33.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.545+0000 7f58ffe00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f58e406bbd0 0x7f58e406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:33.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.546+0000 7f58ffe00640 1 -- 172.21.15.63:0/2825571967 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f59000ad700 con 0x7f59081450d0 2024-03-26T06:18:33.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.546+0000 7f5907e00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f58e406bbd0 0x7f58e406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:33.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.546+0000 7f5907e00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f58e406bbd0 0x7f58e406e090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58f8001640 tx=0x7f58f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:33.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.549+0000 7f58ffe00640 1 -- 172.21.15.63:0/2825571967 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f590004d030 con 0x7f59081450d0 2024-03-26T06:18:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:33.790+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f59080aea00 con 0x7f59081450d0 2024-03-26T06:18:34.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.319+0000 7f58ffe00640 1 -- 172.21.15.63:0/2825571967 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f590007c010 con 0x7f59081450d0 2024-03-26T06:18:34.320 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 5 and data pool 6 2024-03-26T06:18:34.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.322+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f58e406bbd0 msgr2=0x7f58e406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:34.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.322+0000 7f590ee00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f58e406bbd0 0x7f58e406e090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58f8001640 tx=0x7f58f8009040 comp rx=0 tx=0).stop 2024-03-26T06:18:34.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.322+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 msgr2=0x7f59080b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:34.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.322+0000 7f590ee00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 0x7f59080b0510 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5900009e50 tx=0x7f5900004a40 comp rx=0 tx=0).stop 2024-03-26T06:18:34.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.322+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 shutdown_connections 2024-03-26T06:18:34.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.322+0000 7f590ee00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f58e406bbd0 0x7f58e406e090 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58f8001640 tx=0x7f58f8009040 comp rx=0 tx=0).stop 2024-03-26T06:18:34.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.322+0000 7f590ee00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59081450d0 0x7f59080b0510 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.322+0000 7f590ee00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5908144c70 0x7f59081f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.322+0000 7f590ee00640 1 --2- 172.21.15.63:0/2825571967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59080cfd60 0x7f59081e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.324+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 >> 172.21.15.63:0/2825571967 conn(0x7f590806ac90 msgr2=0x7f59080b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:34.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.326+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 shutdown_connections 2024-03-26T06:18:34.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.326+0000 7f590ee00640 1 -- 172.21.15.63:0/2825571967 wait complete. 2024-03-26T06:18:34.377 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.558+0000 7f29e6c00640 1 Processor -- start 2024-03-26T06:18:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.558+0000 7f29e6c00640 1 -- start start 2024-03-26T06:18:34.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.560+0000 7f29e6c00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f29e00ced60 0x7f29e006e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:34.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.560+0000 7f29e6c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29e00cf140 0x7f29e0071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:34.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.560+0000 7f29e6c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e0163490 con 0x7f29e0071890 2024-03-26T06:18:34.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.560+0000 7f29e6c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e006e750 con 0x7f29e00cf140 2024-03-26T06:18:34.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.560+0000 7f29e6c00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e0071ce0 con 0x7f29e00ced60 2024-03-26T06:18:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.560+0000 7f29df400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29e00cf140 0x7f29e0071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.560+0000 7f29df400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29e00cf140 0x7f29e0071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39554/0 (socket says 172.21.15.63:39554) 2024-03-26T06:18:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.560+0000 7f29df400640 1 -- 172.21.15.63:0/3593476761 learned_addr learned my addr 172.21.15.63:0/3593476761 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29dfe00640 1 --2- 172.21.15.63:0/3593476761 >> v2:172.21.15.204:3300/0 conn(0x7f29e00ced60 0x7f29e006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29df400640 1 -- 172.21.15.63:0/3593476761 >> v2:172.21.15.204:3300/0 conn(0x7f29e00ced60 msgr2=0x7f29e006e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:34.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29df400640 1 --2- 172.21.15.63:0/3593476761 >> v2:172.21.15.204:3300/0 conn(0x7f29e00ced60 0x7f29e006e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29df400640 1 -- 172.21.15.63:0/3593476761 >> v1:172.21.15.63:6789/0 conn(0x7f29e0071890 legacy=0x7f29e0162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:34.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29df400640 1 -- 172.21.15.63:0/3593476761 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e006d450 con 0x7f29e00cf140 2024-03-26T06:18:34.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29dfe00640 1 --2- 172.21.15.63:0/3593476761 >> v2:172.21.15.204:3300/0 conn(0x7f29e00ced60 0x7f29e006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29df400640 1 --2- 172.21.15.63:0/3593476761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e00cf140 0x7f29e0071350 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f29e006ba70 tx=0x7f29cc02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df296a44b35d7c58 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29dea00640 1 -- 172.21.15.63:0/3593476761 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc034070 con 0x7f29e00cf140 2024-03-26T06:18:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29dea00640 1 -- 172.21.15.63:0/3593476761 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc030870 con 0x7f29e00cf140 2024-03-26T06:18:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.561+0000 7f29dea00640 1 -- 172.21.15.63:0/3593476761 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc030c40 con 0x7f29e00cf140 2024-03-26T06:18:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.563+0000 7f29e6c00640 1 -- 172.21.15.63:0/3593476761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e00cf140 msgr2=0x7f29e0071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.563+0000 7f29e6c00640 1 --2- 172.21.15.63:0/3593476761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e00cf140 0x7f29e0071350 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f29e006ba70 tx=0x7f29cc02b9b0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.563+0000 7f29e6c00640 1 -- 172.21.15.63:0/3593476761 shutdown_connections 2024-03-26T06:18:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.563+0000 7f29e6c00640 1 --2- 172.21.15.63:0/3593476761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e00cf140 0x7f29e0071350 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.563+0000 7f29e6c00640 1 --2- 172.21.15.63:0/3593476761 >> v2:172.21.15.204:3300/0 conn(0x7f29e00ced60 0x7f29e006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.563+0000 7f29e6c00640 1 -- 172.21.15.63:0/3593476761 >> 172.21.15.63:0/3593476761 conn(0x7f29e006ac90 msgr2=0x7f29e006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.563+0000 7f29e6c00640 1 -- 172.21.15.63:0/3593476761 shutdown_connections 2024-03-26T06:18:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.563+0000 7f29e6c00640 1 -- 172.21.15.63:0/3593476761 wait complete. 2024-03-26T06:18:34.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.565+0000 7f29e6c00640 1 Processor -- start 2024-03-26T06:18:34.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.565+0000 7f29e6c00640 1 -- start start 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.566+0000 7f29e6c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e0071890 0x7f29e015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.566+0000 7f29e6c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29e00ced60 0x7f29e0154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.566+0000 7f29e6c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29e00cf140 0x7f29e01f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.566+0000 7f29e6c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e006dcf0 con 0x7f29e0071890 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.566+0000 7f29e6c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e006da10 con 0x7f29e00ced60 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.566+0000 7f29e6c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0162e20 con 0x7f29e00cf140 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.566+0000 7f29dfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e0071890 0x7f29e015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.566+0000 7f29dfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e0071890 0x7f29e015cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39560/0 (socket says 172.21.15.63:39560) 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.566+0000 7f29dfe00640 1 -- 172.21.15.63:0/3235253181 learned_addr learned my addr 172.21.15.63:0/3235253181 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:34.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29dfe00640 1 -- 172.21.15.63:0/3235253181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29e00cf140 msgr2=0x7f29e01f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:34.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29dfe00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29e00cf140 0x7f29e01f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29df400640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29e00ced60 0x7f29e0154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:34.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29dfe00640 1 -- 172.21.15.63:0/3235253181 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29e00ced60 msgr2=0x7f29e0154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:34.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29dfe00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29e00ced60 0x7f29e0154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29dfe00640 1 -- 172.21.15.63:0/3235253181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e01f8320 con 0x7f29e0071890 2024-03-26T06:18:34.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29dfe00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e0071890 0x7f29e015cbd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c7f0 tx=0x7f29d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:34.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29d7e00640 1 -- 172.21.15.63:0/3235253181 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0015070 con 0x7f29e0071890 2024-03-26T06:18:34.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29d7e00640 1 -- 172.21.15.63:0/3235253181 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0007a30 con 0x7f29e0071890 2024-03-26T06:18:34.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e015d240 con 0x7f29e0071890 2024-03-26T06:18:34.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29d7e00640 1 -- 172.21.15.63:0/3235253181 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0007e00 con 0x7f29e0071890 2024-03-26T06:18:34.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.567+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e015dae0 con 0x7f29e0071890 2024-03-26T06:18:34.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.568+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e015d630 con 0x7f29e0071890 2024-03-26T06:18:34.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.569+0000 7f29d7e00640 1 -- 172.21.15.63:0/3235253181 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f29d0018070 con 0x7f29e0071890 2024-03-26T06:18:34.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.569+0000 7f29d7e00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f29c006bbd0 0x7f29c006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:34.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.571+0000 7f29d7e00640 1 -- 172.21.15.63:0/3235253181 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f29d008ab20 con 0x7f29e0071890 2024-03-26T06:18:34.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.571+0000 7f29df400640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f29c006bbd0 0x7f29c006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:34.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.571+0000 7f29df400640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f29c006bbd0 0x7f29c006e090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29cc036000 tx=0x7f29cc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:34.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.575+0000 7f29d7e00640 1 -- 172.21.15.63:0/3235253181 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f29d0059510 con 0x7f29e0071890 2024-03-26T06:18:34.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.769+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29e0074730 con 0x7f29e0071890 2024-03-26T06:18:34.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.772+0000 7f29d7e00640 1 -- 172.21.15.63:0/3235253181 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16967 (secure 0 0 0) 0x7f29d0058e10 con 0x7f29e0071890 2024-03-26T06:18:34.773 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:34.773 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":38,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:18:33.792167+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:18:31.934065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-26T06:18:32.820259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:34.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f29c006bbd0 msgr2=0x7f29c006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:34.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f29c006bbd0 0x7f29c006e090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29cc036000 tx=0x7f29cc03b040 comp rx=0 tx=0).stop 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e0071890 msgr2=0x7f29e015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e0071890 0x7f29e015cbd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c7f0 tx=0x7f29d000cbf0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 shutdown_connections 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f29c006bbd0 0x7f29c006e090 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29e00cf140 0x7f29e01f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29e00ced60 0x7f29e0154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 --2- 172.21.15.63:0/3235253181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29e0071890 0x7f29e015cbd0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 >> 172.21.15.63:0/3235253181 conn(0x7f29e006ac90 msgr2=0x7f29e0165080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 shutdown_connections 2024-03-26T06:18:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:34.775+0000 7f29e6c00640 1 -- 172.21.15.63:0/3235253181 wait complete. 2024-03-26T06:18:34.793 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:35.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.006+0000 7fc4db000640 1 Processor -- start 2024-03-26T06:18:35.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.006+0000 7fc4db000640 1 -- start start 2024-03-26T06:18:35.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.008+0000 7fc4db000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc4d415d9a0 0x7fc4d40b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.008+0000 7fc4db000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d40b97c0 con 0x7fc4d40d1c10 2024-03-26T06:18:35.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.008+0000 7fc4db000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d40d21b0 con 0x7fc4d40cec20 2024-03-26T06:18:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.008+0000 7fc4db000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d40d2490 con 0x7fc4d415d9a0 2024-03-26T06:18:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.008+0000 7fc4d9c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc4d415d9a0 0x7fc4d40b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.008+0000 7fc4d9200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc4d40d1c10 0x7fc4d40ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43376/0 (socket says 172.21.15.63:43376) 2024-03-26T06:18:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.008+0000 7fc4d9200640 1 -- 172.21.15.63:0/403243967 learned_addr learned my addr 172.21.15.63:0/403243967 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.009+0000 7fc4d9c00640 1 -- 172.21.15.63:0/403243967 >> v1:172.21.15.204:6789/0 conn(0x7fc4d40cec20 legacy=0x7fc4d40b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.009+0000 7fc4d9c00640 1 -- 172.21.15.63:0/403243967 >> v1:172.21.15.63:6789/0 conn(0x7fc4d40d1c10 legacy=0x7fc4d40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.009+0000 7fc4d9c00640 1 -- 172.21.15.63:0/403243967 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40d2770 con 0x7fc4d415d9a0 2024-03-26T06:18:35.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.010+0000 7fc4d9c00640 1 --2- 172.21.15.63:0/403243967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d415d9a0 0x7fc4d40b9280 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097a0 tx=0x7fc4c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07967ac8327ef29 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:35.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.010+0000 7fc4d3e00640 1 -- 172.21.15.63:0/403243967 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8035020 con 0x7fc4d415d9a0 2024-03-26T06:18:35.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.010+0000 7fc4d3e00640 1 -- 172.21.15.63:0/403243967 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8031830 con 0x7fc4d415d9a0 2024-03-26T06:18:35.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.010+0000 7fc4d3e00640 1 -- 172.21.15.63:0/403243967 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8031c00 con 0x7fc4d415d9a0 2024-03-26T06:18:35.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.011+0000 7fc4db000640 1 -- 172.21.15.63:0/403243967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d415d9a0 msgr2=0x7fc4d40b9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.011+0000 7fc4db000640 1 --2- 172.21.15.63:0/403243967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d415d9a0 0x7fc4d40b9280 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097a0 tx=0x7fc4c802b8d0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.011+0000 7fc4db000640 1 -- 172.21.15.63:0/403243967 shutdown_connections 2024-03-26T06:18:35.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.011+0000 7fc4db000640 1 --2- 172.21.15.63:0/403243967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d415d9a0 0x7fc4d40b9280 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.011+0000 7fc4db000640 1 -- 172.21.15.63:0/403243967 >> 172.21.15.63:0/403243967 conn(0x7fc4d406bfa0 msgr2=0x7fc4d406c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:35.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.011+0000 7fc4db000640 1 -- 172.21.15.63:0/403243967 shutdown_connections 2024-03-26T06:18:35.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.011+0000 7fc4db000640 1 -- 172.21.15.63:0/403243967 wait complete. 2024-03-26T06:18:35.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.013+0000 7fc4db000640 1 Processor -- start 2024-03-26T06:18:35.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.013+0000 7fc4db000640 1 -- start start 2024-03-26T06:18:35.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.014+0000 7fc4db000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d40cec20 0x7fc4d40cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.014+0000 7fc4db000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4d40d1c10 0x7fc4d40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.014+0000 7fc4db000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4d415d9a0 0x7fc4d41f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.014+0000 7fc4db000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d415dd80 con 0x7fc4d40cec20 2024-03-26T06:18:35.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.014+0000 7fc4db000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40d2d30 con 0x7fc4d40d1c10 2024-03-26T06:18:35.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.014+0000 7fc4db000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40d3250 con 0x7fc4d415d9a0 2024-03-26T06:18:35.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.014+0000 7fc4d9c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d40cec20 0x7fc4d40cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.014+0000 7fc4d9c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d40cec20 0x7fc4d40cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39576/0 (socket says 172.21.15.63:39576) 2024-03-26T06:18:35.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.014+0000 7fc4d9c00640 1 -- 172.21.15.63:0/112066715 learned_addr learned my addr 172.21.15.63:0/112066715 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:35.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d9c00640 1 -- 172.21.15.63:0/112066715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4d415d9a0 msgr2=0x7fc4d41f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d9c00640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4d415d9a0 0x7fc4d41f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d9200640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4d40d1c10 0x7fc4d40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d9c00640 1 -- 172.21.15.63:0/112066715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4d40d1c10 msgr2=0x7fc4d40cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d9c00640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4d40d1c10 0x7fc4d40cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d9c00640 1 -- 172.21.15.63:0/112066715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40ccf10 con 0x7fc4d40cec20 2024-03-26T06:18:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d9200640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4d40d1c10 0x7fc4d40cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d9c00640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d40cec20 0x7fc4d40cade0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80098c0 tx=0x7fc4c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d1600640 1 -- 172.21.15.63:0/112066715 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8040070 con 0x7fc4d40cec20 2024-03-26T06:18:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d1600640 1 -- 172.21.15.63:0/112066715 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8039a00 con 0x7fc4d40cec20 2024-03-26T06:18:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4d1600640 1 -- 172.21.15.63:0/112066715 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8035040 con 0x7fc4d40cec20 2024-03-26T06:18:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.015+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d40cd1b0 con 0x7fc4d40cec20 2024-03-26T06:18:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.016+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d40cd770 con 0x7fc4d40cec20 2024-03-26T06:18:35.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.017+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d404f050 con 0x7fc4d40cec20 2024-03-26T06:18:35.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.018+0000 7fc4d1600640 1 -- 172.21.15.63:0/112066715 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc4c8038020 con 0x7fc4d40cec20 2024-03-26T06:18:35.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.019+0000 7fc4d1600640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4b406bbd0 0x7fc4b406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.019+0000 7fc4d1600640 1 -- 172.21.15.63:0/112066715 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc4c80ac630 con 0x7fc4d40cec20 2024-03-26T06:18:35.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.019+0000 7fc4d9200640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4b406bbd0 0x7fc4b406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.019+0000 7fc4d9200640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4b406bbd0 0x7fc4b406e090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4d41f6fa0 tx=0x7fc4c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:35.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.023+0000 7fc4d1600640 1 -- 172.21.15.63:0/112066715 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc4c807af80 con 0x7fc4d40cec20 2024-03-26T06:18:35.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.217+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4d40cabc0 con 0x7fc4d40cec20 2024-03-26T06:18:35.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.219+0000 7fc4d1600640 1 -- 172.21.15.63:0/112066715 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16967 (secure 0 0 0) 0x7fc4c807a880 con 0x7fc4d40cec20 2024-03-26T06:18:35.220 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:35.220 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":38,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:18:33.792167+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:18:31.934065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-26T06:18:32.820259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:35.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.222+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4b406bbd0 msgr2=0x7fc4b406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.222+0000 7fc4db000640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4b406bbd0 0x7fc4b406e090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4d41f6fa0 tx=0x7fc4c0009040 comp rx=0 tx=0).stop 2024-03-26T06:18:35.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.222+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d40cec20 msgr2=0x7fc4d40cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.222+0000 7fc4db000640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d40cec20 0x7fc4d40cade0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80098c0 tx=0x7fc4c80046c0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.222+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 shutdown_connections 2024-03-26T06:18:35.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.222+0000 7fc4db000640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc4b406bbd0 0x7fc4b406e090 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.222+0000 7fc4db000640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4d415d9a0 0x7fc4d41f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.223+0000 7fc4db000640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4d40d1c10 0x7fc4d40cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.223+0000 7fc4db000640 1 --2- 172.21.15.63:0/112066715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d40cec20 0x7fc4d40cade0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.223+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 >> 172.21.15.63:0/112066715 conn(0x7fc4d406bfa0 msgr2=0x7fc4d40c8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:35.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.223+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 shutdown_connections 2024-03-26T06:18:35.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.223+0000 7fc4db000640 1 -- 172.21.15.63:0/112066715 wait complete. 2024-03-26T06:18:35.243 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-26T06:18:35.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.463+0000 7f97bb200640 1 Processor -- start 2024-03-26T06:18:35.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.463+0000 7f97bb200640 1 -- start start 2024-03-26T06:18:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.465+0000 7f97bb200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f97b415dd30 0x7f97b415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.465+0000 7f97bb200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97b40cfc40 0x7f97b40cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.465+0000 7f97bb200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b415e890 con 0x7f97b415e410 2024-03-26T06:18:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.465+0000 7f97bb200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b40cd530 con 0x7f97b415dd30 2024-03-26T06:18:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.465+0000 7f97bb200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b415f3b0 con 0x7f97b40cfc40 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.465+0000 7f97b3400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f97b415e410 0x7f97b40cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43386/0 (socket says 172.21.15.63:43386) 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.465+0000 7f97b3400640 1 -- 172.21.15.63:0/4235144613 learned_addr learned my addr 172.21.15.63:0/4235144613 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b3e00640 1 --2- 172.21.15.63:0/4235144613 >> v2:172.21.15.204:3300/0 conn(0x7f97b415dd30 0x7f97b415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b9200640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97b40cfc40 0x7f97b40cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418190122 0 0) 0x7f97a0001110 con 0x7f97b415e410 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9798005730 con 0x7f97b415e410 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2530024932 0 0) 0x7f9798005730 con 0x7f97b415e410 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97b40cfc40 msgr2=0x7f97b40cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97b40cfc40 0x7f97b40cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 >> v2:172.21.15.204:3300/0 conn(0x7f97b415dd30 msgr2=0x7f97b415ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 --2- 172.21.15.63:0/4235144613 >> v2:172.21.15.204:3300/0 conn(0x7f97b415dd30 0x7f97b415ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b415c420 con 0x7f97b415e410 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f97a0001840 con 0x7f97b415e410 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 >> v1:172.21.15.63:6789/0 conn(0x7f97b415e410 legacy=0x7f97b40cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9798005bc0 0x7f9798005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9798006a10 0x7f9798006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97b40cfc40 0x7f97980073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b415f3b0 con 0x7f9798006a10 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.466+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798003520 con 0x7f9798005bc0 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.467+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9798003720 con 0x7f97b40cfc40 2024-03-26T06:18:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.467+0000 7f97b3400640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9798006a10 0x7f9798006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.467+0000 7f97b3e00640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9798005bc0 0x7f9798005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.467+0000 7f97b9200640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97b40cfc40 0x7f97980073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.468+0000 7f97b3400640 1 -- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97b40cfc40 msgr2=0x7f97980073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:35.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.468+0000 7f97b3400640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97b40cfc40 0x7f97980073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.468+0000 7f97b3400640 1 -- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9798005bc0 msgr2=0x7f9798005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:35.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.468+0000 7f97b3400640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9798005bc0 0x7f9798005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.468+0000 7f97b3400640 1 -- 172.21.15.63:0/4235144613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798005730 con 0x7f9798006a10 2024-03-26T06:18:35.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.469+0000 7f97b3400640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9798006a10 0x7f9798006e90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c320 tx=0x7f9798007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854e2bdc890cd785 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:35.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.469+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a002cc40 con 0x7f9798006a10 2024-03-26T06:18:35.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.469+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a0030070 con 0x7f9798006a10 2024-03-26T06:18:35.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.469+0000 7f97b2a00640 1 -- 172.21.15.63:0/4235144613 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a00058d0 con 0x7f9798006a10 2024-03-26T06:18:35.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.470+0000 7f97bb200640 1 -- 172.21.15.63:0/4235144613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9798006a10 msgr2=0x7f9798006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.470+0000 7f97bb200640 1 --2- 172.21.15.63:0/4235144613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9798006a10 0x7f9798006e90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c320 tx=0x7f9798007a40 comp rx=0 tx=0).stop 2024-03-26T06:18:35.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.470+0000 7f97b9200640 1 -- 172.21.15.63:0/4235144613 reap_dead start 2024-03-26T06:18:35.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.470+0000 7f97bb200640 1 -- 172.21.15.63:0/4235144613 shutdown_connections 2024-03-26T06:18:35.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.470+0000 7f97bb200640 1 -- 172.21.15.63:0/4235144613 >> 172.21.15.63:0/4235144613 conn(0x7f97b406ac90 msgr2=0x7f97b406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:35.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.470+0000 7f97bb200640 1 -- 172.21.15.63:0/4235144613 shutdown_connections 2024-03-26T06:18:35.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.470+0000 7f97bb200640 1 -- 172.21.15.63:0/4235144613 wait complete. 2024-03-26T06:18:35.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.472+0000 7f97bb200640 1 Processor -- start 2024-03-26T06:18:35.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.472+0000 7f97bb200640 1 -- start start 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.473+0000 7f97bb200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9798006a10 0x7f97b4158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.473+0000 7f97bb200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b4144b80 0x7f97b4145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.473+0000 7f97bb200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b40aded0 0x7f97b40ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.473+0000 7f97bb200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b415edf0 con 0x7f97b40aded0 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.473+0000 7f97bb200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40cd7f0 con 0x7f97b4144b80 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.473+0000 7f97bb200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b415f0d0 con 0x7f9798006a10 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.473+0000 7f97b9200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b40aded0 0x7f97b40ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.473+0000 7f97b9200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b40aded0 0x7f97b40ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39596/0 (socket says 172.21.15.63:39596) 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.473+0000 7f97b9200640 1 -- 172.21.15.63:0/1677529282 learned_addr learned my addr 172.21.15.63:0/1677529282 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.474+0000 7f97b3e00640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9798006a10 0x7f97b4158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.474+0000 7f97b3400640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b4144b80 0x7f97b4145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.474+0000 7f97b9200640 1 -- 172.21.15.63:0/1677529282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9798006a10 msgr2=0x7f97b4158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.474+0000 7f97b9200640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9798006a10 0x7f97b4158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.474+0000 7f97b9200640 1 -- 172.21.15.63:0/1677529282 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b4144b80 msgr2=0x7f97b4145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.474+0000 7f97b9200640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b4144b80 0x7f97b4145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.474+0000 7f97b9200640 1 -- 172.21.15.63:0/1677529282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4145540 con 0x7f97b40aded0 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.475+0000 7f97b9200640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b40aded0 0x7f97b40ae350 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f97b40b4d00 tx=0x7f97ac00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.475+0000 7f97abe00640 1 -- 172.21.15.63:0/1677529282 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00fce0 con 0x7f97b40aded0 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.475+0000 7f97abe00640 1 -- 172.21.15.63:0/1677529282 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac00fe80 con 0x7f97b40aded0 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.475+0000 7f97abe00640 1 -- 172.21.15.63:0/1677529282 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac015670 con 0x7f97b40aded0 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.475+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b40ae890 con 0x7f97b40aded0 2024-03-26T06:18:35.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.475+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b41f2860 con 0x7f97b40aded0 2024-03-26T06:18:35.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.476+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b4074730 con 0x7f97b40aded0 2024-03-26T06:18:35.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.477+0000 7f97abe00640 1 -- 172.21.15.63:0/1677529282 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f97ac015810 con 0x7f97b40aded0 2024-03-26T06:18:35.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.479+0000 7f97abe00640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f979406bbd0 0x7f979406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:35.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.479+0000 7f97abe00640 1 -- 172.21.15.63:0/1677529282 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f97ac08b8b0 con 0x7f97b40aded0 2024-03-26T06:18:35.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.479+0000 7f97b3e00640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f979406bbd0 0x7f979406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:35.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.479+0000 7f97b3e00640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f979406bbd0 0x7f979406e090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009bc0 tx=0x7f97a4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:35.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.483+0000 7f97abe00640 1 -- 172.21.15.63:0/1677529282 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f97ac019030 con 0x7f97b40aded0 2024-03-26T06:18:35.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:35.730+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f97b41f2610 con 0x7f97b40aded0 2024-03-26T06:18:36.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.354+0000 7f97abe00640 1 -- 172.21.15.63:0/1677529282 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f97ac010040 con 0x7f97b40aded0 2024-03-26T06:18:36.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.358+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f979406bbd0 msgr2=0x7f979406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.358+0000 7f97bb200640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f979406bbd0 0x7f979406e090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009bc0 tx=0x7f97a4009190 comp rx=0 tx=0).stop 2024-03-26T06:18:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.358+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b40aded0 msgr2=0x7f97b40ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.358+0000 7f97bb200640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b40aded0 0x7f97b40ae350 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f97b40b4d00 tx=0x7f97ac00f1b0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.359+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 shutdown_connections 2024-03-26T06:18:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.359+0000 7f97bb200640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f979406bbd0 0x7f979406e090 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.359+0000 7f97bb200640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b40aded0 0x7f97b40ae350 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.359+0000 7f97bb200640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b4144b80 0x7f97b4145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.359+0000 7f97bb200640 1 --2- 172.21.15.63:0/1677529282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9798006a10 0x7f97b4158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.359+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 >> 172.21.15.63:0/1677529282 conn(0x7f97b406ac90 msgr2=0x7f97b4071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:36.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.359+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 shutdown_connections 2024-03-26T06:18:36.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.359+0000 7f97bb200640 1 -- 172.21.15.63:0/1677529282 wait complete. 2024-03-26T06:18:36.381 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-26T06:18:36.382 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-26T06:18:36.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.606+0000 7f556e000640 1 Processor -- start 2024-03-26T06:18:36.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.607+0000 7f556e000640 1 -- start start 2024-03-26T06:18:36.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.608+0000 7f556e000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55680b37c0 0x7f5568071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:36.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.608+0000 7f556e000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5568071680 0x7f556806d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:36.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f556e000640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5568165800 con 0x7f556815f740 2024-03-26T06:18:36.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f556e000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5568163170 con 0x7f55680b37c0 2024-03-26T06:18:36.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f556e000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5568165ac0 con 0x7f5568071680 2024-03-26T06:18:36.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f5567e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55680b37c0 0x7f5568071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:36.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f5567e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55680b37c0 0x7f5568071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39606/0 (socket says 172.21.15.63:39606) 2024-03-26T06:18:36.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f5567e00640 1 -- 172.21.15.63:0/2030324535 learned_addr learned my addr 172.21.15.63:0/2030324535 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f5567e00640 1 -- 172.21.15.63:0/2030324535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5568071680 msgr2=0x7f556806d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f5567e00640 1 --2- 172.21.15.63:0/2030324535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5568071680 0x7f556806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f5567e00640 1 -- 172.21.15.63:0/2030324535 >> v1:172.21.15.204:6789/0 conn(0x7f556815f740 legacy=0x7f556806ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.609+0000 7f5567e00640 1 -- 172.21.15.63:0/2030324535 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568165da0 con 0x7f55680b37c0 2024-03-26T06:18:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.610+0000 7f5567e00640 1 --2- 172.21.15.63:0/2030324535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55680b37c0 0x7f5568071140 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76e40b0d0fcc40b server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.611+0000 7f5567400640 1 -- 172.21.15.63:0/2030324535 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55540317c0 con 0x7f55680b37c0 2024-03-26T06:18:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.611+0000 7f5567400640 1 -- 172.21.15.63:0/2030324535 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5554037070 con 0x7f55680b37c0 2024-03-26T06:18:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.611+0000 7f5567400640 1 -- 172.21.15.63:0/2030324535 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554031b80 con 0x7f55680b37c0 2024-03-26T06:18:36.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.611+0000 7f556e000640 1 -- 172.21.15.63:0/2030324535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55680b37c0 msgr2=0x7f5568071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.611+0000 7f556e000640 1 --2- 172.21.15.63:0/2030324535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55680b37c0 0x7f5568071140 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402b860 comp rx=0 tx=0).stop 2024-03-26T06:18:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.611+0000 7f556e000640 1 -- 172.21.15.63:0/2030324535 shutdown_connections 2024-03-26T06:18:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.611+0000 7f556e000640 1 --2- 172.21.15.63:0/2030324535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5568071680 0x7f556806d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.611+0000 7f556e000640 1 --2- 172.21.15.63:0/2030324535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55680b37c0 0x7f5568071140 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.611+0000 7f556e000640 1 -- 172.21.15.63:0/2030324535 >> 172.21.15.63:0/2030324535 conn(0x7f55680670b0 msgr2=0x7f55680b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.612+0000 7f556e000640 1 -- 172.21.15.63:0/2030324535 shutdown_connections 2024-03-26T06:18:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.612+0000 7f556e000640 1 -- 172.21.15.63:0/2030324535 wait complete. 2024-03-26T06:18:36.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.613+0000 7f556e000640 1 Processor -- start 2024-03-26T06:18:36.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.613+0000 7f556e000640 1 -- start start 2024-03-26T06:18:36.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.614+0000 7f556e000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5568071680 0x7f55681635f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:36.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.614+0000 7f556e000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55680b37c0 0x7f5568163b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:36.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.614+0000 7f556e000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556815f740 0x7f55681f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:36.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.614+0000 7f556e000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5568166640 con 0x7f5568071680 2024-03-26T06:18:36.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.614+0000 7f556e000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5568166360 con 0x7f556815f740 2024-03-26T06:18:36.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.614+0000 7f556e000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556815fb20 con 0x7f55680b37c0 2024-03-26T06:18:36.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556cc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5568071680 0x7f55681635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556cc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5568071680 0x7f55681635f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39620/0 (socket says 172.21.15.63:39620) 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556cc00640 1 -- 172.21.15.63:0/3974308284 learned_addr learned my addr 172.21.15.63:0/3974308284 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556cc00640 1 -- 172.21.15.63:0/3974308284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55680b37c0 msgr2=0x7f5568163b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f5567e00640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55680b37c0 0x7f5568163b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556cc00640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55680b37c0 0x7f5568163b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556cc00640 1 -- 172.21.15.63:0/3974308284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556815f740 msgr2=0x7f55681f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556d600640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556815f740 0x7f55681f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556cc00640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556815f740 0x7f55681f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556cc00640 1 -- 172.21.15.63:0/3974308284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568164070 con 0x7f5568071680 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.615+0000 7f556d600640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556815f740 0x7f55681f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.616+0000 7f556cc00640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5568071680 0x7f55681635f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c430 tx=0x7f555c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.616+0000 7f5564c00640 1 -- 172.21.15.63:0/3974308284 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c011790 con 0x7f5568071680 2024-03-26T06:18:36.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.616+0000 7f5564c00640 1 -- 172.21.15.63:0/3974308284 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c017070 con 0x7f5568071680 2024-03-26T06:18:36.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.616+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55681642e0 con 0x7f5568071680 2024-03-26T06:18:36.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.616+0000 7f5564c00640 1 -- 172.21.15.63:0/3974308284 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c011bb0 con 0x7f5568071680 2024-03-26T06:18:36.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.616+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55681648a0 con 0x7f5568071680 2024-03-26T06:18:36.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.617+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556804f0c0 con 0x7f5568071680 2024-03-26T06:18:36.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.618+0000 7f5564c00640 1 -- 172.21.15.63:0/3974308284 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f555c01c460 con 0x7f5568071680 2024-03-26T06:18:36.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.619+0000 7f5564c00640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f554806bbd0 0x7f554806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:36.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.620+0000 7f5564c00640 1 -- 172.21.15.63:0/3974308284 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f555c08aa50 con 0x7f5568071680 2024-03-26T06:18:36.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.620+0000 7f5567e00640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f554806bbd0 0x7f554806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:36.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.620+0000 7f5567e00640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f554806bbd0 0x7f554806e090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5554036000 tx=0x7f5554008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:36.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.624+0000 7f5564c00640 1 -- 172.21.15.63:0/3974308284 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f555c0593b0 con 0x7f5568071680 2024-03-26T06:18:36.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:36.868+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f55680b0110 con 0x7f5568071680 2024-03-26T06:18:37.270 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T06:18:37.269+0000 7f4911600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-26T06:18:37.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.375+0000 7f5564c00640 1 -- 172.21.15.63:0/3974308284 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f555c058cb0 con 0x7f5568071680 2024-03-26T06:18:37.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f554806bbd0 msgr2=0x7f554806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:37.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f554806bbd0 0x7f554806e090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5554036000 tx=0x7f5554008030 comp rx=0 tx=0).stop 2024-03-26T06:18:37.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5568071680 msgr2=0x7f55681635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:37.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5568071680 0x7f55681635f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c430 tx=0x7f555c00c8f0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 shutdown_connections 2024-03-26T06:18:37.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f554806bbd0 0x7f554806e090 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556815f740 0x7f55681f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55680b37c0 0x7f5568163b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 --2- 172.21.15.63:0/3974308284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5568071680 0x7f55681635f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.379+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 >> 172.21.15.63:0/3974308284 conn(0x7f55680670b0 msgr2=0x7f55680738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:37.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.380+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 shutdown_connections 2024-03-26T06:18:37.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.380+0000 7f556e000640 1 -- 172.21.15.63:0/3974308284 wait complete. 2024-03-26T06:18:37.400 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-26T06:18:37.400 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:18:37.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.608+0000 7f316b200640 1 Processor -- start 2024-03-26T06:18:37.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.608+0000 7f316b200640 1 -- start start 2024-03-26T06:18:37.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.610+0000 7f316b200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f316c0b4c50 0x7f316c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:37.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.610+0000 7f316b200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c0cc070 con 0x7f316c0b5030 2024-03-26T06:18:37.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.610+0000 7f316b200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c15fde0 con 0x7f316c144b50 2024-03-26T06:18:37.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.610+0000 7f316b200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c1600c0 con 0x7f316c0b4c50 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3169400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f316c0b5030 0x7f316c15f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43402/0 (socket says 172.21.15.63:43402) 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3169400640 1 -- 172.21.15.63:0/378630071 learned_addr learned my addr 172.21.15.63:0/378630071 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3169e00640 1 --2- 172.21.15.63:0/378630071 >> v2:172.21.15.204:3300/0 conn(0x7f316c0b4c50 0x7f316c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066791558 0 0) 0x7f316c0cc070 con 0x7f316c0b5030 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3150003520 con 0x7f316c0b5030 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1093753725 0 0) 0x7f3150003520 con 0x7f316c0b5030 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 >> v2:172.21.15.204:3300/0 conn(0x7f316c0b4c50 msgr2=0x7f316c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3168a00640 1 --2- 172.21.15.63:0/378630071 >> v2:172.21.15.204:3300/0 conn(0x7f316c0b4c50 0x7f316c0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 >> v1:172.21.15.204:6789/0 conn(0x7f316c144b50 legacy=0x7f316c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:37.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0cc310 con 0x7f316c0b5030 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f3158001670 con 0x7f316c0b5030 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.611+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 >> v1:172.21.15.63:6789/0 conn(0x7f316c0b5030 legacy=0x7f316c15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3168a00640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500039b0 0x7f3150003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3168a00640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3150004800 0x7f3150004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3168a00640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31500051c0 0x7f315000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c1600c0 con 0x7f31500039b0 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315000c070 con 0x7f3150004800 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315000c270 con 0x7f31500051c0 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3169e00640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500039b0 0x7f3150003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3169400640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3150004800 0x7f3150004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3169e00640 1 -- 172.21.15.63:0/378630071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31500051c0 msgr2=0x7f315000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3169e00640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31500051c0 0x7f315000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3169e00640 1 -- 172.21.15.63:0/378630071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3150004800 msgr2=0x7f3150004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:37.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3169e00640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3150004800 0x7f3150004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3169e00640 1 -- 172.21.15.63:0/378630071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150003520 con 0x7f31500039b0 2024-03-26T06:18:37.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f316a800640 1 -- 172.21.15.63:0/378630071 reap_dead start 2024-03-26T06:18:37.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.612+0000 7f3169400640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3150004800 0x7f3150004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:37.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.613+0000 7f3169e00640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500039b0 0x7f3150003dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f315c009ac0 tx=0x7f3150005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3536dc4874c0d6f server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c039070 con 0x7f31500039b0 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c02c6b0 con 0x7f31500039b0 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f3168a00640 1 -- 172.21.15.63:0/378630071 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c009690 con 0x7f31500039b0 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f316b200640 1 -- 172.21.15.63:0/378630071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500039b0 msgr2=0x7f3150003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f316b200640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500039b0 0x7f3150003dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f315c009ac0 tx=0x7f3150005830 comp rx=0 tx=0).stop 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f316b200640 1 -- 172.21.15.63:0/378630071 shutdown_connections 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f316b200640 1 --2- 172.21.15.63:0/378630071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500039b0 0x7f3150003dd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f316b200640 1 -- 172.21.15.63:0/378630071 >> 172.21.15.63:0/378630071 conn(0x7f316c0b13d0 msgr2=0x7f316c0b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f316b200640 1 -- 172.21.15.63:0/378630071 shutdown_connections 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.614+0000 7f316b200640 1 -- 172.21.15.63:0/378630071 wait complete. 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.616+0000 7f316b200640 1 Processor -- start 2024-03-26T06:18:37.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.617+0000 7f316b200640 1 -- start start 2024-03-26T06:18:37.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.617+0000 7f316b200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500039b0 0x7f316c0c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.617+0000 7f316b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f316c0c7710 0x7f316c13e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f316b200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f316c142a70 0x7f316c142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f316b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0ccaf0 con 0x7f316c0c7710 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f316b200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c06eb70 con 0x7f31500039b0 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f316b200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0ccc70 con 0x7f316c142a70 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f316c0c7710 0x7f316c13e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f316c0c7710 0x7f316c13e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39634/0 (socket says 172.21.15.63:39634) 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169400640 1 -- 172.21.15.63:0/4225848647 learned_addr learned my addr 172.21.15.63:0/4225848647 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169e00640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500039b0 0x7f316c0c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f316a800640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f316c142a70 0x7f316c142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169400640 1 -- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f316c142a70 msgr2=0x7f316c142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169400640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f316c142a70 0x7f316c142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169400640 1 -- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500039b0 msgr2=0x7f316c0c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169400640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500039b0 0x7f316c0c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169400640 1 -- 172.21.15.63:0/4225848647 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0c5800 con 0x7f316c0c7710 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f316a800640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f316c142a70 0x7f316c142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.618+0000 7f3169e00640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500039b0 0x7f316c0c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.619+0000 7f3169400640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f316c0c7710 0x7f316c13e990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f315800d830 tx=0x7f315800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.619+0000 7f3162000640 1 -- 172.21.15.63:0/4225848647 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158019070 con 0x7f316c0c7710 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.619+0000 7f3162000640 1 -- 172.21.15.63:0/4225848647 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31580074e0 con 0x7f316c0c7710 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.619+0000 7f3162000640 1 -- 172.21.15.63:0/4225848647 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31580049e0 con 0x7f316c0c7710 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.619+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c0c5ae0 con 0x7f316c0c7710 2024-03-26T06:18:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.619+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c0c60a0 con 0x7f316c0c7710 2024-03-26T06:18:37.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.620+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c143430 con 0x7f316c0c7710 2024-03-26T06:18:37.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.622+0000 7f3162000640 1 -- 172.21.15.63:0/4225848647 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f315801c070 con 0x7f316c0c7710 2024-03-26T06:18:37.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.623+0000 7f3162000640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f314c06bbd0 0x7f314c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:37.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.623+0000 7f3162000640 1 -- 172.21.15.63:0/4225848647 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f315808a580 con 0x7f316c0c7710 2024-03-26T06:18:37.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.623+0000 7f3169e00640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f314c06bbd0 0x7f314c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:37.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.624+0000 7f3169e00640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f314c06bbd0 0x7f314c06e090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f315c036000 tx=0x7f315c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:37.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.628+0000 7f3162000640 1 -- 172.21.15.63:0/4225848647 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f3158058f70 con 0x7f316c0c7710 2024-03-26T06:18:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.864+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f316c04f050 con 0x7f316c0c7710 2024-03-26T06:18:37.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.865+0000 7f3162000640 1 -- 172.21.15.63:0/4225848647 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f3158058870 con 0x7f316c0c7710 2024-03-26T06:18:37.865 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:37.865 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1772404724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1772404724},{"type":"v1","addr":"172.21.15.63:6835","nonce":1772404724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/3684234118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3684234118},{"type":"v1","addr":"172.21.15.204:6834","nonce":3684234118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4179978388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4179978388},{"type":"v1","addr":"172.21.15.204:6835","nonce":4179978388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:18:33.792118+0000","modified":"2024-03-26T06:18:36.869843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6837/2819968553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":2819968553},{"type":"v1","addr":"172.21.15.63:6837","nonce":2819968553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-26T06:18:37.865 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 18 2024-03-26T06:18:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f314c06bbd0 msgr2=0x7f314c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f314c06bbd0 0x7f314c06e090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f315c036000 tx=0x7f315c030000 comp rx=0 tx=0).stop 2024-03-26T06:18:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f316c0c7710 msgr2=0x7f316c13e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f316c0c7710 0x7f316c13e990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f315800d830 tx=0x7f315800dcf0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 shutdown_connections 2024-03-26T06:18:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f314c06bbd0 0x7f314c06e090 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f316c142a70 0x7f316c142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f316c0c7710 0x7f316c13e990 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 --2- 172.21.15.63:0/4225848647 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500039b0 0x7f316c0c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.867+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 >> 172.21.15.63:0/4225848647 conn(0x7f316c0b13d0 msgr2=0x7f316c15d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.868+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 shutdown_connections 2024-03-26T06:18:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:37.868+0000 7f316b200640 1 -- 172.21.15.63:0/4225848647 wait complete. 2024-03-26T06:18:37.886 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T06:18:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.098+0000 7fc7b1000640 1 Processor -- start 2024-03-26T06:18:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.099+0000 7fc7b1000640 1 -- start start 2024-03-26T06:18:38.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.100+0000 7fc7b1000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac0b4380 0x7fc7ac0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.100+0000 7fc7b1000640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc7ac0ce860 0x7fc7ac15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.100+0000 7fc7b1000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ac0b5000 con 0x7fc7ac066eb0 2024-03-26T06:18:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.100+0000 7fc7b1000640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac15cd10 con 0x7fc7ac0ce860 2024-03-26T06:18:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.100+0000 7fc7b1000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac0b4ca0 con 0x7fc7ac0b4380 2024-03-26T06:18:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.101+0000 7fc7aaa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc7ac066eb0 0x7fc7ac15f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43412/0 (socket says 172.21.15.63:43412) 2024-03-26T06:18:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.101+0000 7fc7aaa00640 1 -- 172.21.15.63:0/63543055 learned_addr learned my addr 172.21.15.63:0/63543055 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.101+0000 7fc7ab400640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac0b4380 0x7fc7ac0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.101+0000 7fc7abe00640 1 --2- 172.21.15.63:0/63543055 >> v2:172.21.15.204:3300/0 conn(0x7fc7ac0ce860 0x7fc7ac15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.101+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150623800 0 0) 0x7fc7ac0b5000 con 0x7fc7ac066eb0 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.101+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc790003520 con 0x7fc7ac066eb0 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2974204011 0 0) 0x7fc790003520 con 0x7fc7ac066eb0 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac0b4380 msgr2=0x7fc7ac0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac0b4380 0x7fc7ac0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 >> v2:172.21.15.204:3300/0 conn(0x7fc7ac0ce860 msgr2=0x7fc7ac15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 --2- 172.21.15.63:0/63543055 >> v2:172.21.15.204:3300/0 conn(0x7fc7ac0ce860 0x7fc7ac15faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac15ca30 con 0x7fc7ac066eb0 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fc798001670 con 0x7fc7ac066eb0 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 >> v1:172.21.15.63:6789/0 conn(0x7fc7ac066eb0 legacy=0x7fc7ac15f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac0b4380 0x7fc7900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc790003f30 0x7fc790004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790004d40 0x7fc7900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac15cd10 con 0x7fc790003f30 2024-03-26T06:18:38.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac0b4ca0 con 0x7fc790004d40 2024-03-26T06:18:38.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79000ba10 con 0x7fc7ac0b4380 2024-03-26T06:18:38.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.102+0000 7fc7aaa00640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc790003f30 0x7fc790004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.103+0000 7fc7abe00640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790004d40 0x7fc7900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.103+0000 7fc7aaa00640 1 -- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac0b4380 msgr2=0x7fc7900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:38.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.103+0000 7fc7aaa00640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac0b4380 0x7fc7900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.103+0000 7fc7aaa00640 1 -- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790004d40 msgr2=0x7fc7900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.103+0000 7fc7aaa00640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790004d40 0x7fc7900051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.103+0000 7fc7aaa00640 1 -- 172.21.15.63:0/63543055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc790003520 con 0x7fc790003f30 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.104+0000 7fc7aaa00640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc790003f30 0x7fc790004800 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc79800c240 tx=0x7fc790005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fefce4771fb86b server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.104+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc798007d50 con 0x7fc790003f30 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.104+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc798030070 con 0x7fc790003f30 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.104+0000 7fc7aa000640 1 -- 172.21.15.63:0/63543055 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79802cdc0 con 0x7fc790003f30 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.105+0000 7fc7b1000640 1 -- 172.21.15.63:0/63543055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc790003f30 msgr2=0x7fc790004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.105+0000 7fc7b1000640 1 --2- 172.21.15.63:0/63543055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc790003f30 0x7fc790004800 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc79800c240 tx=0x7fc790005830 comp rx=0 tx=0).stop 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.105+0000 7fc7abe00640 1 -- 172.21.15.63:0/63543055 reap_dead start 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.105+0000 7fc7b1000640 1 -- 172.21.15.63:0/63543055 shutdown_connections 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.105+0000 7fc7b1000640 1 -- 172.21.15.63:0/63543055 >> 172.21.15.63:0/63543055 conn(0x7fc7ac0cfc80 msgr2=0x7fc7ac0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.105+0000 7fc7b1000640 1 -- 172.21.15.63:0/63543055 shutdown_connections 2024-03-26T06:18:38.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.105+0000 7fc7b1000640 1 -- 172.21.15.63:0/63543055 wait complete. 2024-03-26T06:18:38.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.107+0000 7fc7b1000640 1 Processor -- start 2024-03-26T06:18:38.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.107+0000 7fc7b1000640 1 -- start start 2024-03-26T06:18:38.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.108+0000 7fc7b1000640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790003f30 0x7fc7ac06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.108+0000 7fc7b1000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac154cb0 0x7fc7ac06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.108+0000 7fc7b1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7ac1485f0 0x7fc7ac15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.108+0000 7fc7b1000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac15bb70 con 0x7fc7ac1485f0 2024-03-26T06:18:38.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.108+0000 7fc7b1000640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac0cf630 con 0x7fc790003f30 2024-03-26T06:18:38.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.108+0000 7fc7b1000640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac066a20 con 0x7fc7ac154cb0 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.108+0000 7fc7abe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7ac1485f0 0x7fc7ac15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.108+0000 7fc7abe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7ac1485f0 0x7fc7ac15bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39650/0 (socket says 172.21.15.63:39650) 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.108+0000 7fc7abe00640 1 -- 172.21.15.63:0/1650352150 learned_addr learned my addr 172.21.15.63:0/1650352150 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7ab400640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790003f30 0x7fc7ac06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7aaa00640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac154cb0 0x7fc7ac06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7abe00640 1 -- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac154cb0 msgr2=0x7fc7ac06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7abe00640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac154cb0 0x7fc7ac06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7abe00640 1 -- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790003f30 msgr2=0x7fc7ac06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7abe00640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790003f30 0x7fc7ac06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7abe00640 1 -- 172.21.15.63:0/1650352150 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac06e110 con 0x7fc7ac1485f0 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7aaa00640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac154cb0 0x7fc7ac06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7ab400640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790003f30 0x7fc7ac06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7abe00640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7ac1485f0 0x7fc7ac15bcf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac070460 tx=0x7fc7a400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7a3400640 1 -- 172.21.15.63:0/1650352150 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4016620 con 0x7fc7ac1485f0 2024-03-26T06:18:38.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7a3400640 1 -- 172.21.15.63:0/1650352150 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a401b070 con 0x7fc7ac1485f0 2024-03-26T06:18:38.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7a3400640 1 -- 172.21.15.63:0/1650352150 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4016a20 con 0x7fc7ac1485f0 2024-03-26T06:18:38.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ac06e3f0 con 0x7fc7ac1485f0 2024-03-26T06:18:38.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.109+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ac06e9b0 con 0x7fc7ac1485f0 2024-03-26T06:18:38.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.111+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ac04f050 con 0x7fc7ac1485f0 2024-03-26T06:18:38.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.111+0000 7fc7a3400640 1 -- 172.21.15.63:0/1650352150 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc7a4005d10 con 0x7fc7ac1485f0 2024-03-26T06:18:38.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.112+0000 7fc7a3400640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc78c06bbd0 0x7fc78c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.112+0000 7fc7a3400640 1 -- 172.21.15.63:0/1650352150 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc7a408b480 con 0x7fc7ac1485f0 2024-03-26T06:18:38.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.113+0000 7fc7ab400640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc78c06bbd0 0x7fc78c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.113+0000 7fc7ab400640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc78c06bbd0 0x7fc78c06e090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc79c006ce0 tx=0x7fc79c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:38.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.117+0000 7fc7a3400640 1 -- 172.21.15.63:0/1650352150 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc7a4024020 con 0x7fc7ac1485f0 2024-03-26T06:18:38.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.317+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7ac157da0 con 0x7fc7ac1485f0 2024-03-26T06:18:38.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.321+0000 7fc7a3400640 1 -- 172.21.15.63:0/1650352150 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16954 (secure 0 0 0) 0x7fc7a4059d40 con 0x7fc7ac1485f0 2024-03-26T06:18:38.321 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:38.322 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":39,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T06:18:35.340002+0000","last_up_change":"2024-03-26T06:16:46.252830+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:18:31.934065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-26T06:18:32.820259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists","up"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T06:18:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.323+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc78c06bbd0 msgr2=0x7fc78c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.323+0000 7fc7b1000640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc78c06bbd0 0x7fc78c06e090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc79c006ce0 tx=0x7fc79c008040 comp rx=0 tx=0).stop 2024-03-26T06:18:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.323+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7ac1485f0 msgr2=0x7fc7ac15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.323+0000 7fc7b1000640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7ac1485f0 0x7fc7ac15bcf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac070460 tx=0x7fc7a400f520 comp rx=0 tx=0).stop 2024-03-26T06:18:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.324+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 shutdown_connections 2024-03-26T06:18:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.324+0000 7fc7b1000640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc78c06bbd0 0x7fc78c06e090 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.324+0000 7fc7b1000640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7ac1485f0 0x7fc7ac15bcf0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.324+0000 7fc7b1000640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7ac154cb0 0x7fc7ac06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.324+0000 7fc7b1000640 1 --2- 172.21.15.63:0/1650352150 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc790003f30 0x7fc7ac06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.324+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 >> 172.21.15.63:0/1650352150 conn(0x7fc7ac0cfc80 msgr2=0x7fc7ac15e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.324+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 shutdown_connections 2024-03-26T06:18:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.324+0000 7fc7b1000640 1 -- 172.21.15.63:0/1650352150 wait complete. 2024-03-26T06:18:38.345 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-26T06:18:38.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-26T06:18:38.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.568+0000 7faf9be00640 1 Processor -- start 2024-03-26T06:18:38.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.569+0000 7faf9be00640 1 -- start start 2024-03-26T06:18:38.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.570+0000 7faf9be00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faf9c0d1c10 0x7faf9c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.570+0000 7faf9be00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c0d3250 0x7faf9c0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.570+0000 7faf9be00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c0d21b0 con 0x7faf9c15d9a0 2024-03-26T06:18:38.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.570+0000 7faf9be00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c0d2490 con 0x7faf9c0d1c10 2024-03-26T06:18:38.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.570+0000 7faf9be00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0d2770 con 0x7faf9c0d3250 2024-03-26T06:18:38.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.571+0000 7faf9b400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c0d3250 0x7faf9c0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.571+0000 7faf9b400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c0d3250 0x7faf9c0cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:59244/0 (socket says 172.21.15.63:59244) 2024-03-26T06:18:38.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.571+0000 7faf9b400640 1 -- 172.21.15.63:0/2205995177 learned_addr learned my addr 172.21.15.63:0/2205995177 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:38.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.571+0000 7faf9a000640 1 --2- 172.21.15.63:0/2205995177 >> v2:172.21.15.204:3300/0 conn(0x7faf9c0d1c10 0x7faf9c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.572+0000 7faf9b400640 1 -- 172.21.15.63:0/2205995177 >> v2:172.21.15.204:3300/0 conn(0x7faf9c0d1c10 msgr2=0x7faf9c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:38.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.572+0000 7faf9b400640 1 --2- 172.21.15.63:0/2205995177 >> v2:172.21.15.204:3300/0 conn(0x7faf9c0d1c10 0x7faf9c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.572+0000 7faf9b400640 1 -- 172.21.15.63:0/2205995177 >> v1:172.21.15.204:6789/0 conn(0x7faf9c15d9a0 legacy=0x7faf9c0b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.572+0000 7faf9b400640 1 -- 172.21.15.63:0/2205995177 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0d2a50 con 0x7faf9c0d3250 2024-03-26T06:18:38.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.573+0000 7faf9b400640 1 --2- 172.21.15.63:0/2205995177 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c0d3250 0x7faf9c0cea50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf94009e50 tx=0x7faf9402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917811067d6da023 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:38.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.574+0000 7faf99600640 1 -- 172.21.15.63:0/2205995177 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9402cb00 con 0x7faf9c0d3250 2024-03-26T06:18:38.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.574+0000 7faf99600640 1 -- 172.21.15.63:0/2205995177 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9402cca0 con 0x7faf9c0d3250 2024-03-26T06:18:38.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.574+0000 7faf99600640 1 -- 172.21.15.63:0/2205995177 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94034610 con 0x7faf9c0d3250 2024-03-26T06:18:38.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.575+0000 7faf9be00640 1 -- 172.21.15.63:0/2205995177 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c0d3250 msgr2=0x7faf9c0cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.575+0000 7faf9be00640 1 --2- 172.21.15.63:0/2205995177 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c0d3250 0x7faf9c0cea50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf94009e50 tx=0x7faf9402bf60 comp rx=0 tx=0).stop 2024-03-26T06:18:38.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.575+0000 7faf9be00640 1 -- 172.21.15.63:0/2205995177 shutdown_connections 2024-03-26T06:18:38.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.575+0000 7faf9be00640 1 --2- 172.21.15.63:0/2205995177 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c0d3250 0x7faf9c0cea50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.575+0000 7faf9be00640 1 --2- 172.21.15.63:0/2205995177 >> v2:172.21.15.204:3300/0 conn(0x7faf9c0d1c10 0x7faf9c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.575+0000 7faf9be00640 1 -- 172.21.15.63:0/2205995177 >> 172.21.15.63:0/2205995177 conn(0x7faf9c06bfa0 msgr2=0x7faf9c06c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:38.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.575+0000 7faf9be00640 1 -- 172.21.15.63:0/2205995177 shutdown_connections 2024-03-26T06:18:38.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.575+0000 7faf9be00640 1 -- 172.21.15.63:0/2205995177 wait complete. 2024-03-26T06:18:38.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.577+0000 7faf9be00640 1 Processor -- start 2024-03-26T06:18:38.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.577+0000 7faf9be00640 1 -- start start 2024-03-26T06:18:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9be00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf9c0d1c10 0x7faf9c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0d3250 0x7faf9c14cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9be00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c15d9a0 0x7faf9c1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0b6970 con 0x7faf9c0d3250 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9be00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c15dd80 con 0x7faf9c0d1c10 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9be00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0b6af0 con 0x7faf9c15d9a0 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0d3250 0x7faf9c14cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0d3250 0x7faf9c14cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39666/0 (socket says 172.21.15.63:39666) 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9a000640 1 -- 172.21.15.63:0/4291221744 learned_addr learned my addr 172.21.15.63:0/4291221744 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9b400640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c15d9a0 0x7faf9c1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9aa00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf9c0d1c10 0x7faf9c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9a000640 1 -- 172.21.15.63:0/4291221744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c15d9a0 msgr2=0x7faf9c1600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9a000640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c15d9a0 0x7faf9c1600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9a000640 1 -- 172.21.15.63:0/4291221744 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf9c0d1c10 msgr2=0x7faf9c0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9a000640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf9c0d1c10 0x7faf9c0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9a000640 1 -- 172.21.15.63:0/4291221744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c14d2b0 con 0x7faf9c0d3250 2024-03-26T06:18:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.578+0000 7faf9aa00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf9c0d1c10 0x7faf9c0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.579+0000 7faf9a000640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0d3250 0x7faf9c14cd70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faf8800e9e0 tx=0x7faf8800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.579+0000 7faf92a00640 1 -- 172.21.15.63:0/4291221744 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88017070 con 0x7faf9c0d3250 2024-03-26T06:18:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.579+0000 7faf92a00640 1 -- 172.21.15.63:0/4291221744 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8800c9d0 con 0x7faf9c0d3250 2024-03-26T06:18:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.579+0000 7faf92a00640 1 -- 172.21.15.63:0/4291221744 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8800cdc0 con 0x7faf9c0d3250 2024-03-26T06:18:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.579+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c0b32a0 con 0x7faf9c0d3250 2024-03-26T06:18:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.579+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c0b3860 con 0x7faf9c0d3250 2024-03-26T06:18:38.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.580+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c04f050 con 0x7faf9c0d3250 2024-03-26T06:18:38.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.582+0000 7faf92a00640 1 -- 172.21.15.63:0/4291221744 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7faf8801a070 con 0x7faf9c0d3250 2024-03-26T06:18:38.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.582+0000 7faf92a00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf7c06bc00 0x7faf7c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:38.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.583+0000 7faf92a00640 1 -- 172.21.15.63:0/4291221744 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf8808ac90 con 0x7faf9c0d3250 2024-03-26T06:18:38.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.583+0000 7faf9aa00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf7c06bc00 0x7faf7c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:38.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.583+0000 7faf9aa00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf7c06bc00 0x7faf7c06e0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faf8c000f60 tx=0x7faf8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:38.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.587+0000 7faf92a00640 1 -- 172.21.15.63:0/4291221744 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7faf88059550 con 0x7faf9c0d3250 2024-03-26T06:18:38.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.784+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 --> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf9c0d0910 con 0x7faf7c06bc00 2024-03-26T06:18:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.791+0000 7faf92a00640 1 -- 172.21.15.63:0/4291221744 <== mgr.4104 v2:172.21.15.63:6832/3591189670 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251963 (secure 0 0 0) 0x7faf9c0d0910 con 0x7faf7c06bc00 2024-03-26T06:18:38.796 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:38.797 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-03-26T06:18:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.796+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf7c06bc00 msgr2=0x7faf7c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.796+0000 7faf9be00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf7c06bc00 0x7faf7c06e0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faf8c000f60 tx=0x7faf8c009040 comp rx=0 tx=0).stop 2024-03-26T06:18:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.796+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0d3250 msgr2=0x7faf9c14cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.796+0000 7faf9be00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0d3250 0x7faf9c14cd70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faf8800e9e0 tx=0x7faf8800eea0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.797+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 shutdown_connections 2024-03-26T06:18:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.797+0000 7faf9be00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faf7c06bc00 0x7faf7c06e0c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.797+0000 7faf9be00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9c15d9a0 0x7faf9c1600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.797+0000 7faf9be00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0d3250 0x7faf9c14cd70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.797+0000 7faf9be00640 1 --2- 172.21.15.63:0/4291221744 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf9c0d1c10 0x7faf9c0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.797+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 >> 172.21.15.63:0/4291221744 conn(0x7faf9c06bfa0 msgr2=0x7faf9c0ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.797+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 shutdown_connections 2024-03-26T06:18:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:38.797+0000 7faf9be00640 1 -- 172.21.15.63:0/4291221744 wait complete. 2024-03-26T06:18:38.817 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-03-26T06:18:37.911394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220952,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753768,"statfs":{"total":773094113280,"available":772867858432,"internally_reserved":0,"allocated":4857856,"data_stored":2743148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.619383"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360654+0000","last_change":"2024-03-26T06:18:34.351458+0000","last_active":"2024-03-26T06:18:35.360654+0000","last_peered":"2024-03-26T06:18:35.360654+0000","last_clean":"2024-03-26T06:18:35.360654+0000","last_became_active":"2024-03-26T06:18:34.351151+0000","last_became_peered":"2024-03-26T06:18:34.351151+0000","last_unstale":"2024-03-26T06:18:35.360654+0000","last_undegraded":"2024-03-26T06:18:35.360654+0000","last_fullsized":"2024-03-26T06:18:35.360654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:07:00.672278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360285+0000","last_change":"2024-03-26T06:18:34.349263+0000","last_active":"2024-03-26T06:18:35.360285+0000","last_peered":"2024-03-26T06:18:35.360285+0000","last_clean":"2024-03-26T06:18:35.360285+0000","last_became_active":"2024-03-26T06:18:34.348940+0000","last_became_peered":"2024-03-26T06:18:34.348940+0000","last_unstale":"2024-03-26T06:18:35.360285+0000","last_undegraded":"2024-03-26T06:18:35.360285+0000","last_fullsized":"2024-03-26T06:18:35.360285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:08:37.987374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719152+0000","last_change":"2024-03-26T06:18:34.346527+0000","last_active":"2024-03-26T06:18:35.719152+0000","last_peered":"2024-03-26T06:18:35.719152+0000","last_clean":"2024-03-26T06:18:35.719152+0000","last_became_active":"2024-03-26T06:18:34.346236+0000","last_became_peered":"2024-03-26T06:18:34.346236+0000","last_unstale":"2024-03-26T06:18:35.719152+0000","last_undegraded":"2024-03-26T06:18:35.719152+0000","last_fullsized":"2024-03-26T06:18:35.719152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:42:24.150719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356334+0000","last_change":"2024-03-26T06:18:34.353364+0000","last_active":"2024-03-26T06:18:35.356334+0000","last_peered":"2024-03-26T06:18:35.356334+0000","last_clean":"2024-03-26T06:18:35.356334+0000","last_became_active":"2024-03-26T06:18:34.353081+0000","last_became_peered":"2024-03-26T06:18:34.353081+0000","last_unstale":"2024-03-26T06:18:35.356334+0000","last_undegraded":"2024-03-26T06:18:35.356334+0000","last_fullsized":"2024-03-26T06:18:35.356334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:22:35.734017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356061+0000","last_change":"2024-03-26T06:18:34.363234+0000","last_active":"2024-03-26T06:18:35.356061+0000","last_peered":"2024-03-26T06:18:35.356061+0000","last_clean":"2024-03-26T06:18:35.356061+0000","last_became_active":"2024-03-26T06:18:34.362958+0000","last_became_peered":"2024-03-26T06:18:34.362958+0000","last_unstale":"2024-03-26T06:18:35.356061+0000","last_undegraded":"2024-03-26T06:18:35.356061+0000","last_fullsized":"2024-03-26T06:18:35.356061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T17:10:25.740858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615142+0000","last_change":"2024-03-26T06:18:34.350405+0000","last_active":"2024-03-26T06:18:35.615142+0000","last_peered":"2024-03-26T06:18:35.615142+0000","last_clean":"2024-03-26T06:18:35.615142+0000","last_became_active":"2024-03-26T06:18:34.350118+0000","last_became_peered":"2024-03-26T06:18:34.350118+0000","last_unstale":"2024-03-26T06:18:35.615142+0000","last_undegraded":"2024-03-26T06:18:35.615142+0000","last_fullsized":"2024-03-26T06:18:35.615142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:40:17.916180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721820+0000","last_change":"2024-03-26T06:18:34.356735+0000","last_active":"2024-03-26T06:18:35.721820+0000","last_peered":"2024-03-26T06:18:35.721820+0000","last_clean":"2024-03-26T06:18:35.721820+0000","last_became_active":"2024-03-26T06:18:34.355211+0000","last_became_peered":"2024-03-26T06:18:34.355211+0000","last_unstale":"2024-03-26T06:18:35.721820+0000","last_undegraded":"2024-03-26T06:18:35.721820+0000","last_fullsized":"2024-03-26T06:18:35.721820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:47:07.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359807+0000","last_change":"2024-03-26T06:18:34.350596+0000","last_active":"2024-03-26T06:18:35.359807+0000","last_peered":"2024-03-26T06:18:35.359807+0000","last_clean":"2024-03-26T06:18:35.359807+0000","last_became_active":"2024-03-26T06:18:34.349766+0000","last_became_peered":"2024-03-26T06:18:34.349766+0000","last_unstale":"2024-03-26T06:18:35.359807+0000","last_undegraded":"2024-03-26T06:18:35.359807+0000","last_fullsized":"2024-03-26T06:18:35.359807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:48:52.836101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719657+0000","last_change":"2024-03-26T06:18:34.346719+0000","last_active":"2024-03-26T06:18:35.719657+0000","last_peered":"2024-03-26T06:18:35.719657+0000","last_clean":"2024-03-26T06:18:35.719657+0000","last_became_active":"2024-03-26T06:18:34.345772+0000","last_became_peered":"2024-03-26T06:18:34.345772+0000","last_unstale":"2024-03-26T06:18:35.719657+0000","last_undegraded":"2024-03-26T06:18:35.719657+0000","last_fullsized":"2024-03-26T06:18:35.719657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:38:32.046892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722965+0000","last_change":"2024-03-26T06:18:34.360259+0000","last_active":"2024-03-26T06:18:35.722965+0000","last_peered":"2024-03-26T06:18:35.722965+0000","last_clean":"2024-03-26T06:18:35.722965+0000","last_became_active":"2024-03-26T06:18:34.358462+0000","last_became_peered":"2024-03-26T06:18:34.358462+0000","last_unstale":"2024-03-26T06:18:35.722965+0000","last_undegraded":"2024-03-26T06:18:35.722965+0000","last_fullsized":"2024-03-26T06:18:35.722965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:48:52.836101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724381+0000","last_change":"2024-03-26T06:18:34.351415+0000","last_active":"2024-03-26T06:18:35.724381+0000","last_peered":"2024-03-26T06:18:35.724381+0000","last_clean":"2024-03-26T06:18:35.724381+0000","last_became_active":"2024-03-26T06:18:34.351068+0000","last_became_peered":"2024-03-26T06:18:34.351068+0000","last_unstale":"2024-03-26T06:18:35.724381+0000","last_undegraded":"2024-03-26T06:18:35.724381+0000","last_fullsized":"2024-03-26T06:18:35.724381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:30:33.033135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719034+0000","last_change":"2024-03-26T06:18:34.336864+0000","last_active":"2024-03-26T06:18:35.719034+0000","last_peered":"2024-03-26T06:18:35.719034+0000","last_clean":"2024-03-26T06:18:35.719034+0000","last_became_active":"2024-03-26T06:18:34.336339+0000","last_became_peered":"2024-03-26T06:18:34.336339+0000","last_unstale":"2024-03-26T06:18:35.719034+0000","last_undegraded":"2024-03-26T06:18:35.719034+0000","last_fullsized":"2024-03-26T06:18:35.719034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:40:17.916180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722283+0000","last_change":"2024-03-26T06:18:34.374274+0000","last_active":"2024-03-26T06:18:35.722283+0000","last_peered":"2024-03-26T06:18:35.722283+0000","last_clean":"2024-03-26T06:18:35.722283+0000","last_became_active":"2024-03-26T06:18:34.373940+0000","last_became_peered":"2024-03-26T06:18:34.373940+0000","last_unstale":"2024-03-26T06:18:35.722283+0000","last_undegraded":"2024-03-26T06:18:35.722283+0000","last_fullsized":"2024-03-26T06:18:35.722283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:35:51.852379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721022+0000","last_change":"2024-03-26T06:18:34.370776+0000","last_active":"2024-03-26T06:18:35.721022+0000","last_peered":"2024-03-26T06:18:35.721022+0000","last_clean":"2024-03-26T06:18:35.721022+0000","last_became_active":"2024-03-26T06:18:34.370466+0000","last_became_peered":"2024-03-26T06:18:34.370466+0000","last_unstale":"2024-03-26T06:18:35.721022+0000","last_undegraded":"2024-03-26T06:18:35.721022+0000","last_fullsized":"2024-03-26T06:18:35.721022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:40:17.916180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722253+0000","last_change":"2024-03-26T06:18:34.343171+0000","last_active":"2024-03-26T06:18:35.722253+0000","last_peered":"2024-03-26T06:18:35.722253+0000","last_clean":"2024-03-26T06:18:35.722253+0000","last_became_active":"2024-03-26T06:18:34.342579+0000","last_became_peered":"2024-03-26T06:18:34.342579+0000","last_unstale":"2024-03-26T06:18:35.722253+0000","last_undegraded":"2024-03-26T06:18:35.722253+0000","last_fullsized":"2024-03-26T06:18:35.722253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:46:07.921912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719925+0000","last_change":"2024-03-26T06:18:34.372899+0000","last_active":"2024-03-26T06:18:35.719925+0000","last_peered":"2024-03-26T06:18:35.719925+0000","last_clean":"2024-03-26T06:18:35.719925+0000","last_became_active":"2024-03-26T06:18:34.372459+0000","last_became_peered":"2024-03-26T06:18:34.372459+0000","last_unstale":"2024-03-26T06:18:35.719925+0000","last_undegraded":"2024-03-26T06:18:35.719925+0000","last_fullsized":"2024-03-26T06:18:35.719925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:33:18.385735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723867+0000","last_change":"2024-03-26T06:18:34.372418+0000","last_active":"2024-03-26T06:18:35.723867+0000","last_peered":"2024-03-26T06:18:35.723867+0000","last_clean":"2024-03-26T06:18:35.723867+0000","last_became_active":"2024-03-26T06:18:34.366192+0000","last_became_peered":"2024-03-26T06:18:34.366192+0000","last_unstale":"2024-03-26T06:18:35.723867+0000","last_undegraded":"2024-03-26T06:18:35.723867+0000","last_fullsized":"2024-03-26T06:18:35.723867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:35:51.852379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360543+0000","last_change":"2024-03-26T06:18:34.371170+0000","last_active":"2024-03-26T06:18:35.360543+0000","last_peered":"2024-03-26T06:18:35.360543+0000","last_clean":"2024-03-26T06:18:35.360543+0000","last_became_active":"2024-03-26T06:18:34.369779+0000","last_became_peered":"2024-03-26T06:18:34.369779+0000","last_unstale":"2024-03-26T06:18:35.360543+0000","last_undegraded":"2024-03-26T06:18:35.360543+0000","last_fullsized":"2024-03-26T06:18:35.360543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:49:35.732896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356415+0000","last_change":"2024-03-26T06:18:34.350434+0000","last_active":"2024-03-26T06:18:35.356415+0000","last_peered":"2024-03-26T06:18:35.356415+0000","last_clean":"2024-03-26T06:18:35.356415+0000","last_became_active":"2024-03-26T06:18:34.350113+0000","last_became_peered":"2024-03-26T06:18:34.350113+0000","last_unstale":"2024-03-26T06:18:35.356415+0000","last_undegraded":"2024-03-26T06:18:35.356415+0000","last_fullsized":"2024-03-26T06:18:35.356415+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:12.177098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360079+0000","last_change":"2024-03-26T06:18:34.370942+0000","last_active":"2024-03-26T06:18:35.360079+0000","last_peered":"2024-03-26T06:18:35.360079+0000","last_clean":"2024-03-26T06:18:35.360079+0000","last_became_active":"2024-03-26T06:18:34.370299+0000","last_became_peered":"2024-03-26T06:18:34.370299+0000","last_unstale":"2024-03-26T06:18:35.360079+0000","last_undegraded":"2024-03-26T06:18:35.360079+0000","last_fullsized":"2024-03-26T06:18:35.360079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:43:45.608182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722684+0000","last_change":"2024-03-26T06:18:34.352552+0000","last_active":"2024-03-26T06:18:35.722684+0000","last_peered":"2024-03-26T06:18:35.722684+0000","last_clean":"2024-03-26T06:18:35.722684+0000","last_became_active":"2024-03-26T06:18:34.352246+0000","last_became_peered":"2024-03-26T06:18:34.352246+0000","last_unstale":"2024-03-26T06:18:35.722684+0000","last_undegraded":"2024-03-26T06:18:35.722684+0000","last_fullsized":"2024-03-26T06:18:35.722684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:03:42.630810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721156+0000","last_change":"2024-03-26T06:18:34.359058+0000","last_active":"2024-03-26T06:18:35.721156+0000","last_peered":"2024-03-26T06:18:35.721156+0000","last_clean":"2024-03-26T06:18:35.721156+0000","last_became_active":"2024-03-26T06:18:34.358716+0000","last_became_peered":"2024-03-26T06:18:34.358716+0000","last_unstale":"2024-03-26T06:18:35.721156+0000","last_undegraded":"2024-03-26T06:18:35.721156+0000","last_fullsized":"2024-03-26T06:18:35.721156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:20:04.732332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721617+0000","last_change":"2024-03-26T06:18:34.355765+0000","last_active":"2024-03-26T06:18:35.721617+0000","last_peered":"2024-03-26T06:18:35.721617+0000","last_clean":"2024-03-26T06:18:35.721617+0000","last_became_active":"2024-03-26T06:18:34.355229+0000","last_became_peered":"2024-03-26T06:18:34.355229+0000","last_unstale":"2024-03-26T06:18:35.721617+0000","last_undegraded":"2024-03-26T06:18:35.721617+0000","last_fullsized":"2024-03-26T06:18:35.721617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T17:45:23.867318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.355907+0000","last_change":"2024-03-26T06:18:34.373691+0000","last_active":"2024-03-26T06:18:35.355907+0000","last_peered":"2024-03-26T06:18:35.355907+0000","last_clean":"2024-03-26T06:18:35.355907+0000","last_became_active":"2024-03-26T06:18:34.373394+0000","last_became_peered":"2024-03-26T06:18:34.373394+0000","last_unstale":"2024-03-26T06:18:35.355907+0000","last_undegraded":"2024-03-26T06:18:35.355907+0000","last_fullsized":"2024-03-26T06:18:35.355907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:16:16.596994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360557+0000","last_change":"2024-03-26T06:18:34.367051+0000","last_active":"2024-03-26T06:18:35.360557+0000","last_peered":"2024-03-26T06:18:35.360557+0000","last_clean":"2024-03-26T06:18:35.360557+0000","last_became_active":"2024-03-26T06:18:34.366569+0000","last_became_peered":"2024-03-26T06:18:34.366569+0000","last_unstale":"2024-03-26T06:18:35.360557+0000","last_undegraded":"2024-03-26T06:18:35.360557+0000","last_fullsized":"2024-03-26T06:18:35.360557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:01:22.281107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615942+0000","last_change":"2024-03-26T06:18:34.351342+0000","last_active":"2024-03-26T06:18:35.615942+0000","last_peered":"2024-03-26T06:18:35.615942+0000","last_clean":"2024-03-26T06:18:35.615942+0000","last_became_active":"2024-03-26T06:18:34.349696+0000","last_became_peered":"2024-03-26T06:18:34.349696+0000","last_unstale":"2024-03-26T06:18:35.615942+0000","last_undegraded":"2024-03-26T06:18:35.615942+0000","last_fullsized":"2024-03-26T06:18:35.615942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:33:18.385735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360442+0000","last_change":"2024-03-26T06:18:34.365010+0000","last_active":"2024-03-26T06:18:35.360442+0000","last_peered":"2024-03-26T06:18:35.360442+0000","last_clean":"2024-03-26T06:18:35.360442+0000","last_became_active":"2024-03-26T06:18:34.364707+0000","last_became_peered":"2024-03-26T06:18:34.364707+0000","last_unstale":"2024-03-26T06:18:35.360442+0000","last_undegraded":"2024-03-26T06:18:35.360442+0000","last_fullsized":"2024-03-26T06:18:35.360442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:53:20.769317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723462+0000","last_change":"2024-03-26T06:18:34.355978+0000","last_active":"2024-03-26T06:18:35.723462+0000","last_peered":"2024-03-26T06:18:35.723462+0000","last_clean":"2024-03-26T06:18:35.723462+0000","last_became_active":"2024-03-26T06:18:34.355662+0000","last_became_peered":"2024-03-26T06:18:34.355662+0000","last_unstale":"2024-03-26T06:18:35.723462+0000","last_undegraded":"2024-03-26T06:18:35.723462+0000","last_fullsized":"2024-03-26T06:18:35.723462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:57:39.258556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359448+0000","last_change":"2024-03-26T06:18:34.361521+0000","last_active":"2024-03-26T06:18:35.359448+0000","last_peered":"2024-03-26T06:18:35.359448+0000","last_clean":"2024-03-26T06:18:35.359448+0000","last_became_active":"2024-03-26T06:18:34.361170+0000","last_became_peered":"2024-03-26T06:18:34.361170+0000","last_unstale":"2024-03-26T06:18:35.359448+0000","last_undegraded":"2024-03-26T06:18:35.359448+0000","last_fullsized":"2024-03-26T06:18:35.359448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:18.434643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359479+0000","last_change":"2024-03-26T06:18:34.369447+0000","last_active":"2024-03-26T06:18:35.359479+0000","last_peered":"2024-03-26T06:18:35.359479+0000","last_clean":"2024-03-26T06:18:35.359479+0000","last_became_active":"2024-03-26T06:18:34.369152+0000","last_became_peered":"2024-03-26T06:18:34.369152+0000","last_unstale":"2024-03-26T06:18:35.359479+0000","last_undegraded":"2024-03-26T06:18:35.359479+0000","last_fullsized":"2024-03-26T06:18:35.359479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:13:17.689820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721994+0000","last_change":"2024-03-26T06:18:34.372557+0000","last_active":"2024-03-26T06:18:35.721994+0000","last_peered":"2024-03-26T06:18:35.721994+0000","last_clean":"2024-03-26T06:18:35.721994+0000","last_became_active":"2024-03-26T06:18:34.355504+0000","last_became_peered":"2024-03-26T06:18:34.355504+0000","last_unstale":"2024-03-26T06:18:35.721994+0000","last_undegraded":"2024-03-26T06:18:35.721994+0000","last_fullsized":"2024-03-26T06:18:35.721994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T17:22:32.115092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.614952+0000","last_change":"2024-03-26T06:18:34.349696+0000","last_active":"2024-03-26T06:18:35.614952+0000","last_peered":"2024-03-26T06:18:35.614952+0000","last_clean":"2024-03-26T06:18:35.614952+0000","last_became_active":"2024-03-26T06:18:34.348008+0000","last_became_peered":"2024-03-26T06:18:34.348008+0000","last_unstale":"2024-03-26T06:18:35.614952+0000","last_undegraded":"2024-03-26T06:18:35.614952+0000","last_fullsized":"2024-03-26T06:18:35.614952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:01:22.281107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723408+0000","last_change":"2024-03-26T06:18:34.364130+0000","last_active":"2024-03-26T06:18:35.723408+0000","last_peered":"2024-03-26T06:18:35.723408+0000","last_clean":"2024-03-26T06:18:35.723408+0000","last_became_active":"2024-03-26T06:18:34.363870+0000","last_became_peered":"2024-03-26T06:18:34.363870+0000","last_unstale":"2024-03-26T06:18:35.723408+0000","last_undegraded":"2024-03-26T06:18:35.723408+0000","last_fullsized":"2024-03-26T06:18:35.723408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:47:07.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360609+0000","last_change":"2024-03-26T06:18:33.340521+0000","last_active":"2024-03-26T06:18:35.360609+0000","last_peered":"2024-03-26T06:18:35.360609+0000","last_clean":"2024-03-26T06:18:35.360609+0000","last_became_active":"2024-03-26T06:18:33.339911+0000","last_became_peered":"2024-03-26T06:18:33.339911+0000","last_unstale":"2024-03-26T06:18:35.360609+0000","last_undegraded":"2024-03-26T06:18:35.360609+0000","last_fullsized":"2024-03-26T06:18:35.360609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:20:11.329891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615795+0000","last_change":"2024-03-26T06:18:34.360796+0000","last_active":"2024-03-26T06:18:35.615795+0000","last_peered":"2024-03-26T06:18:35.615795+0000","last_clean":"2024-03-26T06:18:35.615795+0000","last_became_active":"2024-03-26T06:18:34.360519+0000","last_became_peered":"2024-03-26T06:18:34.360519+0000","last_unstale":"2024-03-26T06:18:35.615795+0000","last_undegraded":"2024-03-26T06:18:35.615795+0000","last_fullsized":"2024-03-26T06:18:35.615795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:42:24.150719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719056+0000","last_change":"2024-03-26T06:18:33.333690+0000","last_active":"2024-03-26T06:18:35.719056+0000","last_peered":"2024-03-26T06:18:35.719056+0000","last_clean":"2024-03-26T06:18:35.719056+0000","last_became_active":"2024-03-26T06:18:33.333356+0000","last_became_peered":"2024-03-26T06:18:33.333356+0000","last_unstale":"2024-03-26T06:18:35.719056+0000","last_undegraded":"2024-03-26T06:18:35.719056+0000","last_fullsized":"2024-03-26T06:18:35.719056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:36:20.827634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720475+0000","last_change":"2024-03-26T06:18:34.370642+0000","last_active":"2024-03-26T06:18:35.720475+0000","last_peered":"2024-03-26T06:18:35.720475+0000","last_clean":"2024-03-26T06:18:35.720475+0000","last_became_active":"2024-03-26T06:18:34.369996+0000","last_became_peered":"2024-03-26T06:18:34.369996+0000","last_unstale":"2024-03-26T06:18:35.720475+0000","last_undegraded":"2024-03-26T06:18:35.720475+0000","last_fullsized":"2024-03-26T06:18:35.720475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:01:22.281107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615918+0000","last_change":"2024-03-26T06:18:33.339802+0000","last_active":"2024-03-26T06:18:35.615918+0000","last_peered":"2024-03-26T06:18:35.615918+0000","last_clean":"2024-03-26T06:18:35.615918+0000","last_became_active":"2024-03-26T06:18:33.339437+0000","last_became_peered":"2024-03-26T06:18:33.339437+0000","last_unstale":"2024-03-26T06:18:35.615918+0000","last_undegraded":"2024-03-26T06:18:35.615918+0000","last_fullsized":"2024-03-26T06:18:35.615918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:06:08.730312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360606+0000","last_change":"2024-03-26T06:18:34.369605+0000","last_active":"2024-03-26T06:18:35.360606+0000","last_peered":"2024-03-26T06:18:35.360606+0000","last_clean":"2024-03-26T06:18:35.360606+0000","last_became_active":"2024-03-26T06:18:34.369327+0000","last_became_peered":"2024-03-26T06:18:34.369327+0000","last_unstale":"2024-03-26T06:18:35.360606+0000","last_undegraded":"2024-03-26T06:18:35.360606+0000","last_fullsized":"2024-03-26T06:18:35.360606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:09:42.150767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720521+0000","last_change":"2024-03-26T06:18:33.333500+0000","last_active":"2024-03-26T06:18:35.720521+0000","last_peered":"2024-03-26T06:18:35.720521+0000","last_clean":"2024-03-26T06:18:35.720521+0000","last_became_active":"2024-03-26T06:18:33.332655+0000","last_became_peered":"2024-03-26T06:18:33.332655+0000","last_unstale":"2024-03-26T06:18:35.720521+0000","last_undegraded":"2024-03-26T06:18:35.720521+0000","last_fullsized":"2024-03-26T06:18:35.720521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:29:31.007850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.718642+0000","last_change":"2024-03-26T06:18:34.346795+0000","last_active":"2024-03-26T06:18:35.718642+0000","last_peered":"2024-03-26T06:18:35.718642+0000","last_clean":"2024-03-26T06:18:35.718642+0000","last_became_active":"2024-03-26T06:18:34.346434+0000","last_became_peered":"2024-03-26T06:18:34.346434+0000","last_unstale":"2024-03-26T06:18:35.718642+0000","last_undegraded":"2024-03-26T06:18:35.718642+0000","last_fullsized":"2024-03-26T06:18:35.718642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:49:35.732896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722949+0000","last_change":"2024-03-26T06:18:33.321745+0000","last_active":"2024-03-26T06:18:35.722949+0000","last_peered":"2024-03-26T06:18:35.722949+0000","last_clean":"2024-03-26T06:18:35.722949+0000","last_became_active":"2024-03-26T06:18:33.321362+0000","last_became_peered":"2024-03-26T06:18:33.321362+0000","last_unstale":"2024-03-26T06:18:35.722949+0000","last_undegraded":"2024-03-26T06:18:35.722949+0000","last_fullsized":"2024-03-26T06:18:35.722949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:17.423008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722646+0000","last_change":"2024-03-26T06:18:34.353640+0000","last_active":"2024-03-26T06:18:35.722646+0000","last_peered":"2024-03-26T06:18:35.722646+0000","last_clean":"2024-03-26T06:18:35.722646+0000","last_became_active":"2024-03-26T06:18:34.353377+0000","last_became_peered":"2024-03-26T06:18:34.353377+0000","last_unstale":"2024-03-26T06:18:35.722646+0000","last_undegraded":"2024-03-26T06:18:35.722646+0000","last_fullsized":"2024-03-26T06:18:35.722646+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:38:00.372104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722372+0000","last_change":"2024-03-26T06:18:33.340607+0000","last_active":"2024-03-26T06:18:35.722372+0000","last_peered":"2024-03-26T06:18:35.722372+0000","last_clean":"2024-03-26T06:18:35.722372+0000","last_became_active":"2024-03-26T06:18:33.340334+0000","last_became_peered":"2024-03-26T06:18:33.340334+0000","last_unstale":"2024-03-26T06:18:35.722372+0000","last_undegraded":"2024-03-26T06:18:35.722372+0000","last_fullsized":"2024-03-26T06:18:35.722372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:36:20.827634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721438+0000","last_change":"2024-03-26T06:18:34.364000+0000","last_active":"2024-03-26T06:18:35.721438+0000","last_peered":"2024-03-26T06:18:35.721438+0000","last_clean":"2024-03-26T06:18:35.721438+0000","last_became_active":"2024-03-26T06:18:34.363683+0000","last_became_peered":"2024-03-26T06:18:34.363683+0000","last_unstale":"2024-03-26T06:18:35.721438+0000","last_undegraded":"2024-03-26T06:18:35.721438+0000","last_fullsized":"2024-03-26T06:18:35.721438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:42:24.150719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.614810+0000","last_change":"2024-03-26T06:18:33.329380+0000","last_active":"2024-03-26T06:18:35.614810+0000","last_peered":"2024-03-26T06:18:35.614810+0000","last_clean":"2024-03-26T06:18:35.614810+0000","last_became_active":"2024-03-26T06:18:33.329069+0000","last_became_peered":"2024-03-26T06:18:33.329069+0000","last_unstale":"2024-03-26T06:18:35.614810+0000","last_undegraded":"2024-03-26T06:18:35.614810+0000","last_fullsized":"2024-03-26T06:18:35.614810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:20:11.329891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360249+0000","last_change":"2024-03-26T06:18:34.376982+0000","last_active":"2024-03-26T06:18:35.360249+0000","last_peered":"2024-03-26T06:18:35.360249+0000","last_clean":"2024-03-26T06:18:35.360249+0000","last_became_active":"2024-03-26T06:18:34.376481+0000","last_became_peered":"2024-03-26T06:18:34.376481+0000","last_unstale":"2024-03-26T06:18:35.360249+0000","last_undegraded":"2024-03-26T06:18:35.360249+0000","last_fullsized":"2024-03-26T06:18:35.360249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:30:33.033135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719066+0000","last_change":"2024-03-26T06:18:33.333054+0000","last_active":"2024-03-26T06:18:35.719066+0000","last_peered":"2024-03-26T06:18:35.719066+0000","last_clean":"2024-03-26T06:18:35.719066+0000","last_became_active":"2024-03-26T06:18:33.332589+0000","last_became_peered":"2024-03-26T06:18:33.332589+0000","last_unstale":"2024-03-26T06:18:35.719066+0000","last_undegraded":"2024-03-26T06:18:35.719066+0000","last_fullsized":"2024-03-26T06:18:35.719066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:26:00.073024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356303+0000","last_change":"2024-03-26T06:18:34.353255+0000","last_active":"2024-03-26T06:18:35.356303+0000","last_peered":"2024-03-26T06:18:35.356303+0000","last_clean":"2024-03-26T06:18:35.356303+0000","last_became_active":"2024-03-26T06:18:34.352988+0000","last_became_peered":"2024-03-26T06:18:34.352988+0000","last_unstale":"2024-03-26T06:18:35.356303+0000","last_undegraded":"2024-03-26T06:18:35.356303+0000","last_fullsized":"2024-03-26T06:18:35.356303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:46:24.069097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360703+0000","last_change":"2024-03-26T06:18:33.329409+0000","last_active":"2024-03-26T06:18:35.360703+0000","last_peered":"2024-03-26T06:18:35.360703+0000","last_clean":"2024-03-26T06:18:35.360703+0000","last_became_active":"2024-03-26T06:18:33.329008+0000","last_became_peered":"2024-03-26T06:18:33.329008+0000","last_unstale":"2024-03-26T06:18:35.360703+0000","last_undegraded":"2024-03-26T06:18:35.360703+0000","last_fullsized":"2024-03-26T06:18:35.360703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:42:23.139085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724061+0000","last_change":"2024-03-26T06:18:34.376033+0000","last_active":"2024-03-26T06:18:35.724061+0000","last_peered":"2024-03-26T06:18:35.724061+0000","last_clean":"2024-03-26T06:18:35.724061+0000","last_became_active":"2024-03-26T06:18:34.373359+0000","last_became_peered":"2024-03-26T06:18:34.373359+0000","last_unstale":"2024-03-26T06:18:35.724061+0000","last_undegraded":"2024-03-26T06:18:35.724061+0000","last_fullsized":"2024-03-26T06:18:35.724061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:44:50.392750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723477+0000","last_change":"2024-03-26T06:18:33.324989+0000","last_active":"2024-03-26T06:18:35.723477+0000","last_peered":"2024-03-26T06:18:35.723477+0000","last_clean":"2024-03-26T06:18:35.723477+0000","last_became_active":"2024-03-26T06:18:33.324551+0000","last_became_peered":"2024-03-26T06:18:33.324551+0000","last_unstale":"2024-03-26T06:18:35.723477+0000","last_undegraded":"2024-03-26T06:18:35.723477+0000","last_fullsized":"2024-03-26T06:18:35.723477+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:53:19.757682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719489+0000","last_change":"2024-03-26T06:18:34.358233+0000","last_active":"2024-03-26T06:18:35.719489+0000","last_peered":"2024-03-26T06:18:35.719489+0000","last_clean":"2024-03-26T06:18:35.719489+0000","last_became_active":"2024-03-26T06:18:34.357648+0000","last_became_peered":"2024-03-26T06:18:34.357648+0000","last_unstale":"2024-03-26T06:18:35.719489+0000","last_undegraded":"2024-03-26T06:18:35.719489+0000","last_fullsized":"2024-03-26T06:18:35.719489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:33:18.385735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724644+0000","last_change":"2024-03-26T06:18:33.330089+0000","last_active":"2024-03-26T06:18:35.724644+0000","last_peered":"2024-03-26T06:18:35.724644+0000","last_clean":"2024-03-26T06:18:35.724644+0000","last_became_active":"2024-03-26T06:18:33.329802+0000","last_became_peered":"2024-03-26T06:18:33.329802+0000","last_unstale":"2024-03-26T06:18:35.724644+0000","last_undegraded":"2024-03-26T06:18:35.724644+0000","last_fullsized":"2024-03-26T06:18:35.724644+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:37:11.369553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720502+0000","last_change":"2024-03-26T06:18:34.362733+0000","last_active":"2024-03-26T06:18:35.720502+0000","last_peered":"2024-03-26T06:18:35.720502+0000","last_clean":"2024-03-26T06:18:35.720502+0000","last_became_active":"2024-03-26T06:18:34.361860+0000","last_became_peered":"2024-03-26T06:18:34.361860+0000","last_unstale":"2024-03-26T06:18:35.720502+0000","last_undegraded":"2024-03-26T06:18:35.720502+0000","last_fullsized":"2024-03-26T06:18:35.720502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:29:42.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360259+0000","last_change":"2024-03-26T06:18:33.332908+0000","last_active":"2024-03-26T06:18:35.360259+0000","last_peered":"2024-03-26T06:18:35.360259+0000","last_clean":"2024-03-26T06:18:35.360259+0000","last_became_active":"2024-03-26T06:18:33.332636+0000","last_became_peered":"2024-03-26T06:18:33.332636+0000","last_unstale":"2024-03-26T06:18:35.360259+0000","last_undegraded":"2024-03-26T06:18:35.360259+0000","last_fullsized":"2024-03-26T06:18:35.360259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:20:03.720697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.718707+0000","last_change":"2024-03-26T06:18:34.343304+0000","last_active":"2024-03-26T06:18:35.718707+0000","last_peered":"2024-03-26T06:18:35.718707+0000","last_clean":"2024-03-26T06:18:35.718707+0000","last_became_active":"2024-03-26T06:18:34.342805+0000","last_became_peered":"2024-03-26T06:18:34.342805+0000","last_unstale":"2024-03-26T06:18:35.718707+0000","last_undegraded":"2024-03-26T06:18:35.718707+0000","last_fullsized":"2024-03-26T06:18:35.718707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:01:22.281107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360465+0000","last_change":"2024-03-26T06:18:33.326716+0000","last_active":"2024-03-26T06:18:35.360465+0000","last_peered":"2024-03-26T06:18:35.360465+0000","last_clean":"2024-03-26T06:18:35.360465+0000","last_became_active":"2024-03-26T06:18:33.324895+0000","last_became_peered":"2024-03-26T06:18:33.324895+0000","last_unstale":"2024-03-26T06:18:35.360465+0000","last_undegraded":"2024-03-26T06:18:35.360465+0000","last_fullsized":"2024-03-26T06:18:35.360465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:40:16.904545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359910+0000","last_change":"2024-03-26T06:18:34.342671+0000","last_active":"2024-03-26T06:18:35.359910+0000","last_peered":"2024-03-26T06:18:35.359910+0000","last_clean":"2024-03-26T06:18:35.359910+0000","last_became_active":"2024-03-26T06:18:34.342329+0000","last_became_peered":"2024-03-26T06:18:34.342329+0000","last_unstale":"2024-03-26T06:18:35.359910+0000","last_undegraded":"2024-03-26T06:18:35.359910+0000","last_fullsized":"2024-03-26T06:18:35.359910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:57:39.258556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.614950+0000","last_change":"2024-03-26T06:18:33.329622+0000","last_active":"2024-03-26T06:18:35.614950+0000","last_peered":"2024-03-26T06:18:35.614950+0000","last_clean":"2024-03-26T06:18:35.614950+0000","last_became_active":"2024-03-26T06:18:33.329327+0000","last_became_peered":"2024-03-26T06:18:33.329327+0000","last_unstale":"2024-03-26T06:18:35.614950+0000","last_undegraded":"2024-03-26T06:18:35.614950+0000","last_fullsized":"2024-03-26T06:18:35.614950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:36:20.827634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721894+0000","last_change":"2024-03-26T06:18:34.356849+0000","last_active":"2024-03-26T06:18:35.721894+0000","last_peered":"2024-03-26T06:18:35.721894+0000","last_clean":"2024-03-26T06:18:35.721894+0000","last_became_active":"2024-03-26T06:18:34.356541+0000","last_became_peered":"2024-03-26T06:18:34.356541+0000","last_unstale":"2024-03-26T06:18:35.721894+0000","last_undegraded":"2024-03-26T06:18:35.721894+0000","last_fullsized":"2024-03-26T06:18:35.721894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:11:54.009514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359680+0000","last_change":"2024-03-26T06:18:33.337975+0000","last_active":"2024-03-26T06:18:35.359680+0000","last_peered":"2024-03-26T06:18:35.359680+0000","last_clean":"2024-03-26T06:18:35.359680+0000","last_became_active":"2024-03-26T06:18:33.337122+0000","last_became_peered":"2024-03-26T06:18:33.337122+0000","last_unstale":"2024-03-26T06:18:35.359680+0000","last_undegraded":"2024-03-26T06:18:35.359680+0000","last_fullsized":"2024-03-26T06:18:35.359680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:26:00.073024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360105+0000","last_change":"2024-03-26T06:18:34.349574+0000","last_active":"2024-03-26T06:18:35.360105+0000","last_peered":"2024-03-26T06:18:35.360105+0000","last_clean":"2024-03-26T06:18:35.360105+0000","last_became_active":"2024-03-26T06:18:34.349284+0000","last_became_peered":"2024-03-26T06:18:34.349284+0000","last_unstale":"2024-03-26T06:18:35.360105+0000","last_undegraded":"2024-03-26T06:18:35.360105+0000","last_fullsized":"2024-03-26T06:18:35.360105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:11:10.424843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720228+0000","last_change":"2024-03-26T06:18:33.336543+0000","last_active":"2024-03-26T06:18:35.720228+0000","last_peered":"2024-03-26T06:18:35.720228+0000","last_clean":"2024-03-26T06:18:35.720228+0000","last_became_active":"2024-03-26T06:18:33.335318+0000","last_became_peered":"2024-03-26T06:18:33.335318+0000","last_unstale":"2024-03-26T06:18:35.720228+0000","last_undegraded":"2024-03-26T06:18:35.720228+0000","last_fullsized":"2024-03-26T06:18:35.720228+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:37:11.369553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360315+0000","last_change":"2024-03-26T06:18:34.361797+0000","last_active":"2024-03-26T06:18:35.360315+0000","last_peered":"2024-03-26T06:18:35.360315+0000","last_clean":"2024-03-26T06:18:35.360315+0000","last_became_active":"2024-03-26T06:18:34.358023+0000","last_became_peered":"2024-03-26T06:18:34.358023+0000","last_unstale":"2024-03-26T06:18:35.360315+0000","last_undegraded":"2024-03-26T06:18:35.360315+0000","last_fullsized":"2024-03-26T06:18:35.360315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:48:21.581737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724742+0000","last_change":"2024-03-26T06:18:33.336277+0000","last_active":"2024-03-26T06:18:35.724742+0000","last_peered":"2024-03-26T06:18:35.724742+0000","last_clean":"2024-03-26T06:18:35.724742+0000","last_became_active":"2024-03-26T06:18:33.335956+0000","last_became_peered":"2024-03-26T06:18:33.335956+0000","last_unstale":"2024-03-26T06:18:35.724742+0000","last_undegraded":"2024-03-26T06:18:35.724742+0000","last_fullsized":"2024-03-26T06:18:35.724742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:13:16.678185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724480+0000","last_change":"2024-03-26T06:18:34.350739+0000","last_active":"2024-03-26T06:18:35.724480+0000","last_peered":"2024-03-26T06:18:35.724480+0000","last_clean":"2024-03-26T06:18:35.724480+0000","last_became_active":"2024-03-26T06:18:34.350473+0000","last_became_peered":"2024-03-26T06:18:34.350473+0000","last_unstale":"2024-03-26T06:18:35.724480+0000","last_undegraded":"2024-03-26T06:18:35.724480+0000","last_fullsized":"2024-03-26T06:18:35.724480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:08:37.987374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720763+0000","last_change":"2024-03-26T06:18:33.339350+0000","last_active":"2024-03-26T06:18:35.720763+0000","last_peered":"2024-03-26T06:18:35.720763+0000","last_clean":"2024-03-26T06:18:35.720763+0000","last_became_active":"2024-03-26T06:18:33.339032+0000","last_became_peered":"2024-03-26T06:18:33.339032+0000","last_unstale":"2024-03-26T06:18:35.720763+0000","last_undegraded":"2024-03-26T06:18:35.720763+0000","last_fullsized":"2024-03-26T06:18:35.720763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:00:12.476047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719810+0000","last_change":"2024-03-26T06:18:34.364898+0000","last_active":"2024-03-26T06:18:35.719810+0000","last_peered":"2024-03-26T06:18:35.719810+0000","last_clean":"2024-03-26T06:18:35.719810+0000","last_became_active":"2024-03-26T06:18:34.364621+0000","last_became_peered":"2024-03-26T06:18:34.364621+0000","last_unstale":"2024-03-26T06:18:35.719810+0000","last_undegraded":"2024-03-26T06:18:35.719810+0000","last_fullsized":"2024-03-26T06:18:35.719810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:49:35.732896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356339+0000","last_change":"2024-03-26T06:18:33.334385+0000","last_active":"2024-03-26T06:18:35.356339+0000","last_peered":"2024-03-26T06:18:35.356339+0000","last_clean":"2024-03-26T06:18:35.356339+0000","last_became_active":"2024-03-26T06:18:33.332434+0000","last_became_peered":"2024-03-26T06:18:33.332434+0000","last_unstale":"2024-03-26T06:18:35.356339+0000","last_undegraded":"2024-03-26T06:18:35.356339+0000","last_fullsized":"2024-03-26T06:18:35.356339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:36:59.593572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356538+0000","last_change":"2024-03-26T06:18:34.360171+0000","last_active":"2024-03-26T06:18:35.356538+0000","last_peered":"2024-03-26T06:18:35.356538+0000","last_clean":"2024-03-26T06:18:35.356538+0000","last_became_active":"2024-03-26T06:18:34.359182+0000","last_became_peered":"2024-03-26T06:18:34.359182+0000","last_unstale":"2024-03-26T06:18:35.356538+0000","last_undegraded":"2024-03-26T06:18:35.356538+0000","last_fullsized":"2024-03-26T06:18:35.356538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:26:01.084659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615571+0000","last_change":"2024-03-26T06:18:33.339801+0000","last_active":"2024-03-26T06:18:35.615571+0000","last_peered":"2024-03-26T06:18:35.615571+0000","last_clean":"2024-03-26T06:18:35.615571+0000","last_became_active":"2024-03-26T06:18:33.339401+0000","last_became_peered":"2024-03-26T06:18:33.339401+0000","last_unstale":"2024-03-26T06:18:35.615571+0000","last_undegraded":"2024-03-26T06:18:35.615571+0000","last_fullsized":"2024-03-26T06:18:35.615571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:29:31.007850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720639+0000","last_change":"2024-03-26T06:18:34.373610+0000","last_active":"2024-03-26T06:18:35.720639+0000","last_peered":"2024-03-26T06:18:35.720639+0000","last_clean":"2024-03-26T06:18:35.720639+0000","last_became_active":"2024-03-26T06:18:34.373258+0000","last_became_peered":"2024-03-26T06:18:34.373258+0000","last_unstale":"2024-03-26T06:18:35.720639+0000","last_undegraded":"2024-03-26T06:18:35.720639+0000","last_fullsized":"2024-03-26T06:18:35.720639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:38:32.046892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356062+0000","last_change":"2024-03-26T06:18:33.320558+0000","last_active":"2024-03-26T06:18:35.356062+0000","last_peered":"2024-03-26T06:18:35.356062+0000","last_clean":"2024-03-26T06:18:35.356062+0000","last_became_active":"2024-03-26T06:18:33.319427+0000","last_became_peered":"2024-03-26T06:18:33.319427+0000","last_unstale":"2024-03-26T06:18:35.356062+0000","last_undegraded":"2024-03-26T06:18:35.356062+0000","last_fullsized":"2024-03-26T06:18:35.356062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T17:31:14.125284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.718726+0000","last_change":"2024-03-26T06:18:34.374144+0000","last_active":"2024-03-26T06:18:35.718726+0000","last_peered":"2024-03-26T06:18:35.718726+0000","last_clean":"2024-03-26T06:18:35.718726+0000","last_became_active":"2024-03-26T06:18:34.373801+0000","last_became_peered":"2024-03-26T06:18:34.373801+0000","last_unstale":"2024-03-26T06:18:35.718726+0000","last_undegraded":"2024-03-26T06:18:35.718726+0000","last_fullsized":"2024-03-26T06:18:35.718726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:29:42.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356138+0000","last_change":"2024-03-26T06:18:33.339852+0000","last_active":"2024-03-26T06:18:35.356138+0000","last_peered":"2024-03-26T06:18:35.356138+0000","last_clean":"2024-03-26T06:18:35.356138+0000","last_became_active":"2024-03-26T06:18:33.339488+0000","last_became_peered":"2024-03-26T06:18:33.339488+0000","last_unstale":"2024-03-26T06:18:35.356138+0000","last_undegraded":"2024-03-26T06:18:35.356138+0000","last_fullsized":"2024-03-26T06:18:35.356138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:09:14.462296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722364+0000","last_change":"2024-03-26T06:18:34.361182+0000","last_active":"2024-03-26T06:18:35.722364+0000","last_peered":"2024-03-26T06:18:35.722364+0000","last_clean":"2024-03-26T06:18:35.722364+0000","last_became_active":"2024-03-26T06:18:34.359136+0000","last_became_peered":"2024-03-26T06:18:34.359136+0000","last_unstale":"2024-03-26T06:18:35.722364+0000","last_undegraded":"2024-03-26T06:18:35.722364+0000","last_fullsized":"2024-03-26T06:18:35.722364+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:44:50.392750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722262+0000","last_change":"2024-03-26T06:18:33.336295+0000","last_active":"2024-03-26T06:18:35.722262+0000","last_peered":"2024-03-26T06:18:35.722262+0000","last_clean":"2024-03-26T06:18:35.722262+0000","last_became_active":"2024-03-26T06:18:33.334648+0000","last_became_peered":"2024-03-26T06:18:33.334648+0000","last_unstale":"2024-03-26T06:18:35.722262+0000","last_undegraded":"2024-03-26T06:18:35.722262+0000","last_fullsized":"2024-03-26T06:18:35.722262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:15:24.954097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360280+0000","last_change":"2024-03-26T06:18:34.372901+0000","last_active":"2024-03-26T06:18:35.360280+0000","last_peered":"2024-03-26T06:18:35.360280+0000","last_clean":"2024-03-26T06:18:35.360280+0000","last_became_active":"2024-03-26T06:18:34.372714+0000","last_became_peered":"2024-03-26T06:18:34.372714+0000","last_unstale":"2024-03-26T06:18:35.360280+0000","last_undegraded":"2024-03-26T06:18:35.360280+0000","last_fullsized":"2024-03-26T06:18:35.360280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:12:49.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.355942+0000","last_change":"2024-03-26T06:18:33.322380+0000","last_active":"2024-03-26T06:18:35.355942+0000","last_peered":"2024-03-26T06:18:35.355942+0000","last_clean":"2024-03-26T06:18:35.355942+0000","last_became_active":"2024-03-26T06:18:33.322089+0000","last_became_peered":"2024-03-26T06:18:33.322089+0000","last_unstale":"2024-03-26T06:18:35.355942+0000","last_undegraded":"2024-03-26T06:18:35.355942+0000","last_fullsized":"2024-03-26T06:18:35.355942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:11:32.748567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615194+0000","last_change":"2024-03-26T06:18:34.350024+0000","last_active":"2024-03-26T06:18:35.615194+0000","last_peered":"2024-03-26T06:18:35.615194+0000","last_clean":"2024-03-26T06:18:35.615194+0000","last_became_active":"2024-03-26T06:18:34.349747+0000","last_became_peered":"2024-03-26T06:18:34.349747+0000","last_unstale":"2024-03-26T06:18:35.615194+0000","last_undegraded":"2024-03-26T06:18:35.615194+0000","last_fullsized":"2024-03-26T06:18:35.615194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:20:04.732332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724885+0000","last_change":"2024-03-26T06:18:33.331298+0000","last_active":"2024-03-26T06:18:35.724885+0000","last_peered":"2024-03-26T06:18:35.724885+0000","last_clean":"2024-03-26T06:18:35.724885+0000","last_became_active":"2024-03-26T06:18:33.330304+0000","last_became_peered":"2024-03-26T06:18:33.330304+0000","last_unstale":"2024-03-26T06:18:35.724885+0000","last_undegraded":"2024-03-26T06:18:35.724885+0000","last_fullsized":"2024-03-26T06:18:35.724885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:43:44.596547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724269+0000","last_change":"2024-03-26T06:18:34.372999+0000","last_active":"2024-03-26T06:18:35.724269+0000","last_peered":"2024-03-26T06:18:35.724269+0000","last_clean":"2024-03-26T06:18:35.724269+0000","last_became_active":"2024-03-26T06:18:34.372740+0000","last_became_peered":"2024-03-26T06:18:34.372740+0000","last_unstale":"2024-03-26T06:18:35.724269+0000","last_undegraded":"2024-03-26T06:18:35.724269+0000","last_fullsized":"2024-03-26T06:18:35.724269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:38:00.372104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:36.335984+0000","last_change":"2024-03-26T06:18:33.326714+0000","last_active":"2024-03-26T06:18:36.335984+0000","last_peered":"2024-03-26T06:18:36.335984+0000","last_clean":"2024-03-26T06:18:36.335984+0000","last_became_active":"2024-03-26T06:18:33.326189+0000","last_became_peered":"2024-03-26T06:18:33.326189+0000","last_unstale":"2024-03-26T06:18:36.335984+0000","last_undegraded":"2024-03-26T06:18:36.335984+0000","last_fullsized":"2024-03-26T06:18:36.335984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:37:14.730216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360566+0000","last_change":"2024-03-26T06:18:34.355446+0000","last_active":"2024-03-26T06:18:35.360566+0000","last_peered":"2024-03-26T06:18:35.360566+0000","last_clean":"2024-03-26T06:18:35.360566+0000","last_became_active":"2024-03-26T06:18:34.355194+0000","last_became_peered":"2024-03-26T06:18:34.355194+0000","last_unstale":"2024-03-26T06:18:35.360566+0000","last_undegraded":"2024-03-26T06:18:35.360566+0000","last_fullsized":"2024-03-26T06:18:35.360566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:56:14.438674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719374+0000","last_change":"2024-03-26T06:18:33.329425+0000","last_active":"2024-03-26T06:18:35.719374+0000","last_peered":"2024-03-26T06:18:35.719374+0000","last_clean":"2024-03-26T06:18:35.719374+0000","last_became_active":"2024-03-26T06:18:33.329118+0000","last_became_peered":"2024-03-26T06:18:33.329118+0000","last_unstale":"2024-03-26T06:18:35.719374+0000","last_undegraded":"2024-03-26T06:18:35.719374+0000","last_fullsized":"2024-03-26T06:18:35.719374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:20:11.329891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719069+0000","last_change":"2024-03-26T06:18:34.343519+0000","last_active":"2024-03-26T06:18:35.719069+0000","last_peered":"2024-03-26T06:18:35.719069+0000","last_clean":"2024-03-26T06:18:35.719069+0000","last_became_active":"2024-03-26T06:18:34.343117+0000","last_became_peered":"2024-03-26T06:18:34.343117+0000","last_unstale":"2024-03-26T06:18:35.719069+0000","last_undegraded":"2024-03-26T06:18:35.719069+0000","last_fullsized":"2024-03-26T06:18:35.719069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:20:04.732332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719754+0000","last_change":"2024-03-26T06:18:33.331043+0000","last_active":"2024-03-26T06:18:35.719754+0000","last_peered":"2024-03-26T06:18:35.719754+0000","last_clean":"2024-03-26T06:18:35.719754+0000","last_became_active":"2024-03-26T06:18:33.330780+0000","last_became_peered":"2024-03-26T06:18:33.330780+0000","last_unstale":"2024-03-26T06:18:35.719754+0000","last_undegraded":"2024-03-26T06:18:35.719754+0000","last_fullsized":"2024-03-26T06:18:35.719754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:00:12.476047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615023+0000","last_change":"2024-03-26T06:18:34.354028+0000","last_active":"2024-03-26T06:18:35.615023+0000","last_peered":"2024-03-26T06:18:35.615023+0000","last_clean":"2024-03-26T06:18:35.615023+0000","last_became_active":"2024-03-26T06:18:34.353751+0000","last_became_peered":"2024-03-26T06:18:34.353751+0000","last_unstale":"2024-03-26T06:18:35.615023+0000","last_undegraded":"2024-03-26T06:18:35.615023+0000","last_fullsized":"2024-03-26T06:18:35.615023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:29:42.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359453+0000","last_change":"2024-03-26T06:18:33.330782+0000","last_active":"2024-03-26T06:18:35.359453+0000","last_peered":"2024-03-26T06:18:35.359453+0000","last_clean":"2024-03-26T06:18:35.359453+0000","last_became_active":"2024-03-26T06:18:33.330171+0000","last_became_peered":"2024-03-26T06:18:33.330171+0000","last_unstale":"2024-03-26T06:18:35.359453+0000","last_undegraded":"2024-03-26T06:18:35.359453+0000","last_fullsized":"2024-03-26T06:18:35.359453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:11.165463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719739+0000","last_change":"2024-03-26T06:18:34.363504+0000","last_active":"2024-03-26T06:18:35.719739+0000","last_peered":"2024-03-26T06:18:35.719739+0000","last_clean":"2024-03-26T06:18:35.719739+0000","last_became_active":"2024-03-26T06:18:34.362629+0000","last_became_peered":"2024-03-26T06:18:34.362629+0000","last_unstale":"2024-03-26T06:18:35.719739+0000","last_undegraded":"2024-03-26T06:18:35.719739+0000","last_fullsized":"2024-03-26T06:18:35.719739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:53:20.769317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719975+0000","last_change":"2024-03-26T06:18:33.333066+0000","last_active":"2024-03-26T06:18:35.719975+0000","last_peered":"2024-03-26T06:18:35.719975+0000","last_clean":"2024-03-26T06:18:35.719975+0000","last_became_active":"2024-03-26T06:18:33.332700+0000","last_became_peered":"2024-03-26T06:18:33.332700+0000","last_unstale":"2024-03-26T06:18:35.719975+0000","last_undegraded":"2024-03-26T06:18:35.719975+0000","last_fullsized":"2024-03-26T06:18:35.719975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:11.165463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723701+0000","last_change":"2024-03-26T06:18:34.374044+0000","last_active":"2024-03-26T06:18:35.723701+0000","last_peered":"2024-03-26T06:18:35.723701+0000","last_clean":"2024-03-26T06:18:35.723701+0000","last_became_active":"2024-03-26T06:18:34.373336+0000","last_became_peered":"2024-03-26T06:18:34.373336+0000","last_unstale":"2024-03-26T06:18:35.723701+0000","last_undegraded":"2024-03-26T06:18:35.723701+0000","last_fullsized":"2024-03-26T06:18:35.723701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:46:07.921912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359865+0000","last_change":"2024-03-26T06:18:33.330912+0000","last_active":"2024-03-26T06:18:35.359865+0000","last_peered":"2024-03-26T06:18:35.359865+0000","last_clean":"2024-03-26T06:18:35.359865+0000","last_became_active":"2024-03-26T06:18:33.330619+0000","last_became_peered":"2024-03-26T06:18:33.330619+0000","last_unstale":"2024-03-26T06:18:35.359865+0000","last_undegraded":"2024-03-26T06:18:35.359865+0000","last_fullsized":"2024-03-26T06:18:35.359865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:29:41.292833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724232+0000","last_change":"2024-03-26T06:18:34.358865+0000","last_active":"2024-03-26T06:18:35.724232+0000","last_peered":"2024-03-26T06:18:35.724232+0000","last_clean":"2024-03-26T06:18:35.724232+0000","last_became_active":"2024-03-26T06:18:34.358566+0000","last_became_peered":"2024-03-26T06:18:34.358566+0000","last_unstale":"2024-03-26T06:18:35.724232+0000","last_undegraded":"2024-03-26T06:18:35.724232+0000","last_fullsized":"2024-03-26T06:18:35.724232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:11:10.424843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723624+0000","last_change":"2024-03-26T06:18:33.338378+0000","last_active":"2024-03-26T06:18:35.723624+0000","last_peered":"2024-03-26T06:18:35.723624+0000","last_clean":"2024-03-26T06:18:35.723624+0000","last_became_active":"2024-03-26T06:18:33.337717+0000","last_became_peered":"2024-03-26T06:18:33.337717+0000","last_unstale":"2024-03-26T06:18:35.723624+0000","last_undegraded":"2024-03-26T06:18:35.723624+0000","last_fullsized":"2024-03-26T06:18:35.723624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:06:08.730312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720788+0000","last_change":"2024-03-26T06:16:49.590440+0000","last_active":"2024-03-26T06:18:35.720788+0000","last_peered":"2024-03-26T06:18:35.720788+0000","last_clean":"2024-03-26T06:18:35.720788+0000","last_became_active":"2024-03-26T06:16:49.589017+0000","last_became_peered":"2024-03-26T06:16:49.589017+0000","last_unstale":"2024-03-26T06:18:35.720788+0000","last_undegraded":"2024-03-26T06:18:35.720788+0000","last_fullsized":"2024-03-26T06:18:35.720788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_clean_scrub_stamp":"2024-03-26T06:16:48.290068+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:00:05.158039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1060864,"data_stored":786749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":195281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":195303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":196345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":194789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":785101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-26T06:18:38.822 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-26T06:18:39.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.086+0000 7fc97e200640 1 Processor -- start 2024-03-26T06:18:39.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.086+0000 7fc97e200640 1 -- start start 2024-03-26T06:18:39.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.087+0000 7fc97e200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc978071350 0x7fc9780717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.087+0000 7fc97e200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc9780cc3f0 0x7fc9780cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.088+0000 7fc97e200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97815bf80 con 0x7fc978145100 2024-03-26T06:18:39.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.088+0000 7fc97e200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9780a86e0 con 0x7fc9780cc3f0 2024-03-26T06:18:39.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.088+0000 7fc97e200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97806e2f0 con 0x7fc978071350 2024-03-26T06:18:39.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.088+0000 7fc977400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc978145100 0x7fc97806ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43424/0 (socket says 172.21.15.63:43424) 2024-03-26T06:18:39.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.088+0000 7fc977400640 1 -- 172.21.15.63:0/1618242624 learned_addr learned my addr 172.21.15.63:0/1618242624 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:39.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.088+0000 7fc977e00640 1 --2- 172.21.15.63:0/1618242624 >> v2:172.21.15.63:3300/0 conn(0x7fc9780cc3f0 0x7fc9780cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.088+0000 7fc976a00640 1 --2- 172.21.15.63:0/1618242624 >> v2:172.21.15.204:3300/0 conn(0x7fc978071350 0x7fc9780717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.088+0000 7fc976000640 1 -- 172.21.15.63:0/1618242624 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677246001 0 0) 0x7fc97815bf80 con 0x7fc978145100 2024-03-26T06:18:39.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.089+0000 7fc976000640 1 -- 172.21.15.63:0/1618242624 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc95c003520 con 0x7fc978145100 2024-03-26T06:18:39.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.089+0000 7fc977e00640 1 -- 172.21.15.63:0/1618242624 >> v2:172.21.15.204:3300/0 conn(0x7fc978071350 msgr2=0x7fc9780717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:39.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.089+0000 7fc977e00640 1 --2- 172.21.15.63:0/1618242624 >> v2:172.21.15.204:3300/0 conn(0x7fc978071350 0x7fc9780717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.089+0000 7fc977e00640 1 -- 172.21.15.63:0/1618242624 >> v1:172.21.15.63:6789/0 conn(0x7fc978145100 legacy=0x7fc97806ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.089+0000 7fc977e00640 1 -- 172.21.15.63:0/1618242624 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97806d770 con 0x7fc9780cc3f0 2024-03-26T06:18:39.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.090+0000 7fc977e00640 1 --2- 172.21.15.63:0/1618242624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9780cc3f0 0x7fc9780cc7d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc9780af3b0 tx=0x7fc97002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb19af341a4d9ce server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:39.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.090+0000 7fc976000640 1 -- 172.21.15.63:0/1618242624 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970035020 con 0x7fc9780cc3f0 2024-03-26T06:18:39.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.090+0000 7fc976000640 1 -- 172.21.15.63:0/1618242624 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970031830 con 0x7fc9780cc3f0 2024-03-26T06:18:39.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.090+0000 7fc976000640 1 -- 172.21.15.63:0/1618242624 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970031c00 con 0x7fc9780cc3f0 2024-03-26T06:18:39.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.091+0000 7fc97e200640 1 -- 172.21.15.63:0/1618242624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9780cc3f0 msgr2=0x7fc9780cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.091+0000 7fc97e200640 1 --2- 172.21.15.63:0/1618242624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9780cc3f0 0x7fc9780cc7d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc9780af3b0 tx=0x7fc97002b8d0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.091+0000 7fc97e200640 1 -- 172.21.15.63:0/1618242624 shutdown_connections 2024-03-26T06:18:39.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.091+0000 7fc97e200640 1 --2- 172.21.15.63:0/1618242624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9780cc3f0 0x7fc9780cc7d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.091+0000 7fc97e200640 1 --2- 172.21.15.63:0/1618242624 >> v2:172.21.15.204:3300/0 conn(0x7fc978071350 0x7fc9780717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.091+0000 7fc97e200640 1 -- 172.21.15.63:0/1618242624 >> 172.21.15.63:0/1618242624 conn(0x7fc97806ac90 msgr2=0x7fc97806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:39.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.091+0000 7fc97e200640 1 -- 172.21.15.63:0/1618242624 shutdown_connections 2024-03-26T06:18:39.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.091+0000 7fc97e200640 1 -- 172.21.15.63:0/1618242624 wait complete. 2024-03-26T06:18:39.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.093+0000 7fc97e200640 1 Processor -- start 2024-03-26T06:18:39.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.093+0000 7fc97e200640 1 -- start start 2024-03-26T06:18:39.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc97e200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc978071350 0x7fc9780b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc97e200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9780cc3f0 0x7fc97813cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc97e200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc978145100 0x7fc97813d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc97e200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97806e010 con 0x7fc978071350 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc97e200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97806dd30 con 0x7fc978145100 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc97e200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781454e0 con 0x7fc9780cc3f0 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc977400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc978071350 0x7fc9780b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc977400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc978071350 0x7fc9780b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39680/0 (socket says 172.21.15.63:39680) 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc977400640 1 -- 172.21.15.63:0/65369500 learned_addr learned my addr 172.21.15.63:0/65369500 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc977400640 1 -- 172.21.15.63:0/65369500 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9780cc3f0 msgr2=0x7fc97813cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc977400640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9780cc3f0 0x7fc97813cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc977400640 1 -- 172.21.15.63:0/65369500 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc978145100 msgr2=0x7fc97813d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc977400640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc978145100 0x7fc97813d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.094+0000 7fc977400640 1 -- 172.21.15.63:0/65369500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780b3670 con 0x7fc978071350 2024-03-26T06:18:39.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.095+0000 7fc977400640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc978071350 0x7fc9780b3130 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc968001460 tx=0x7fc96800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:39.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.095+0000 7fc96f400640 1 -- 172.21.15.63:0/65369500 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968017070 con 0x7fc978071350 2024-03-26T06:18:39.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.095+0000 7fc96f400640 1 -- 172.21.15.63:0/65369500 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96800ad00 con 0x7fc978071350 2024-03-26T06:18:39.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.095+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9780afcf0 con 0x7fc978071350 2024-03-26T06:18:39.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.095+0000 7fc96f400640 1 -- 172.21.15.63:0/65369500 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968012640 con 0x7fc978071350 2024-03-26T06:18:39.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.095+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780b02b0 con 0x7fc978071350 2024-03-26T06:18:39.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.096+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc978074730 con 0x7fc978071350 2024-03-26T06:18:39.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.097+0000 7fc96f400640 1 -- 172.21.15.63:0/65369500 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc96801a070 con 0x7fc978071350 2024-03-26T06:18:39.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.098+0000 7fc96f400640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc95806bbd0 0x7fc95806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.098+0000 7fc96f400640 1 -- 172.21.15.63:0/65369500 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc96808aaf0 con 0x7fc978071350 2024-03-26T06:18:39.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.098+0000 7fc976a00640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc95806bbd0 0x7fc95806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.099+0000 7fc976a00640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc95806bbd0 0x7fc95806e090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc964006fd0 tx=0x7fc964008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.103+0000 7fc96f400640 1 -- 172.21.15.63:0/65369500 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc968059440 con 0x7fc978071350 2024-03-26T06:18:39.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.302+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 --> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9781419b0 con 0x7fc95806bbd0 2024-03-26T06:18:39.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.321+0000 7fc96f400640 1 -- 172.21.15.63:0/65369500 <== mgr.4104 v2:172.21.15.63:6832/3591189670 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251963 (secure 0 0 0) 0x7fc9781419b0 con 0x7fc95806bbd0 2024-03-26T06:18:39.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:39.327 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-03-26T06:18:39.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc95806bbd0 msgr2=0x7fc95806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc95806bbd0 0x7fc95806e090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc964006fd0 tx=0x7fc964008040 comp rx=0 tx=0).stop 2024-03-26T06:18:39.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc978071350 msgr2=0x7fc9780b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc978071350 0x7fc9780b3130 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc968001460 tx=0x7fc96800a430 comp rx=0 tx=0).stop 2024-03-26T06:18:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 shutdown_connections 2024-03-26T06:18:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fc95806bbd0 0x7fc95806e090 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc978145100 0x7fc97813d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9780cc3f0 0x7fc97813cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 --2- 172.21.15.63:0/65369500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc978071350 0x7fc9780b3130 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.328+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 >> 172.21.15.63:0/65369500 conn(0x7fc97806ac90 msgr2=0x7fc9780cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:39.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.329+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 shutdown_connections 2024-03-26T06:18:39.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.329+0000 7fc97e200640 1 -- 172.21.15.63:0/65369500 wait complete. 2024-03-26T06:18:39.349 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-03-26T06:18:37.911394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220952,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753768,"statfs":{"total":773094113280,"available":772867858432,"internally_reserved":0,"allocated":4857856,"data_stored":2743148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.619383"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360654+0000","last_change":"2024-03-26T06:18:34.351458+0000","last_active":"2024-03-26T06:18:35.360654+0000","last_peered":"2024-03-26T06:18:35.360654+0000","last_clean":"2024-03-26T06:18:35.360654+0000","last_became_active":"2024-03-26T06:18:34.351151+0000","last_became_peered":"2024-03-26T06:18:34.351151+0000","last_unstale":"2024-03-26T06:18:35.360654+0000","last_undegraded":"2024-03-26T06:18:35.360654+0000","last_fullsized":"2024-03-26T06:18:35.360654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:07:00.672278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360285+0000","last_change":"2024-03-26T06:18:34.349263+0000","last_active":"2024-03-26T06:18:35.360285+0000","last_peered":"2024-03-26T06:18:35.360285+0000","last_clean":"2024-03-26T06:18:35.360285+0000","last_became_active":"2024-03-26T06:18:34.348940+0000","last_became_peered":"2024-03-26T06:18:34.348940+0000","last_unstale":"2024-03-26T06:18:35.360285+0000","last_undegraded":"2024-03-26T06:18:35.360285+0000","last_fullsized":"2024-03-26T06:18:35.360285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:08:37.987374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719152+0000","last_change":"2024-03-26T06:18:34.346527+0000","last_active":"2024-03-26T06:18:35.719152+0000","last_peered":"2024-03-26T06:18:35.719152+0000","last_clean":"2024-03-26T06:18:35.719152+0000","last_became_active":"2024-03-26T06:18:34.346236+0000","last_became_peered":"2024-03-26T06:18:34.346236+0000","last_unstale":"2024-03-26T06:18:35.719152+0000","last_undegraded":"2024-03-26T06:18:35.719152+0000","last_fullsized":"2024-03-26T06:18:35.719152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:42:24.150719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356334+0000","last_change":"2024-03-26T06:18:34.353364+0000","last_active":"2024-03-26T06:18:35.356334+0000","last_peered":"2024-03-26T06:18:35.356334+0000","last_clean":"2024-03-26T06:18:35.356334+0000","last_became_active":"2024-03-26T06:18:34.353081+0000","last_became_peered":"2024-03-26T06:18:34.353081+0000","last_unstale":"2024-03-26T06:18:35.356334+0000","last_undegraded":"2024-03-26T06:18:35.356334+0000","last_fullsized":"2024-03-26T06:18:35.356334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:22:35.734017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356061+0000","last_change":"2024-03-26T06:18:34.363234+0000","last_active":"2024-03-26T06:18:35.356061+0000","last_peered":"2024-03-26T06:18:35.356061+0000","last_clean":"2024-03-26T06:18:35.356061+0000","last_became_active":"2024-03-26T06:18:34.362958+0000","last_became_peered":"2024-03-26T06:18:34.362958+0000","last_unstale":"2024-03-26T06:18:35.356061+0000","last_undegraded":"2024-03-26T06:18:35.356061+0000","last_fullsized":"2024-03-26T06:18:35.356061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T17:10:25.740858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615142+0000","last_change":"2024-03-26T06:18:34.350405+0000","last_active":"2024-03-26T06:18:35.615142+0000","last_peered":"2024-03-26T06:18:35.615142+0000","last_clean":"2024-03-26T06:18:35.615142+0000","last_became_active":"2024-03-26T06:18:34.350118+0000","last_became_peered":"2024-03-26T06:18:34.350118+0000","last_unstale":"2024-03-26T06:18:35.615142+0000","last_undegraded":"2024-03-26T06:18:35.615142+0000","last_fullsized":"2024-03-26T06:18:35.615142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:40:17.916180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721820+0000","last_change":"2024-03-26T06:18:34.356735+0000","last_active":"2024-03-26T06:18:35.721820+0000","last_peered":"2024-03-26T06:18:35.721820+0000","last_clean":"2024-03-26T06:18:35.721820+0000","last_became_active":"2024-03-26T06:18:34.355211+0000","last_became_peered":"2024-03-26T06:18:34.355211+0000","last_unstale":"2024-03-26T06:18:35.721820+0000","last_undegraded":"2024-03-26T06:18:35.721820+0000","last_fullsized":"2024-03-26T06:18:35.721820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:47:07.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359807+0000","last_change":"2024-03-26T06:18:34.350596+0000","last_active":"2024-03-26T06:18:35.359807+0000","last_peered":"2024-03-26T06:18:35.359807+0000","last_clean":"2024-03-26T06:18:35.359807+0000","last_became_active":"2024-03-26T06:18:34.349766+0000","last_became_peered":"2024-03-26T06:18:34.349766+0000","last_unstale":"2024-03-26T06:18:35.359807+0000","last_undegraded":"2024-03-26T06:18:35.359807+0000","last_fullsized":"2024-03-26T06:18:35.359807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:48:52.836101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719657+0000","last_change":"2024-03-26T06:18:34.346719+0000","last_active":"2024-03-26T06:18:35.719657+0000","last_peered":"2024-03-26T06:18:35.719657+0000","last_clean":"2024-03-26T06:18:35.719657+0000","last_became_active":"2024-03-26T06:18:34.345772+0000","last_became_peered":"2024-03-26T06:18:34.345772+0000","last_unstale":"2024-03-26T06:18:35.719657+0000","last_undegraded":"2024-03-26T06:18:35.719657+0000","last_fullsized":"2024-03-26T06:18:35.719657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:38:32.046892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722965+0000","last_change":"2024-03-26T06:18:34.360259+0000","last_active":"2024-03-26T06:18:35.722965+0000","last_peered":"2024-03-26T06:18:35.722965+0000","last_clean":"2024-03-26T06:18:35.722965+0000","last_became_active":"2024-03-26T06:18:34.358462+0000","last_became_peered":"2024-03-26T06:18:34.358462+0000","last_unstale":"2024-03-26T06:18:35.722965+0000","last_undegraded":"2024-03-26T06:18:35.722965+0000","last_fullsized":"2024-03-26T06:18:35.722965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:48:52.836101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724381+0000","last_change":"2024-03-26T06:18:34.351415+0000","last_active":"2024-03-26T06:18:35.724381+0000","last_peered":"2024-03-26T06:18:35.724381+0000","last_clean":"2024-03-26T06:18:35.724381+0000","last_became_active":"2024-03-26T06:18:34.351068+0000","last_became_peered":"2024-03-26T06:18:34.351068+0000","last_unstale":"2024-03-26T06:18:35.724381+0000","last_undegraded":"2024-03-26T06:18:35.724381+0000","last_fullsized":"2024-03-26T06:18:35.724381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:30:33.033135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719034+0000","last_change":"2024-03-26T06:18:34.336864+0000","last_active":"2024-03-26T06:18:35.719034+0000","last_peered":"2024-03-26T06:18:35.719034+0000","last_clean":"2024-03-26T06:18:35.719034+0000","last_became_active":"2024-03-26T06:18:34.336339+0000","last_became_peered":"2024-03-26T06:18:34.336339+0000","last_unstale":"2024-03-26T06:18:35.719034+0000","last_undegraded":"2024-03-26T06:18:35.719034+0000","last_fullsized":"2024-03-26T06:18:35.719034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:40:17.916180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722283+0000","last_change":"2024-03-26T06:18:34.374274+0000","last_active":"2024-03-26T06:18:35.722283+0000","last_peered":"2024-03-26T06:18:35.722283+0000","last_clean":"2024-03-26T06:18:35.722283+0000","last_became_active":"2024-03-26T06:18:34.373940+0000","last_became_peered":"2024-03-26T06:18:34.373940+0000","last_unstale":"2024-03-26T06:18:35.722283+0000","last_undegraded":"2024-03-26T06:18:35.722283+0000","last_fullsized":"2024-03-26T06:18:35.722283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:35:51.852379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721022+0000","last_change":"2024-03-26T06:18:34.370776+0000","last_active":"2024-03-26T06:18:35.721022+0000","last_peered":"2024-03-26T06:18:35.721022+0000","last_clean":"2024-03-26T06:18:35.721022+0000","last_became_active":"2024-03-26T06:18:34.370466+0000","last_became_peered":"2024-03-26T06:18:34.370466+0000","last_unstale":"2024-03-26T06:18:35.721022+0000","last_undegraded":"2024-03-26T06:18:35.721022+0000","last_fullsized":"2024-03-26T06:18:35.721022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:40:17.916180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722253+0000","last_change":"2024-03-26T06:18:34.343171+0000","last_active":"2024-03-26T06:18:35.722253+0000","last_peered":"2024-03-26T06:18:35.722253+0000","last_clean":"2024-03-26T06:18:35.722253+0000","last_became_active":"2024-03-26T06:18:34.342579+0000","last_became_peered":"2024-03-26T06:18:34.342579+0000","last_unstale":"2024-03-26T06:18:35.722253+0000","last_undegraded":"2024-03-26T06:18:35.722253+0000","last_fullsized":"2024-03-26T06:18:35.722253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:46:07.921912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719925+0000","last_change":"2024-03-26T06:18:34.372899+0000","last_active":"2024-03-26T06:18:35.719925+0000","last_peered":"2024-03-26T06:18:35.719925+0000","last_clean":"2024-03-26T06:18:35.719925+0000","last_became_active":"2024-03-26T06:18:34.372459+0000","last_became_peered":"2024-03-26T06:18:34.372459+0000","last_unstale":"2024-03-26T06:18:35.719925+0000","last_undegraded":"2024-03-26T06:18:35.719925+0000","last_fullsized":"2024-03-26T06:18:35.719925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:33:18.385735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723867+0000","last_change":"2024-03-26T06:18:34.372418+0000","last_active":"2024-03-26T06:18:35.723867+0000","last_peered":"2024-03-26T06:18:35.723867+0000","last_clean":"2024-03-26T06:18:35.723867+0000","last_became_active":"2024-03-26T06:18:34.366192+0000","last_became_peered":"2024-03-26T06:18:34.366192+0000","last_unstale":"2024-03-26T06:18:35.723867+0000","last_undegraded":"2024-03-26T06:18:35.723867+0000","last_fullsized":"2024-03-26T06:18:35.723867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:35:51.852379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360543+0000","last_change":"2024-03-26T06:18:34.371170+0000","last_active":"2024-03-26T06:18:35.360543+0000","last_peered":"2024-03-26T06:18:35.360543+0000","last_clean":"2024-03-26T06:18:35.360543+0000","last_became_active":"2024-03-26T06:18:34.369779+0000","last_became_peered":"2024-03-26T06:18:34.369779+0000","last_unstale":"2024-03-26T06:18:35.360543+0000","last_undegraded":"2024-03-26T06:18:35.360543+0000","last_fullsized":"2024-03-26T06:18:35.360543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:49:35.732896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356415+0000","last_change":"2024-03-26T06:18:34.350434+0000","last_active":"2024-03-26T06:18:35.356415+0000","last_peered":"2024-03-26T06:18:35.356415+0000","last_clean":"2024-03-26T06:18:35.356415+0000","last_became_active":"2024-03-26T06:18:34.350113+0000","last_became_peered":"2024-03-26T06:18:34.350113+0000","last_unstale":"2024-03-26T06:18:35.356415+0000","last_undegraded":"2024-03-26T06:18:35.356415+0000","last_fullsized":"2024-03-26T06:18:35.356415+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:12.177098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360079+0000","last_change":"2024-03-26T06:18:34.370942+0000","last_active":"2024-03-26T06:18:35.360079+0000","last_peered":"2024-03-26T06:18:35.360079+0000","last_clean":"2024-03-26T06:18:35.360079+0000","last_became_active":"2024-03-26T06:18:34.370299+0000","last_became_peered":"2024-03-26T06:18:34.370299+0000","last_unstale":"2024-03-26T06:18:35.360079+0000","last_undegraded":"2024-03-26T06:18:35.360079+0000","last_fullsized":"2024-03-26T06:18:35.360079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:43:45.608182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722684+0000","last_change":"2024-03-26T06:18:34.352552+0000","last_active":"2024-03-26T06:18:35.722684+0000","last_peered":"2024-03-26T06:18:35.722684+0000","last_clean":"2024-03-26T06:18:35.722684+0000","last_became_active":"2024-03-26T06:18:34.352246+0000","last_became_peered":"2024-03-26T06:18:34.352246+0000","last_unstale":"2024-03-26T06:18:35.722684+0000","last_undegraded":"2024-03-26T06:18:35.722684+0000","last_fullsized":"2024-03-26T06:18:35.722684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:03:42.630810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721156+0000","last_change":"2024-03-26T06:18:34.359058+0000","last_active":"2024-03-26T06:18:35.721156+0000","last_peered":"2024-03-26T06:18:35.721156+0000","last_clean":"2024-03-26T06:18:35.721156+0000","last_became_active":"2024-03-26T06:18:34.358716+0000","last_became_peered":"2024-03-26T06:18:34.358716+0000","last_unstale":"2024-03-26T06:18:35.721156+0000","last_undegraded":"2024-03-26T06:18:35.721156+0000","last_fullsized":"2024-03-26T06:18:35.721156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:20:04.732332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721617+0000","last_change":"2024-03-26T06:18:34.355765+0000","last_active":"2024-03-26T06:18:35.721617+0000","last_peered":"2024-03-26T06:18:35.721617+0000","last_clean":"2024-03-26T06:18:35.721617+0000","last_became_active":"2024-03-26T06:18:34.355229+0000","last_became_peered":"2024-03-26T06:18:34.355229+0000","last_unstale":"2024-03-26T06:18:35.721617+0000","last_undegraded":"2024-03-26T06:18:35.721617+0000","last_fullsized":"2024-03-26T06:18:35.721617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T17:45:23.867318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.355907+0000","last_change":"2024-03-26T06:18:34.373691+0000","last_active":"2024-03-26T06:18:35.355907+0000","last_peered":"2024-03-26T06:18:35.355907+0000","last_clean":"2024-03-26T06:18:35.355907+0000","last_became_active":"2024-03-26T06:18:34.373394+0000","last_became_peered":"2024-03-26T06:18:34.373394+0000","last_unstale":"2024-03-26T06:18:35.355907+0000","last_undegraded":"2024-03-26T06:18:35.355907+0000","last_fullsized":"2024-03-26T06:18:35.355907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:16:16.596994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360557+0000","last_change":"2024-03-26T06:18:34.367051+0000","last_active":"2024-03-26T06:18:35.360557+0000","last_peered":"2024-03-26T06:18:35.360557+0000","last_clean":"2024-03-26T06:18:35.360557+0000","last_became_active":"2024-03-26T06:18:34.366569+0000","last_became_peered":"2024-03-26T06:18:34.366569+0000","last_unstale":"2024-03-26T06:18:35.360557+0000","last_undegraded":"2024-03-26T06:18:35.360557+0000","last_fullsized":"2024-03-26T06:18:35.360557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:01:22.281107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615942+0000","last_change":"2024-03-26T06:18:34.351342+0000","last_active":"2024-03-26T06:18:35.615942+0000","last_peered":"2024-03-26T06:18:35.615942+0000","last_clean":"2024-03-26T06:18:35.615942+0000","last_became_active":"2024-03-26T06:18:34.349696+0000","last_became_peered":"2024-03-26T06:18:34.349696+0000","last_unstale":"2024-03-26T06:18:35.615942+0000","last_undegraded":"2024-03-26T06:18:35.615942+0000","last_fullsized":"2024-03-26T06:18:35.615942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:33:18.385735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360442+0000","last_change":"2024-03-26T06:18:34.365010+0000","last_active":"2024-03-26T06:18:35.360442+0000","last_peered":"2024-03-26T06:18:35.360442+0000","last_clean":"2024-03-26T06:18:35.360442+0000","last_became_active":"2024-03-26T06:18:34.364707+0000","last_became_peered":"2024-03-26T06:18:34.364707+0000","last_unstale":"2024-03-26T06:18:35.360442+0000","last_undegraded":"2024-03-26T06:18:35.360442+0000","last_fullsized":"2024-03-26T06:18:35.360442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:53:20.769317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723462+0000","last_change":"2024-03-26T06:18:34.355978+0000","last_active":"2024-03-26T06:18:35.723462+0000","last_peered":"2024-03-26T06:18:35.723462+0000","last_clean":"2024-03-26T06:18:35.723462+0000","last_became_active":"2024-03-26T06:18:34.355662+0000","last_became_peered":"2024-03-26T06:18:34.355662+0000","last_unstale":"2024-03-26T06:18:35.723462+0000","last_undegraded":"2024-03-26T06:18:35.723462+0000","last_fullsized":"2024-03-26T06:18:35.723462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:57:39.258556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359448+0000","last_change":"2024-03-26T06:18:34.361521+0000","last_active":"2024-03-26T06:18:35.359448+0000","last_peered":"2024-03-26T06:18:35.359448+0000","last_clean":"2024-03-26T06:18:35.359448+0000","last_became_active":"2024-03-26T06:18:34.361170+0000","last_became_peered":"2024-03-26T06:18:34.361170+0000","last_unstale":"2024-03-26T06:18:35.359448+0000","last_undegraded":"2024-03-26T06:18:35.359448+0000","last_fullsized":"2024-03-26T06:18:35.359448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:18.434643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359479+0000","last_change":"2024-03-26T06:18:34.369447+0000","last_active":"2024-03-26T06:18:35.359479+0000","last_peered":"2024-03-26T06:18:35.359479+0000","last_clean":"2024-03-26T06:18:35.359479+0000","last_became_active":"2024-03-26T06:18:34.369152+0000","last_became_peered":"2024-03-26T06:18:34.369152+0000","last_unstale":"2024-03-26T06:18:35.359479+0000","last_undegraded":"2024-03-26T06:18:35.359479+0000","last_fullsized":"2024-03-26T06:18:35.359479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:13:17.689820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721994+0000","last_change":"2024-03-26T06:18:34.372557+0000","last_active":"2024-03-26T06:18:35.721994+0000","last_peered":"2024-03-26T06:18:35.721994+0000","last_clean":"2024-03-26T06:18:35.721994+0000","last_became_active":"2024-03-26T06:18:34.355504+0000","last_became_peered":"2024-03-26T06:18:34.355504+0000","last_unstale":"2024-03-26T06:18:35.721994+0000","last_undegraded":"2024-03-26T06:18:35.721994+0000","last_fullsized":"2024-03-26T06:18:35.721994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T17:22:32.115092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.614952+0000","last_change":"2024-03-26T06:18:34.349696+0000","last_active":"2024-03-26T06:18:35.614952+0000","last_peered":"2024-03-26T06:18:35.614952+0000","last_clean":"2024-03-26T06:18:35.614952+0000","last_became_active":"2024-03-26T06:18:34.348008+0000","last_became_peered":"2024-03-26T06:18:34.348008+0000","last_unstale":"2024-03-26T06:18:35.614952+0000","last_undegraded":"2024-03-26T06:18:35.614952+0000","last_fullsized":"2024-03-26T06:18:35.614952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:01:22.281107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723408+0000","last_change":"2024-03-26T06:18:34.364130+0000","last_active":"2024-03-26T06:18:35.723408+0000","last_peered":"2024-03-26T06:18:35.723408+0000","last_clean":"2024-03-26T06:18:35.723408+0000","last_became_active":"2024-03-26T06:18:34.363870+0000","last_became_peered":"2024-03-26T06:18:34.363870+0000","last_unstale":"2024-03-26T06:18:35.723408+0000","last_undegraded":"2024-03-26T06:18:35.723408+0000","last_fullsized":"2024-03-26T06:18:35.723408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:47:07.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360609+0000","last_change":"2024-03-26T06:18:33.340521+0000","last_active":"2024-03-26T06:18:35.360609+0000","last_peered":"2024-03-26T06:18:35.360609+0000","last_clean":"2024-03-26T06:18:35.360609+0000","last_became_active":"2024-03-26T06:18:33.339911+0000","last_became_peered":"2024-03-26T06:18:33.339911+0000","last_unstale":"2024-03-26T06:18:35.360609+0000","last_undegraded":"2024-03-26T06:18:35.360609+0000","last_fullsized":"2024-03-26T06:18:35.360609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:20:11.329891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615795+0000","last_change":"2024-03-26T06:18:34.360796+0000","last_active":"2024-03-26T06:18:35.615795+0000","last_peered":"2024-03-26T06:18:35.615795+0000","last_clean":"2024-03-26T06:18:35.615795+0000","last_became_active":"2024-03-26T06:18:34.360519+0000","last_became_peered":"2024-03-26T06:18:34.360519+0000","last_unstale":"2024-03-26T06:18:35.615795+0000","last_undegraded":"2024-03-26T06:18:35.615795+0000","last_fullsized":"2024-03-26T06:18:35.615795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:42:24.150719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719056+0000","last_change":"2024-03-26T06:18:33.333690+0000","last_active":"2024-03-26T06:18:35.719056+0000","last_peered":"2024-03-26T06:18:35.719056+0000","last_clean":"2024-03-26T06:18:35.719056+0000","last_became_active":"2024-03-26T06:18:33.333356+0000","last_became_peered":"2024-03-26T06:18:33.333356+0000","last_unstale":"2024-03-26T06:18:35.719056+0000","last_undegraded":"2024-03-26T06:18:35.719056+0000","last_fullsized":"2024-03-26T06:18:35.719056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:36:20.827634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720475+0000","last_change":"2024-03-26T06:18:34.370642+0000","last_active":"2024-03-26T06:18:35.720475+0000","last_peered":"2024-03-26T06:18:35.720475+0000","last_clean":"2024-03-26T06:18:35.720475+0000","last_became_active":"2024-03-26T06:18:34.369996+0000","last_became_peered":"2024-03-26T06:18:34.369996+0000","last_unstale":"2024-03-26T06:18:35.720475+0000","last_undegraded":"2024-03-26T06:18:35.720475+0000","last_fullsized":"2024-03-26T06:18:35.720475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:01:22.281107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615918+0000","last_change":"2024-03-26T06:18:33.339802+0000","last_active":"2024-03-26T06:18:35.615918+0000","last_peered":"2024-03-26T06:18:35.615918+0000","last_clean":"2024-03-26T06:18:35.615918+0000","last_became_active":"2024-03-26T06:18:33.339437+0000","last_became_peered":"2024-03-26T06:18:33.339437+0000","last_unstale":"2024-03-26T06:18:35.615918+0000","last_undegraded":"2024-03-26T06:18:35.615918+0000","last_fullsized":"2024-03-26T06:18:35.615918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:06:08.730312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360606+0000","last_change":"2024-03-26T06:18:34.369605+0000","last_active":"2024-03-26T06:18:35.360606+0000","last_peered":"2024-03-26T06:18:35.360606+0000","last_clean":"2024-03-26T06:18:35.360606+0000","last_became_active":"2024-03-26T06:18:34.369327+0000","last_became_peered":"2024-03-26T06:18:34.369327+0000","last_unstale":"2024-03-26T06:18:35.360606+0000","last_undegraded":"2024-03-26T06:18:35.360606+0000","last_fullsized":"2024-03-26T06:18:35.360606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:09:42.150767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720521+0000","last_change":"2024-03-26T06:18:33.333500+0000","last_active":"2024-03-26T06:18:35.720521+0000","last_peered":"2024-03-26T06:18:35.720521+0000","last_clean":"2024-03-26T06:18:35.720521+0000","last_became_active":"2024-03-26T06:18:33.332655+0000","last_became_peered":"2024-03-26T06:18:33.332655+0000","last_unstale":"2024-03-26T06:18:35.720521+0000","last_undegraded":"2024-03-26T06:18:35.720521+0000","last_fullsized":"2024-03-26T06:18:35.720521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:29:31.007850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.718642+0000","last_change":"2024-03-26T06:18:34.346795+0000","last_active":"2024-03-26T06:18:35.718642+0000","last_peered":"2024-03-26T06:18:35.718642+0000","last_clean":"2024-03-26T06:18:35.718642+0000","last_became_active":"2024-03-26T06:18:34.346434+0000","last_became_peered":"2024-03-26T06:18:34.346434+0000","last_unstale":"2024-03-26T06:18:35.718642+0000","last_undegraded":"2024-03-26T06:18:35.718642+0000","last_fullsized":"2024-03-26T06:18:35.718642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:49:35.732896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722949+0000","last_change":"2024-03-26T06:18:33.321745+0000","last_active":"2024-03-26T06:18:35.722949+0000","last_peered":"2024-03-26T06:18:35.722949+0000","last_clean":"2024-03-26T06:18:35.722949+0000","last_became_active":"2024-03-26T06:18:33.321362+0000","last_became_peered":"2024-03-26T06:18:33.321362+0000","last_unstale":"2024-03-26T06:18:35.722949+0000","last_undegraded":"2024-03-26T06:18:35.722949+0000","last_fullsized":"2024-03-26T06:18:35.722949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:46:17.423008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722646+0000","last_change":"2024-03-26T06:18:34.353640+0000","last_active":"2024-03-26T06:18:35.722646+0000","last_peered":"2024-03-26T06:18:35.722646+0000","last_clean":"2024-03-26T06:18:35.722646+0000","last_became_active":"2024-03-26T06:18:34.353377+0000","last_became_peered":"2024-03-26T06:18:34.353377+0000","last_unstale":"2024-03-26T06:18:35.722646+0000","last_undegraded":"2024-03-26T06:18:35.722646+0000","last_fullsized":"2024-03-26T06:18:35.722646+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:38:00.372104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722372+0000","last_change":"2024-03-26T06:18:33.340607+0000","last_active":"2024-03-26T06:18:35.722372+0000","last_peered":"2024-03-26T06:18:35.722372+0000","last_clean":"2024-03-26T06:18:35.722372+0000","last_became_active":"2024-03-26T06:18:33.340334+0000","last_became_peered":"2024-03-26T06:18:33.340334+0000","last_unstale":"2024-03-26T06:18:35.722372+0000","last_undegraded":"2024-03-26T06:18:35.722372+0000","last_fullsized":"2024-03-26T06:18:35.722372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:36:20.827634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721438+0000","last_change":"2024-03-26T06:18:34.364000+0000","last_active":"2024-03-26T06:18:35.721438+0000","last_peered":"2024-03-26T06:18:35.721438+0000","last_clean":"2024-03-26T06:18:35.721438+0000","last_became_active":"2024-03-26T06:18:34.363683+0000","last_became_peered":"2024-03-26T06:18:34.363683+0000","last_unstale":"2024-03-26T06:18:35.721438+0000","last_undegraded":"2024-03-26T06:18:35.721438+0000","last_fullsized":"2024-03-26T06:18:35.721438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:42:24.150719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.614810+0000","last_change":"2024-03-26T06:18:33.329380+0000","last_active":"2024-03-26T06:18:35.614810+0000","last_peered":"2024-03-26T06:18:35.614810+0000","last_clean":"2024-03-26T06:18:35.614810+0000","last_became_active":"2024-03-26T06:18:33.329069+0000","last_became_peered":"2024-03-26T06:18:33.329069+0000","last_unstale":"2024-03-26T06:18:35.614810+0000","last_undegraded":"2024-03-26T06:18:35.614810+0000","last_fullsized":"2024-03-26T06:18:35.614810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:20:11.329891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360249+0000","last_change":"2024-03-26T06:18:34.376982+0000","last_active":"2024-03-26T06:18:35.360249+0000","last_peered":"2024-03-26T06:18:35.360249+0000","last_clean":"2024-03-26T06:18:35.360249+0000","last_became_active":"2024-03-26T06:18:34.376481+0000","last_became_peered":"2024-03-26T06:18:34.376481+0000","last_unstale":"2024-03-26T06:18:35.360249+0000","last_undegraded":"2024-03-26T06:18:35.360249+0000","last_fullsized":"2024-03-26T06:18:35.360249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:30:33.033135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719066+0000","last_change":"2024-03-26T06:18:33.333054+0000","last_active":"2024-03-26T06:18:35.719066+0000","last_peered":"2024-03-26T06:18:35.719066+0000","last_clean":"2024-03-26T06:18:35.719066+0000","last_became_active":"2024-03-26T06:18:33.332589+0000","last_became_peered":"2024-03-26T06:18:33.332589+0000","last_unstale":"2024-03-26T06:18:35.719066+0000","last_undegraded":"2024-03-26T06:18:35.719066+0000","last_fullsized":"2024-03-26T06:18:35.719066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:26:00.073024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356303+0000","last_change":"2024-03-26T06:18:34.353255+0000","last_active":"2024-03-26T06:18:35.356303+0000","last_peered":"2024-03-26T06:18:35.356303+0000","last_clean":"2024-03-26T06:18:35.356303+0000","last_became_active":"2024-03-26T06:18:34.352988+0000","last_became_peered":"2024-03-26T06:18:34.352988+0000","last_unstale":"2024-03-26T06:18:35.356303+0000","last_undegraded":"2024-03-26T06:18:35.356303+0000","last_fullsized":"2024-03-26T06:18:35.356303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:46:24.069097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360703+0000","last_change":"2024-03-26T06:18:33.329409+0000","last_active":"2024-03-26T06:18:35.360703+0000","last_peered":"2024-03-26T06:18:35.360703+0000","last_clean":"2024-03-26T06:18:35.360703+0000","last_became_active":"2024-03-26T06:18:33.329008+0000","last_became_peered":"2024-03-26T06:18:33.329008+0000","last_unstale":"2024-03-26T06:18:35.360703+0000","last_undegraded":"2024-03-26T06:18:35.360703+0000","last_fullsized":"2024-03-26T06:18:35.360703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:42:23.139085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724061+0000","last_change":"2024-03-26T06:18:34.376033+0000","last_active":"2024-03-26T06:18:35.724061+0000","last_peered":"2024-03-26T06:18:35.724061+0000","last_clean":"2024-03-26T06:18:35.724061+0000","last_became_active":"2024-03-26T06:18:34.373359+0000","last_became_peered":"2024-03-26T06:18:34.373359+0000","last_unstale":"2024-03-26T06:18:35.724061+0000","last_undegraded":"2024-03-26T06:18:35.724061+0000","last_fullsized":"2024-03-26T06:18:35.724061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:44:50.392750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723477+0000","last_change":"2024-03-26T06:18:33.324989+0000","last_active":"2024-03-26T06:18:35.723477+0000","last_peered":"2024-03-26T06:18:35.723477+0000","last_clean":"2024-03-26T06:18:35.723477+0000","last_became_active":"2024-03-26T06:18:33.324551+0000","last_became_peered":"2024-03-26T06:18:33.324551+0000","last_unstale":"2024-03-26T06:18:35.723477+0000","last_undegraded":"2024-03-26T06:18:35.723477+0000","last_fullsized":"2024-03-26T06:18:35.723477+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:53:19.757682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719489+0000","last_change":"2024-03-26T06:18:34.358233+0000","last_active":"2024-03-26T06:18:35.719489+0000","last_peered":"2024-03-26T06:18:35.719489+0000","last_clean":"2024-03-26T06:18:35.719489+0000","last_became_active":"2024-03-26T06:18:34.357648+0000","last_became_peered":"2024-03-26T06:18:34.357648+0000","last_unstale":"2024-03-26T06:18:35.719489+0000","last_undegraded":"2024-03-26T06:18:35.719489+0000","last_fullsized":"2024-03-26T06:18:35.719489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:33:18.385735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724644+0000","last_change":"2024-03-26T06:18:33.330089+0000","last_active":"2024-03-26T06:18:35.724644+0000","last_peered":"2024-03-26T06:18:35.724644+0000","last_clean":"2024-03-26T06:18:35.724644+0000","last_became_active":"2024-03-26T06:18:33.329802+0000","last_became_peered":"2024-03-26T06:18:33.329802+0000","last_unstale":"2024-03-26T06:18:35.724644+0000","last_undegraded":"2024-03-26T06:18:35.724644+0000","last_fullsized":"2024-03-26T06:18:35.724644+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:37:11.369553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720502+0000","last_change":"2024-03-26T06:18:34.362733+0000","last_active":"2024-03-26T06:18:35.720502+0000","last_peered":"2024-03-26T06:18:35.720502+0000","last_clean":"2024-03-26T06:18:35.720502+0000","last_became_active":"2024-03-26T06:18:34.361860+0000","last_became_peered":"2024-03-26T06:18:34.361860+0000","last_unstale":"2024-03-26T06:18:35.720502+0000","last_undegraded":"2024-03-26T06:18:35.720502+0000","last_fullsized":"2024-03-26T06:18:35.720502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:29:42.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360259+0000","last_change":"2024-03-26T06:18:33.332908+0000","last_active":"2024-03-26T06:18:35.360259+0000","last_peered":"2024-03-26T06:18:35.360259+0000","last_clean":"2024-03-26T06:18:35.360259+0000","last_became_active":"2024-03-26T06:18:33.332636+0000","last_became_peered":"2024-03-26T06:18:33.332636+0000","last_unstale":"2024-03-26T06:18:35.360259+0000","last_undegraded":"2024-03-26T06:18:35.360259+0000","last_fullsized":"2024-03-26T06:18:35.360259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:20:03.720697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.718707+0000","last_change":"2024-03-26T06:18:34.343304+0000","last_active":"2024-03-26T06:18:35.718707+0000","last_peered":"2024-03-26T06:18:35.718707+0000","last_clean":"2024-03-26T06:18:35.718707+0000","last_became_active":"2024-03-26T06:18:34.342805+0000","last_became_peered":"2024-03-26T06:18:34.342805+0000","last_unstale":"2024-03-26T06:18:35.718707+0000","last_undegraded":"2024-03-26T06:18:35.718707+0000","last_fullsized":"2024-03-26T06:18:35.718707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:01:22.281107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360465+0000","last_change":"2024-03-26T06:18:33.326716+0000","last_active":"2024-03-26T06:18:35.360465+0000","last_peered":"2024-03-26T06:18:35.360465+0000","last_clean":"2024-03-26T06:18:35.360465+0000","last_became_active":"2024-03-26T06:18:33.324895+0000","last_became_peered":"2024-03-26T06:18:33.324895+0000","last_unstale":"2024-03-26T06:18:35.360465+0000","last_undegraded":"2024-03-26T06:18:35.360465+0000","last_fullsized":"2024-03-26T06:18:35.360465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:40:16.904545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359910+0000","last_change":"2024-03-26T06:18:34.342671+0000","last_active":"2024-03-26T06:18:35.359910+0000","last_peered":"2024-03-26T06:18:35.359910+0000","last_clean":"2024-03-26T06:18:35.359910+0000","last_became_active":"2024-03-26T06:18:34.342329+0000","last_became_peered":"2024-03-26T06:18:34.342329+0000","last_unstale":"2024-03-26T06:18:35.359910+0000","last_undegraded":"2024-03-26T06:18:35.359910+0000","last_fullsized":"2024-03-26T06:18:35.359910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:57:39.258556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.614950+0000","last_change":"2024-03-26T06:18:33.329622+0000","last_active":"2024-03-26T06:18:35.614950+0000","last_peered":"2024-03-26T06:18:35.614950+0000","last_clean":"2024-03-26T06:18:35.614950+0000","last_became_active":"2024-03-26T06:18:33.329327+0000","last_became_peered":"2024-03-26T06:18:33.329327+0000","last_unstale":"2024-03-26T06:18:35.614950+0000","last_undegraded":"2024-03-26T06:18:35.614950+0000","last_fullsized":"2024-03-26T06:18:35.614950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:36:20.827634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.721894+0000","last_change":"2024-03-26T06:18:34.356849+0000","last_active":"2024-03-26T06:18:35.721894+0000","last_peered":"2024-03-26T06:18:35.721894+0000","last_clean":"2024-03-26T06:18:35.721894+0000","last_became_active":"2024-03-26T06:18:34.356541+0000","last_became_peered":"2024-03-26T06:18:34.356541+0000","last_unstale":"2024-03-26T06:18:35.721894+0000","last_undegraded":"2024-03-26T06:18:35.721894+0000","last_fullsized":"2024-03-26T06:18:35.721894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:11:54.009514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359680+0000","last_change":"2024-03-26T06:18:33.337975+0000","last_active":"2024-03-26T06:18:35.359680+0000","last_peered":"2024-03-26T06:18:35.359680+0000","last_clean":"2024-03-26T06:18:35.359680+0000","last_became_active":"2024-03-26T06:18:33.337122+0000","last_became_peered":"2024-03-26T06:18:33.337122+0000","last_unstale":"2024-03-26T06:18:35.359680+0000","last_undegraded":"2024-03-26T06:18:35.359680+0000","last_fullsized":"2024-03-26T06:18:35.359680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:26:00.073024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360105+0000","last_change":"2024-03-26T06:18:34.349574+0000","last_active":"2024-03-26T06:18:35.360105+0000","last_peered":"2024-03-26T06:18:35.360105+0000","last_clean":"2024-03-26T06:18:35.360105+0000","last_became_active":"2024-03-26T06:18:34.349284+0000","last_became_peered":"2024-03-26T06:18:34.349284+0000","last_unstale":"2024-03-26T06:18:35.360105+0000","last_undegraded":"2024-03-26T06:18:35.360105+0000","last_fullsized":"2024-03-26T06:18:35.360105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:11:10.424843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720228+0000","last_change":"2024-03-26T06:18:33.336543+0000","last_active":"2024-03-26T06:18:35.720228+0000","last_peered":"2024-03-26T06:18:35.720228+0000","last_clean":"2024-03-26T06:18:35.720228+0000","last_became_active":"2024-03-26T06:18:33.335318+0000","last_became_peered":"2024-03-26T06:18:33.335318+0000","last_unstale":"2024-03-26T06:18:35.720228+0000","last_undegraded":"2024-03-26T06:18:35.720228+0000","last_fullsized":"2024-03-26T06:18:35.720228+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:37:11.369553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360315+0000","last_change":"2024-03-26T06:18:34.361797+0000","last_active":"2024-03-26T06:18:35.360315+0000","last_peered":"2024-03-26T06:18:35.360315+0000","last_clean":"2024-03-26T06:18:35.360315+0000","last_became_active":"2024-03-26T06:18:34.358023+0000","last_became_peered":"2024-03-26T06:18:34.358023+0000","last_unstale":"2024-03-26T06:18:35.360315+0000","last_undegraded":"2024-03-26T06:18:35.360315+0000","last_fullsized":"2024-03-26T06:18:35.360315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T09:48:21.581737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724742+0000","last_change":"2024-03-26T06:18:33.336277+0000","last_active":"2024-03-26T06:18:35.724742+0000","last_peered":"2024-03-26T06:18:35.724742+0000","last_clean":"2024-03-26T06:18:35.724742+0000","last_became_active":"2024-03-26T06:18:33.335956+0000","last_became_peered":"2024-03-26T06:18:33.335956+0000","last_unstale":"2024-03-26T06:18:35.724742+0000","last_undegraded":"2024-03-26T06:18:35.724742+0000","last_fullsized":"2024-03-26T06:18:35.724742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:13:16.678185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724480+0000","last_change":"2024-03-26T06:18:34.350739+0000","last_active":"2024-03-26T06:18:35.724480+0000","last_peered":"2024-03-26T06:18:35.724480+0000","last_clean":"2024-03-26T06:18:35.724480+0000","last_became_active":"2024-03-26T06:18:34.350473+0000","last_became_peered":"2024-03-26T06:18:34.350473+0000","last_unstale":"2024-03-26T06:18:35.724480+0000","last_undegraded":"2024-03-26T06:18:35.724480+0000","last_fullsized":"2024-03-26T06:18:35.724480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:08:37.987374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720763+0000","last_change":"2024-03-26T06:18:33.339350+0000","last_active":"2024-03-26T06:18:35.720763+0000","last_peered":"2024-03-26T06:18:35.720763+0000","last_clean":"2024-03-26T06:18:35.720763+0000","last_became_active":"2024-03-26T06:18:33.339032+0000","last_became_peered":"2024-03-26T06:18:33.339032+0000","last_unstale":"2024-03-26T06:18:35.720763+0000","last_undegraded":"2024-03-26T06:18:35.720763+0000","last_fullsized":"2024-03-26T06:18:35.720763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:00:12.476047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719810+0000","last_change":"2024-03-26T06:18:34.364898+0000","last_active":"2024-03-26T06:18:35.719810+0000","last_peered":"2024-03-26T06:18:35.719810+0000","last_clean":"2024-03-26T06:18:35.719810+0000","last_became_active":"2024-03-26T06:18:34.364621+0000","last_became_peered":"2024-03-26T06:18:34.364621+0000","last_unstale":"2024-03-26T06:18:35.719810+0000","last_undegraded":"2024-03-26T06:18:35.719810+0000","last_fullsized":"2024-03-26T06:18:35.719810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:49:35.732896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356339+0000","last_change":"2024-03-26T06:18:33.334385+0000","last_active":"2024-03-26T06:18:35.356339+0000","last_peered":"2024-03-26T06:18:35.356339+0000","last_clean":"2024-03-26T06:18:35.356339+0000","last_became_active":"2024-03-26T06:18:33.332434+0000","last_became_peered":"2024-03-26T06:18:33.332434+0000","last_unstale":"2024-03-26T06:18:35.356339+0000","last_undegraded":"2024-03-26T06:18:35.356339+0000","last_fullsized":"2024-03-26T06:18:35.356339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:36:59.593572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356538+0000","last_change":"2024-03-26T06:18:34.360171+0000","last_active":"2024-03-26T06:18:35.356538+0000","last_peered":"2024-03-26T06:18:35.356538+0000","last_clean":"2024-03-26T06:18:35.356538+0000","last_became_active":"2024-03-26T06:18:34.359182+0000","last_became_peered":"2024-03-26T06:18:34.359182+0000","last_unstale":"2024-03-26T06:18:35.356538+0000","last_undegraded":"2024-03-26T06:18:35.356538+0000","last_fullsized":"2024-03-26T06:18:35.356538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:26:01.084659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615571+0000","last_change":"2024-03-26T06:18:33.339801+0000","last_active":"2024-03-26T06:18:35.615571+0000","last_peered":"2024-03-26T06:18:35.615571+0000","last_clean":"2024-03-26T06:18:35.615571+0000","last_became_active":"2024-03-26T06:18:33.339401+0000","last_became_peered":"2024-03-26T06:18:33.339401+0000","last_unstale":"2024-03-26T06:18:35.615571+0000","last_undegraded":"2024-03-26T06:18:35.615571+0000","last_fullsized":"2024-03-26T06:18:35.615571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:29:31.007850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720639+0000","last_change":"2024-03-26T06:18:34.373610+0000","last_active":"2024-03-26T06:18:35.720639+0000","last_peered":"2024-03-26T06:18:35.720639+0000","last_clean":"2024-03-26T06:18:35.720639+0000","last_became_active":"2024-03-26T06:18:34.373258+0000","last_became_peered":"2024-03-26T06:18:34.373258+0000","last_unstale":"2024-03-26T06:18:35.720639+0000","last_undegraded":"2024-03-26T06:18:35.720639+0000","last_fullsized":"2024-03-26T06:18:35.720639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T16:38:32.046892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356062+0000","last_change":"2024-03-26T06:18:33.320558+0000","last_active":"2024-03-26T06:18:35.356062+0000","last_peered":"2024-03-26T06:18:35.356062+0000","last_clean":"2024-03-26T06:18:35.356062+0000","last_became_active":"2024-03-26T06:18:33.319427+0000","last_became_peered":"2024-03-26T06:18:33.319427+0000","last_unstale":"2024-03-26T06:18:35.356062+0000","last_undegraded":"2024-03-26T06:18:35.356062+0000","last_fullsized":"2024-03-26T06:18:35.356062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T17:31:14.125284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.718726+0000","last_change":"2024-03-26T06:18:34.374144+0000","last_active":"2024-03-26T06:18:35.718726+0000","last_peered":"2024-03-26T06:18:35.718726+0000","last_clean":"2024-03-26T06:18:35.718726+0000","last_became_active":"2024-03-26T06:18:34.373801+0000","last_became_peered":"2024-03-26T06:18:34.373801+0000","last_unstale":"2024-03-26T06:18:35.718726+0000","last_undegraded":"2024-03-26T06:18:35.718726+0000","last_fullsized":"2024-03-26T06:18:35.718726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:29:42.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.356138+0000","last_change":"2024-03-26T06:18:33.339852+0000","last_active":"2024-03-26T06:18:35.356138+0000","last_peered":"2024-03-26T06:18:35.356138+0000","last_clean":"2024-03-26T06:18:35.356138+0000","last_became_active":"2024-03-26T06:18:33.339488+0000","last_became_peered":"2024-03-26T06:18:33.339488+0000","last_unstale":"2024-03-26T06:18:35.356138+0000","last_undegraded":"2024-03-26T06:18:35.356138+0000","last_fullsized":"2024-03-26T06:18:35.356138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:09:14.462296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722364+0000","last_change":"2024-03-26T06:18:34.361182+0000","last_active":"2024-03-26T06:18:35.722364+0000","last_peered":"2024-03-26T06:18:35.722364+0000","last_clean":"2024-03-26T06:18:35.722364+0000","last_became_active":"2024-03-26T06:18:34.359136+0000","last_became_peered":"2024-03-26T06:18:34.359136+0000","last_unstale":"2024-03-26T06:18:35.722364+0000","last_undegraded":"2024-03-26T06:18:35.722364+0000","last_fullsized":"2024-03-26T06:18:35.722364+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T15:44:50.392750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.722262+0000","last_change":"2024-03-26T06:18:33.336295+0000","last_active":"2024-03-26T06:18:35.722262+0000","last_peered":"2024-03-26T06:18:35.722262+0000","last_clean":"2024-03-26T06:18:35.722262+0000","last_became_active":"2024-03-26T06:18:33.334648+0000","last_became_peered":"2024-03-26T06:18:33.334648+0000","last_unstale":"2024-03-26T06:18:35.722262+0000","last_undegraded":"2024-03-26T06:18:35.722262+0000","last_fullsized":"2024-03-26T06:18:35.722262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T18:15:24.954097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360280+0000","last_change":"2024-03-26T06:18:34.372901+0000","last_active":"2024-03-26T06:18:35.360280+0000","last_peered":"2024-03-26T06:18:35.360280+0000","last_clean":"2024-03-26T06:18:35.360280+0000","last_became_active":"2024-03-26T06:18:34.372714+0000","last_became_peered":"2024-03-26T06:18:34.372714+0000","last_unstale":"2024-03-26T06:18:35.360280+0000","last_undegraded":"2024-03-26T06:18:35.360280+0000","last_fullsized":"2024-03-26T06:18:35.360280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:12:49.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.355942+0000","last_change":"2024-03-26T06:18:33.322380+0000","last_active":"2024-03-26T06:18:35.355942+0000","last_peered":"2024-03-26T06:18:35.355942+0000","last_clean":"2024-03-26T06:18:35.355942+0000","last_became_active":"2024-03-26T06:18:33.322089+0000","last_became_peered":"2024-03-26T06:18:33.322089+0000","last_unstale":"2024-03-26T06:18:35.355942+0000","last_undegraded":"2024-03-26T06:18:35.355942+0000","last_fullsized":"2024-03-26T06:18:35.355942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:11:32.748567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615194+0000","last_change":"2024-03-26T06:18:34.350024+0000","last_active":"2024-03-26T06:18:35.615194+0000","last_peered":"2024-03-26T06:18:35.615194+0000","last_clean":"2024-03-26T06:18:35.615194+0000","last_became_active":"2024-03-26T06:18:34.349747+0000","last_became_peered":"2024-03-26T06:18:34.349747+0000","last_unstale":"2024-03-26T06:18:35.615194+0000","last_undegraded":"2024-03-26T06:18:35.615194+0000","last_fullsized":"2024-03-26T06:18:35.615194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:20:04.732332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724885+0000","last_change":"2024-03-26T06:18:33.331298+0000","last_active":"2024-03-26T06:18:35.724885+0000","last_peered":"2024-03-26T06:18:35.724885+0000","last_clean":"2024-03-26T06:18:35.724885+0000","last_became_active":"2024-03-26T06:18:33.330304+0000","last_became_peered":"2024-03-26T06:18:33.330304+0000","last_unstale":"2024-03-26T06:18:35.724885+0000","last_undegraded":"2024-03-26T06:18:35.724885+0000","last_fullsized":"2024-03-26T06:18:35.724885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:43:44.596547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724269+0000","last_change":"2024-03-26T06:18:34.372999+0000","last_active":"2024-03-26T06:18:35.724269+0000","last_peered":"2024-03-26T06:18:35.724269+0000","last_clean":"2024-03-26T06:18:35.724269+0000","last_became_active":"2024-03-26T06:18:34.372740+0000","last_became_peered":"2024-03-26T06:18:34.372740+0000","last_unstale":"2024-03-26T06:18:35.724269+0000","last_undegraded":"2024-03-26T06:18:35.724269+0000","last_fullsized":"2024-03-26T06:18:35.724269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:38:00.372104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:36.335984+0000","last_change":"2024-03-26T06:18:33.326714+0000","last_active":"2024-03-26T06:18:36.335984+0000","last_peered":"2024-03-26T06:18:36.335984+0000","last_clean":"2024-03-26T06:18:36.335984+0000","last_became_active":"2024-03-26T06:18:33.326189+0000","last_became_peered":"2024-03-26T06:18:33.326189+0000","last_unstale":"2024-03-26T06:18:36.335984+0000","last_undegraded":"2024-03-26T06:18:36.335984+0000","last_fullsized":"2024-03-26T06:18:36.335984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T06:37:14.730216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.360566+0000","last_change":"2024-03-26T06:18:34.355446+0000","last_active":"2024-03-26T06:18:35.360566+0000","last_peered":"2024-03-26T06:18:35.360566+0000","last_clean":"2024-03-26T06:18:35.360566+0000","last_became_active":"2024-03-26T06:18:34.355194+0000","last_became_peered":"2024-03-26T06:18:34.355194+0000","last_unstale":"2024-03-26T06:18:35.360566+0000","last_undegraded":"2024-03-26T06:18:35.360566+0000","last_fullsized":"2024-03-26T06:18:35.360566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:56:14.438674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719374+0000","last_change":"2024-03-26T06:18:33.329425+0000","last_active":"2024-03-26T06:18:35.719374+0000","last_peered":"2024-03-26T06:18:35.719374+0000","last_clean":"2024-03-26T06:18:35.719374+0000","last_became_active":"2024-03-26T06:18:33.329118+0000","last_became_peered":"2024-03-26T06:18:33.329118+0000","last_unstale":"2024-03-26T06:18:35.719374+0000","last_undegraded":"2024-03-26T06:18:35.719374+0000","last_fullsized":"2024-03-26T06:18:35.719374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T13:20:11.329891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719069+0000","last_change":"2024-03-26T06:18:34.343519+0000","last_active":"2024-03-26T06:18:35.719069+0000","last_peered":"2024-03-26T06:18:35.719069+0000","last_clean":"2024-03-26T06:18:35.719069+0000","last_became_active":"2024-03-26T06:18:34.343117+0000","last_became_peered":"2024-03-26T06:18:34.343117+0000","last_unstale":"2024-03-26T06:18:35.719069+0000","last_undegraded":"2024-03-26T06:18:35.719069+0000","last_fullsized":"2024-03-26T06:18:35.719069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T08:20:04.732332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719754+0000","last_change":"2024-03-26T06:18:33.331043+0000","last_active":"2024-03-26T06:18:35.719754+0000","last_peered":"2024-03-26T06:18:35.719754+0000","last_clean":"2024-03-26T06:18:35.719754+0000","last_became_active":"2024-03-26T06:18:33.330780+0000","last_became_peered":"2024-03-26T06:18:33.330780+0000","last_unstale":"2024-03-26T06:18:35.719754+0000","last_undegraded":"2024-03-26T06:18:35.719754+0000","last_fullsized":"2024-03-26T06:18:35.719754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T11:00:12.476047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.615023+0000","last_change":"2024-03-26T06:18:34.354028+0000","last_active":"2024-03-26T06:18:35.615023+0000","last_peered":"2024-03-26T06:18:35.615023+0000","last_clean":"2024-03-26T06:18:35.615023+0000","last_became_active":"2024-03-26T06:18:34.353751+0000","last_became_peered":"2024-03-26T06:18:34.353751+0000","last_unstale":"2024-03-26T06:18:35.615023+0000","last_undegraded":"2024-03-26T06:18:35.615023+0000","last_fullsized":"2024-03-26T06:18:35.615023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:29:42.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359453+0000","last_change":"2024-03-26T06:18:33.330782+0000","last_active":"2024-03-26T06:18:35.359453+0000","last_peered":"2024-03-26T06:18:35.359453+0000","last_clean":"2024-03-26T06:18:35.359453+0000","last_became_active":"2024-03-26T06:18:33.330171+0000","last_became_peered":"2024-03-26T06:18:33.330171+0000","last_unstale":"2024-03-26T06:18:35.359453+0000","last_undegraded":"2024-03-26T06:18:35.359453+0000","last_fullsized":"2024-03-26T06:18:35.359453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:11.165463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719739+0000","last_change":"2024-03-26T06:18:34.363504+0000","last_active":"2024-03-26T06:18:35.719739+0000","last_peered":"2024-03-26T06:18:35.719739+0000","last_clean":"2024-03-26T06:18:35.719739+0000","last_became_active":"2024-03-26T06:18:34.362629+0000","last_became_peered":"2024-03-26T06:18:34.362629+0000","last_unstale":"2024-03-26T06:18:35.719739+0000","last_undegraded":"2024-03-26T06:18:35.719739+0000","last_fullsized":"2024-03-26T06:18:35.719739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:53:20.769317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.719975+0000","last_change":"2024-03-26T06:18:33.333066+0000","last_active":"2024-03-26T06:18:35.719975+0000","last_peered":"2024-03-26T06:18:35.719975+0000","last_clean":"2024-03-26T06:18:35.719975+0000","last_became_active":"2024-03-26T06:18:33.332700+0000","last_became_peered":"2024-03-26T06:18:33.332700+0000","last_unstale":"2024-03-26T06:18:35.719975+0000","last_undegraded":"2024-03-26T06:18:35.719975+0000","last_fullsized":"2024-03-26T06:18:35.719975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:38:11.165463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723701+0000","last_change":"2024-03-26T06:18:34.374044+0000","last_active":"2024-03-26T06:18:35.723701+0000","last_peered":"2024-03-26T06:18:35.723701+0000","last_clean":"2024-03-26T06:18:35.723701+0000","last_became_active":"2024-03-26T06:18:34.373336+0000","last_became_peered":"2024-03-26T06:18:34.373336+0000","last_unstale":"2024-03-26T06:18:35.723701+0000","last_undegraded":"2024-03-26T06:18:35.723701+0000","last_fullsized":"2024-03-26T06:18:35.723701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T14:46:07.921912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.359865+0000","last_change":"2024-03-26T06:18:33.330912+0000","last_active":"2024-03-26T06:18:35.359865+0000","last_peered":"2024-03-26T06:18:35.359865+0000","last_clean":"2024-03-26T06:18:35.359865+0000","last_became_active":"2024-03-26T06:18:33.330619+0000","last_became_peered":"2024-03-26T06:18:33.330619+0000","last_unstale":"2024-03-26T06:18:35.359865+0000","last_undegraded":"2024-03-26T06:18:35.359865+0000","last_fullsized":"2024-03-26T06:18:35.359865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:29:41.292833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.724232+0000","last_change":"2024-03-26T06:18:34.358865+0000","last_active":"2024-03-26T06:18:35.724232+0000","last_peered":"2024-03-26T06:18:35.724232+0000","last_clean":"2024-03-26T06:18:35.724232+0000","last_became_active":"2024-03-26T06:18:34.358566+0000","last_became_peered":"2024-03-26T06:18:34.358566+0000","last_unstale":"2024-03-26T06:18:35.724232+0000","last_undegraded":"2024-03-26T06:18:35.724232+0000","last_fullsized":"2024-03-26T06:18:35.724232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:33.290646+0000","last_clean_scrub_stamp":"2024-03-26T06:18:33.290646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T12:11:10.424843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.723624+0000","last_change":"2024-03-26T06:18:33.338378+0000","last_active":"2024-03-26T06:18:35.723624+0000","last_peered":"2024-03-26T06:18:35.723624+0000","last_clean":"2024-03-26T06:18:35.723624+0000","last_became_active":"2024-03-26T06:18:33.337717+0000","last_became_peered":"2024-03-26T06:18:33.337717+0000","last_unstale":"2024-03-26T06:18:35.723624+0000","last_undegraded":"2024-03-26T06:18:35.723624+0000","last_fullsized":"2024-03-26T06:18:35.723624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:18:32.279012+0000","last_clean_scrub_stamp":"2024-03-26T06:18:32.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T10:06:08.730312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-26T06:18:35.720788+0000","last_change":"2024-03-26T06:16:49.590440+0000","last_active":"2024-03-26T06:18:35.720788+0000","last_peered":"2024-03-26T06:18:35.720788+0000","last_clean":"2024-03-26T06:18:35.720788+0000","last_became_active":"2024-03-26T06:16:49.589017+0000","last_became_peered":"2024-03-26T06:16:49.589017+0000","last_unstale":"2024-03-26T06:18:35.720788+0000","last_undegraded":"2024-03-26T06:18:35.720788+0000","last_fullsized":"2024-03-26T06:18:35.720788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T06:16:48.290068+0000","last_clean_scrub_stamp":"2024-03-26T06:16:48.290068+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T07:00:05.158039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1060864,"data_stored":786749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":195281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":195303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":196345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":194789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":785101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-26T06:18:39.354 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-26T06:18:39.355 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-26T06:18:39.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.612+0000 7f3988400640 1 Processor -- start 2024-03-26T06:18:39.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.612+0000 7f3988400640 1 -- start start 2024-03-26T06:18:39.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.614+0000 7f3988400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f39800aeb80 0x7f39800cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.614+0000 7f3988400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f398006de00 0x7f39800b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.614+0000 7f3988400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39801633c0 con 0x7f39800b3630 2024-03-26T06:18:39.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.614+0000 7f3988400640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800b3aa0 con 0x7f39800aeb80 2024-03-26T06:18:39.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.614+0000 7f3988400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3980162840 con 0x7f398006de00 2024-03-26T06:18:39.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.614+0000 7f3986400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f39800b3630 0x7f3980165dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43428/0 (socket says 172.21.15.63:43428) 2024-03-26T06:18:39.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.614+0000 7f3986400640 1 -- 172.21.15.63:0/2058000460 learned_addr learned my addr 172.21.15.63:0/2058000460 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:39.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f3985a00640 1 --2- 172.21.15.63:0/2058000460 >> v2:172.21.15.204:3300/0 conn(0x7f39800aeb80 0x7f39800cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f3985000640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f398006de00 0x7f39800b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427714700 0 0) 0x7f39801633c0 con 0x7f39800b3630 2024-03-26T06:18:39.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3968003520 con 0x7f39800b3630 2024-03-26T06:18:39.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057351392 0 0) 0x7f3968003520 con 0x7f39800b3630 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f398006de00 msgr2=0x7f39800b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f398006de00 0x7f39800b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 >> v2:172.21.15.204:3300/0 conn(0x7f39800aeb80 msgr2=0x7f39800cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 --2- 172.21.15.63:0/2058000460 >> v2:172.21.15.204:3300/0 conn(0x7f39800aeb80 0x7f39800cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980162b20 con 0x7f39800b3630 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f39780019f0 con 0x7f39800b3630 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 >> v1:172.21.15.63:6789/0 conn(0x7f39800b3630 legacy=0x7f3980165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39680039b0 0x7f3968003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f398006de00 0x7f3968004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3968004d40 0x7f39680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800b3aa0 con 0x7f3968004d40 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3980162840 con 0x7f39680039b0 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.615+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396800ba40 con 0x7f398006de00 2024-03-26T06:18:39.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.616+0000 7f3986400640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3968004d40 0x7f39680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.616+0000 7f3985a00640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39680039b0 0x7f3968003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.616+0000 7f3985000640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f398006de00 0x7f3968004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.616+0000 7f3986400640 1 -- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f398006de00 msgr2=0x7f3968004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:39.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.616+0000 7f3986400640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f398006de00 0x7f3968004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.616+0000 7f3986400640 1 -- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39680039b0 msgr2=0x7f3968003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:39.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.616+0000 7f3986400640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39680039b0 0x7f3968003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.616+0000 7f3986400640 1 -- 172.21.15.63:0/2058000460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968003520 con 0x7f3968004d40 2024-03-26T06:18:39.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.616+0000 7f3985a00640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39680039b0 0x7f3968003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:18:39.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.617+0000 7f3986400640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3968004d40 0x7f39680051c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f397800a920 tx=0x7f3968005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8294a08f4d21e7d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:39.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800a4c0 con 0x7f3968004d40 2024-03-26T06:18:39.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3978034650 con 0x7f3968004d40 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f397fe00640 1 -- 172.21.15.63:0/2058000460 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978034a40 con 0x7f3968004d40 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f3988400640 1 -- 172.21.15.63:0/2058000460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3968004d40 msgr2=0x7f39680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f3988400640 1 --2- 172.21.15.63:0/2058000460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3968004d40 0x7f39680051c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f397800a920 tx=0x7f3968005830 comp rx=0 tx=0).stop 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f3986400640 1 -- 172.21.15.63:0/2058000460 reap_dead start 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f3988400640 1 -- 172.21.15.63:0/2058000460 shutdown_connections 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f3988400640 1 -- 172.21.15.63:0/2058000460 >> 172.21.15.63:0/2058000460 conn(0x7f398006ac90 msgr2=0x7f398006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f3988400640 1 -- 172.21.15.63:0/2058000460 shutdown_connections 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.618+0000 7f3988400640 1 -- 172.21.15.63:0/2058000460 wait complete. 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.620+0000 7f3988400640 1 Processor -- start 2024-03-26T06:18:39.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.620+0000 7f3988400640 1 -- start start 2024-03-26T06:18:39.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.621+0000 7f3988400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f398015c0e0 0x7f39800ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.621+0000 7f3988400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39800cc480 0x7f39801f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.621+0000 7f3988400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39801f7fc0 0x7f39800b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.621+0000 7f3988400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800aef60 con 0x7f39801f7fc0 2024-03-26T06:18:39.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.621+0000 7f3988400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801630e0 con 0x7f398015c0e0 2024-03-26T06:18:39.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.621+0000 7f3988400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39800af0e0 con 0x7f39800cc480 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.621+0000 7f3986400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39801f7fc0 0x7f39800b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3986400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39801f7fc0 0x7f39800b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39688/0 (socket says 172.21.15.63:39688) 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3986400640 1 -- 172.21.15.63:0/310560390 learned_addr learned my addr 172.21.15.63:0/310560390 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3985a00640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f398015c0e0 0x7f39800ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3985000640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39800cc480 0x7f39801f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3986400640 1 -- 172.21.15.63:0/310560390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39800cc480 msgr2=0x7f39801f7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3986400640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39800cc480 0x7f39801f7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3986400640 1 -- 172.21.15.63:0/310560390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f398015c0e0 msgr2=0x7f39800ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3986400640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f398015c0e0 0x7f39800ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3986400640 1 -- 172.21.15.63:0/310560390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39801fb070 con 0x7f39801f7fc0 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.622+0000 7f3986400640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39801f7fc0 0x7f39800b0510 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f397800aa40 tx=0x7f3980162cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.623+0000 7f397d600640 1 -- 172.21.15.63:0/310560390 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800a4c0 con 0x7f39801f7fc0 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.623+0000 7f397d600640 1 -- 172.21.15.63:0/310560390 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3978045070 con 0x7f39801f7fc0 2024-03-26T06:18:39.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.623+0000 7f397d600640 1 -- 172.21.15.63:0/310560390 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978002000 con 0x7f39801f7fc0 2024-03-26T06:18:39.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.623+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39800cc940 con 0x7f39801f7fc0 2024-03-26T06:18:39.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.623+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39800ccf00 con 0x7f39801f7fc0 2024-03-26T06:18:39.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.624+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3980074730 con 0x7f39801f7fc0 2024-03-26T06:18:39.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.625+0000 7f397d600640 1 -- 172.21.15.63:0/310560390 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3978034c00 con 0x7f39801f7fc0 2024-03-26T06:18:39.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.626+0000 7f397d600640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f396006bbd0 0x7f396006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:39.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.626+0000 7f397d600640 1 -- 172.21.15.63:0/310560390 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f39780ad180 con 0x7f39801f7fc0 2024-03-26T06:18:39.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.626+0000 7f3985a00640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f396006bbd0 0x7f396006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:39.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.627+0000 7f3985a00640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f396006bbd0 0x7f396006e090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3980161840 tx=0x7f3974008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:39.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.631+0000 7f397d600640 1 -- 172.21.15.63:0/310560390 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f397807bab0 con 0x7f39801f7fc0 2024-03-26T06:18:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.906+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f39800b28a0 con 0x7f39801f7fc0 2024-03-26T06:18:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.911+0000 7f397d600640 1 -- 172.21.15.63:0/310560390 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f397807b3b0 con 0x7f39801f7fc0 2024-03-26T06:18:39.912 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-03-26T06:18:39.912 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAYaAJmRB44MRAAZ6mfBf153b2nT0G6Lkv1MA== 2024-03-26T06:18:39.912 INFO:teuthology.orchestra.run.smithi063.stdout: caps mds = "allow" 2024-03-26T06:18:39.912 INFO:teuthology.orchestra.run.smithi063.stdout: caps mon = "allow r" 2024-03-26T06:18:39.912 INFO:teuthology.orchestra.run.smithi063.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-26T06:18:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2024-03-26T06:18:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f396006bbd0 msgr2=0x7f396006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f396006bbd0 0x7f396006e090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3980161840 tx=0x7f3974008040 comp rx=0 tx=0).stop 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39801f7fc0 msgr2=0x7f39800b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39801f7fc0 0x7f39800b0510 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f397800aa40 tx=0x7f3980162cf0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 shutdown_connections 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f396006bbd0 0x7f396006e090 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39801f7fc0 0x7f39800b0510 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39800cc480 0x7f39801f7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 --2- 172.21.15.63:0/310560390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f398015c0e0 0x7f39800ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 >> 172.21.15.63:0/310560390 conn(0x7f398006ac90 msgr2=0x7f3980163430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 shutdown_connections 2024-03-26T06:18:39.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:39.915+0000 7f3988400640 1 -- 172.21.15.63:0/310560390 wait complete. 2024-03-26T06:18:39.936 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-26T06:18:40.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.157+0000 7fb6c7200640 1 Processor -- start 2024-03-26T06:18:40.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.157+0000 7fb6c7200640 1 -- start start 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.158+0000 7fb6c7200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb6c80af720 0x7fb6c80b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c7200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb6c815dfc0 0x7fb6c815e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c7200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c8161800 con 0x7fb6c80c6a50 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c7200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c81615b0 con 0x7fb6c815dfc0 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c7200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c8161ae0 con 0x7fb6c80af720 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c5e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb6c80c6a50 0x7fb6c80c6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43442/0 (socket says 172.21.15.63:43442) 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c5e00640 1 -- 172.21.15.63:0/50938001 learned_addr learned my addr 172.21.15.63:0/50938001 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c6800640 1 --2- 172.21.15.63:0/50938001 >> v2:172.21.15.63:3300/0 conn(0x7fb6c815dfc0 0x7fb6c815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c5400640 1 --2- 172.21.15.63:0/50938001 >> v2:172.21.15.204:3300/0 conn(0x7fb6c80af720 0x7fb6c80b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:40.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c4a00640 1 -- 172.21.15.63:0/50938001 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944938869 0 0) 0x7fb6c8161800 con 0x7fb6c80c6a50 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.159+0000 7fb6c4a00640 1 -- 172.21.15.63:0/50938001 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ac003520 con 0x7fb6c80c6a50 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.160+0000 7fb6c6800640 1 -- 172.21.15.63:0/50938001 >> v2:172.21.15.204:3300/0 conn(0x7fb6c80af720 msgr2=0x7fb6c80b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.160+0000 7fb6c6800640 1 --2- 172.21.15.63:0/50938001 >> v2:172.21.15.204:3300/0 conn(0x7fb6c80af720 0x7fb6c80b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.160+0000 7fb6c6800640 1 -- 172.21.15.63:0/50938001 >> v1:172.21.15.63:6789/0 conn(0x7fb6c80c6a50 legacy=0x7fb6c80c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.160+0000 7fb6c6800640 1 -- 172.21.15.63:0/50938001 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c8161dc0 con 0x7fb6c815dfc0 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.161+0000 7fb6c6800640 1 --2- 172.21.15.63:0/50938001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c815dfc0 0x7fb6c815e410 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8070540 tx=0x7fb6c002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9136d1828710b7b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.161+0000 7fb6c4a00640 1 -- 172.21.15.63:0/50938001 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0039070 con 0x7fb6c815dfc0 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.161+0000 7fb6c4a00640 1 -- 172.21.15.63:0/50938001 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c002cd10 con 0x7fb6c815dfc0 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.161+0000 7fb6c4a00640 1 -- 172.21.15.63:0/50938001 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0034660 con 0x7fb6c815dfc0 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.162+0000 7fb6c7200640 1 -- 172.21.15.63:0/50938001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c815dfc0 msgr2=0x7fb6c815e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.162+0000 7fb6c7200640 1 --2- 172.21.15.63:0/50938001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c815dfc0 0x7fb6c815e410 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8070540 tx=0x7fb6c002bf60 comp rx=0 tx=0).stop 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.162+0000 7fb6c7200640 1 -- 172.21.15.63:0/50938001 shutdown_connections 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.162+0000 7fb6c7200640 1 --2- 172.21.15.63:0/50938001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c815dfc0 0x7fb6c815e410 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.162+0000 7fb6c7200640 1 --2- 172.21.15.63:0/50938001 >> v2:172.21.15.204:3300/0 conn(0x7fb6c80af720 0x7fb6c80b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.162+0000 7fb6c7200640 1 -- 172.21.15.63:0/50938001 >> 172.21.15.63:0/50938001 conn(0x7fb6c8099a70 msgr2=0x7fb6c80b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.162+0000 7fb6c7200640 1 -- 172.21.15.63:0/50938001 shutdown_connections 2024-03-26T06:18:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.162+0000 7fb6c7200640 1 -- 172.21.15.63:0/50938001 wait complete. 2024-03-26T06:18:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.164+0000 7fb6c7200640 1 Processor -- start 2024-03-26T06:18:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.164+0000 7fb6c7200640 1 -- start start 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6c80af720 0x7fb6c81599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c80c6a50 0x7fb6c814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6c815dfc0 0x7fb6c80adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c7200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80cdc90 con 0x7fb6c80c6a50 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c7200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80ccdc0 con 0x7fb6c80af720 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c7200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80cde10 con 0x7fb6c815dfc0 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c80c6a50 0x7fb6c814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c80c6a50 0x7fb6c814fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39712/0 (socket says 172.21.15.63:39712) 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c5400640 1 -- 172.21.15.63:0/3940002724 learned_addr learned my addr 172.21.15.63:0/3940002724 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.165+0000 7fb6c5400640 1 -- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6c815dfc0 msgr2=0x7fb6c80adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c6800640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6c815dfc0 0x7fb6c80adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c5e00640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6c80af720 0x7fb6c81599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c5400640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6c815dfc0 0x7fb6c80adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c5400640 1 -- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6c80af720 msgr2=0x7fb6c81599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c5400640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6c80af720 0x7fb6c81599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c5400640 1 -- 172.21.15.63:0/3940002724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c815ae30 con 0x7fb6c80c6a50 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c5e00640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6c80af720 0x7fb6c81599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c6800640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6c815dfc0 0x7fb6c80adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c5400640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c80c6a50 0x7fb6c814fda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400d800 tx=0x7fb6b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6be000640 1 -- 172.21.15.63:0/3940002724 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400b6c0 con 0x7fb6c80c6a50 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6be000640 1 -- 172.21.15.63:0/3940002724 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4019070 con 0x7fb6c80c6a50 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6be000640 1 -- 172.21.15.63:0/3940002724 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400ba80 con 0x7fb6c80c6a50 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c8158ee0 con 0x7fb6c80c6a50 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.166+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c81594a0 con 0x7fb6c80c6a50 2024-03-26T06:18:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.168+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c804f050 con 0x7fb6c80c6a50 2024-03-26T06:18:40.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.169+0000 7fb6be000640 1 -- 172.21.15.63:0/3940002724 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb6b400bc20 con 0x7fb6c80c6a50 2024-03-26T06:18:40.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.169+0000 7fb6be000640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb6a806bbd0 0x7fb6a806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:40.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.169+0000 7fb6be000640 1 -- 172.21.15.63:0/3940002724 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fb6b408b1b0 con 0x7fb6c80c6a50 2024-03-26T06:18:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.170+0000 7fb6c5e00640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb6a806bbd0 0x7fb6a806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.170+0000 7fb6c5e00640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb6a806bbd0 0x7fb6a806e090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8005880 tx=0x7fb6b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:40.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.174+0000 7fb6be000640 1 -- 172.21.15.63:0/3940002724 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb6b4059a50 con 0x7fb6c80c6a50 2024-03-26T06:18:40.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.420+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6c8072ee0 con 0x7fb6c80c6a50 2024-03-26T06:18:40.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.421+0000 7fb6be000640 1 -- 172.21.15.63:0/3940002724 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fb6b4059350 con 0x7fb6c80c6a50 2024-03-26T06:18:40.422 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:40.422 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1772404724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1772404724},{"type":"v1","addr":"172.21.15.63:6835","nonce":1772404724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/3684234118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3684234118},{"type":"v1","addr":"172.21.15.204:6834","nonce":3684234118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4179978388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4179978388},{"type":"v1","addr":"172.21.15.204:6835","nonce":4179978388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-26T06:18:33.792118+0000","modified":"2024-03-26T06:18:36.869843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6837/2819968553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":2819968553},{"type":"v1","addr":"172.21.15.63:6837","nonce":2819968553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-26T06:18:40.423 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 18 2024-03-26T06:18:40.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb6a806bbd0 msgr2=0x7fb6a806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:40.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb6a806bbd0 0x7fb6a806e090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8005880 tx=0x7fb6b8009040 comp rx=0 tx=0).stop 2024-03-26T06:18:40.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c80c6a50 msgr2=0x7fb6c814fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:40.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c80c6a50 0x7fb6c814fda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400d800 tx=0x7fb6b400dcc0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 shutdown_connections 2024-03-26T06:18:40.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fb6a806bbd0 0x7fb6a806e090 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6c815dfc0 0x7fb6c80adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6c80c6a50 0x7fb6c814fda0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 --2- 172.21.15.63:0/3940002724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6c80af720 0x7fb6c81599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:40.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 >> 172.21.15.63:0/3940002724 conn(0x7fb6c8099a70 msgr2=0x7fb6c80b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:40.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 shutdown_connections 2024-03-26T06:18:40.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:40.424+0000 7fb6c7200640 1 -- 172.21.15.63:0/3940002724 wait complete. 2024-03-26T06:18:40.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-26T06:18:33.792118+0000', 'modified': '2024-03-26T06:18:36.869843+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5373}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5373': {'gid': 5373, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.63:6837/2819968553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6836', 'nonce': 2819968553}, {'type': 'v1', 'addr': '172.21.15.63:6837', 'nonce': 2819968553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-26T06:18:40.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-26T06:18:40.847 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-26T06:18:41.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.085+0000 7f8487200640 1 Processor -- start 2024-03-26T06:18:41.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.086+0000 7f8487200640 1 -- start start 2024-03-26T06:18:41.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.087+0000 7f8487200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8488071850 0x7f8488166590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.087+0000 7f8487200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848815f410 con 0x7f848806d270 2024-03-26T06:18:41.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.087+0000 7f8487200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848815f6f0 con 0x7f848813e650 2024-03-26T06:18:41.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.087+0000 7f8487200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848815f9d0 con 0x7f8488071850 2024-03-26T06:18:41.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.088+0000 7f847d400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f848806d270 0x7f8488071140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:49254/0 (socket says 172.21.15.63:49254) 2024-03-26T06:18:41.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.088+0000 7f847d400640 1 -- 172.21.15.63:0/1223635751 learned_addr learned my addr 172.21.15.63:0/1223635751 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:41.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.088+0000 7f8486800640 1 --2- 172.21.15.63:0/1223635751 >> v2:172.21.15.204:3300/0 conn(0x7f8488071850 0x7f8488166590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.088+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634861233 0 0) 0x7f848815f410 con 0x7f848806d270 2024-03-26T06:18:41.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.088+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f846c003520 con 0x7f848806d270 2024-03-26T06:18:41.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.088+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 785167222 0 0) 0x7f846c003520 con 0x7f848806d270 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.088+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 >> v2:172.21.15.204:3300/0 conn(0x7f8488071850 msgr2=0x7f8488166590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.088+0000 7f8485400640 1 --2- 172.21.15.63:0/1223635751 >> v2:172.21.15.204:3300/0 conn(0x7f8488071850 0x7f8488166590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 >> v1:172.21.15.204:6789/0 conn(0x7f848813e650 legacy=0x7f848806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848815fcb0 con 0x7f848806d270 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f8470001670 con 0x7f848806d270 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 >> v1:172.21.15.63:6789/0 conn(0x7f848806d270 legacy=0x7f8488071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f846c0039b0 0x7f846c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f846c004800 0x7f846c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f846c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848815f9d0 con 0x7f846c0051c0 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c00c060 con 0x7f846c004800 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c00c260 con 0x7f846c0039b0 2024-03-26T06:18:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8486800640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f846c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8485e00640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f846c0039b0 0x7f846c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8486800640 1 -- 172.21.15.63:0/1223635751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f846c0039b0 msgr2=0x7f846c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.089+0000 7f8486800640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f846c0039b0 0x7f846c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.090+0000 7f8486800640 1 -- 172.21.15.63:0/1223635751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f846c004800 msgr2=0x7f846c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.090+0000 7f8486800640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f846c004800 0x7f846c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.090+0000 7f8486800640 1 -- 172.21.15.63:0/1223635751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c003520 con 0x7f846c0051c0 2024-03-26T06:18:41.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.090+0000 7f8486800640 1 -- 172.21.15.63:0/1223635751 reap_dead start 2024-03-26T06:18:41.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.091+0000 7f8486800640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f846c00b9c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8480009fc0 tx=0x7f846c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b22738cf917f1d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.091+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480009c10 con 0x7f846c0051c0 2024-03-26T06:18:41.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.091+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848002cca0 con 0x7f846c0051c0 2024-03-26T06:18:41.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.091+0000 7f8485400640 1 -- 172.21.15.63:0/1223635751 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480003bd0 con 0x7f846c0051c0 2024-03-26T06:18:41.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.091+0000 7f8487200640 1 -- 172.21.15.63:0/1223635751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 msgr2=0x7f846c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.091+0000 7f8487200640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f846c00b9c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8480009fc0 tx=0x7f846c005830 comp rx=0 tx=0).stop 2024-03-26T06:18:41.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.092+0000 7f8487200640 1 -- 172.21.15.63:0/1223635751 shutdown_connections 2024-03-26T06:18:41.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.092+0000 7f8487200640 1 --2- 172.21.15.63:0/1223635751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f846c00b9c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.092+0000 7f8487200640 1 -- 172.21.15.63:0/1223635751 >> 172.21.15.63:0/1223635751 conn(0x7f84880670b0 msgr2=0x7f84880b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:41.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.092+0000 7f8487200640 1 -- 172.21.15.63:0/1223635751 shutdown_connections 2024-03-26T06:18:41.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.092+0000 7f8487200640 1 -- 172.21.15.63:0/1223635751 wait complete. 2024-03-26T06:18:41.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.094+0000 7f8487200640 1 Processor -- start 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.094+0000 7f8487200640 1 -- start start 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8487200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f848815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8487200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84881583c0 0x7f84880b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8487200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8488158840 0x7f84880b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8487200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848813ee20 con 0x7f846c0051c0 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8487200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848813eca0 con 0x7f84881583c0 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8487200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848813efa0 con 0x7f8488158840 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8485e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f848815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8485e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f848815b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50014/0 (socket says 172.21.15.63:50014) 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8485e00640 1 -- 172.21.15.63:0/2851135076 learned_addr learned my addr 172.21.15.63:0/2851135076 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8485e00640 1 -- 172.21.15.63:0/2851135076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8488158840 msgr2=0x7f84880b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8485e00640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8488158840 0x7f84880b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8485e00640 1 -- 172.21.15.63:0/2851135076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84881583c0 msgr2=0x7f84880b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8485e00640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84881583c0 0x7f84880b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.095+0000 7f8485e00640 1 -- 172.21.15.63:0/2851135076 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488158e10 con 0x7f846c0051c0 2024-03-26T06:18:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.096+0000 7f8485e00640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f848815b780 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f847800d4c0 tx=0x7f847800d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.096+0000 7f847ea00640 1 -- 172.21.15.63:0/2851135076 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478005480 con 0x7f846c0051c0 2024-03-26T06:18:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.096+0000 7f847ea00640 1 -- 172.21.15.63:0/2851135076 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478017070 con 0x7f846c0051c0 2024-03-26T06:18:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.096+0000 7f847ea00640 1 -- 172.21.15.63:0/2851135076 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478003830 con 0x7f846c0051c0 2024-03-26T06:18:41.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.096+0000 7f8487200640 1 -- 172.21.15.63:0/2851135076 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848815aca0 con 0x7f846c0051c0 2024-03-26T06:18:41.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.096+0000 7f8487200640 1 -- 172.21.15.63:0/2851135076 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848815b260 con 0x7f846c0051c0 2024-03-26T06:18:41.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.098+0000 7f847ea00640 1 -- 172.21.15.63:0/2851135076 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f84780039d0 con 0x7f846c0051c0 2024-03-26T06:18:41.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.099+0000 7f847ea00640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f846406bc00 0x7f846406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.099+0000 7f847ea00640 1 -- 172.21.15.63:0/2851135076 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f847808aa10 con 0x7f846c0051c0 2024-03-26T06:18:41.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.099+0000 7f847d400640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f846406bc00 0x7f846406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.100+0000 7f848fc53740 1 Processor -- start 2024-03-26T06:18:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.100+0000 7f848fc53740 1 -- start start 2024-03-26T06:18:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.100+0000 7f847d400640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f846406bc00 0x7f846406e0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f84700011e0 tx=0x7f84700014e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.101+0000 7f848fc53740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbc810 0x55d728c8f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.101+0000 7f848fc53740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.101+0000 7f848fc53740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728c8fcf0 0x55d728cbfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.101+0000 7f848fc53740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d728bf96f0 con 0x55d728cbcbf0 2024-03-26T06:18:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.101+0000 7f848fc53740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d728ba29e0 con 0x55d728cbc810 2024-03-26T06:18:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.101+0000 7f848fc53740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d728bf5790 con 0x55d728c8fcf0 2024-03-26T06:18:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.101+0000 7f847d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.101+0000 7f847d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50024/0 (socket says 172.21.15.63:50024) 2024-03-26T06:18:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.101+0000 7f847d400640 1 -- 172.21.15.63:0/1849840403 learned_addr learned my addr 172.21.15.63:0/1849840403 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:41.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f8486800640 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728c8fcf0 0x55d728cbfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f8485e00640 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbc810 0x55d728c8f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f847d400640 1 -- 172.21.15.63:0/1849840403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728c8fcf0 msgr2=0x55d728cbfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f847d400640 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728c8fcf0 0x55d728cbfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f847d400640 1 -- 172.21.15.63:0/1849840403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbc810 msgr2=0x55d728c8f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f847d400640 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbc810 0x55d728c8f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f847d400640 1 -- 172.21.15.63:0/1849840403 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d728b96720 con 0x55d728cbcbf0 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f8485e00640 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbc810 0x55d728c8f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f847d400640 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf5a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f84700074b0 tx=0x7f847000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7e3765e8d68985 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f8476a00640 1 -- 172.21.15.63:0/1849840403 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470005c80 con 0x55d728cbcbf0 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f8476a00640 1 -- 172.21.15.63:0/1849840403 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8470005e20 con 0x55d728cbcbf0 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.102+0000 7f8476a00640 1 -- 172.21.15.63:0/1849840403 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847000cdb0 con 0x55d728cbcbf0 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.103+0000 7f848fc53740 1 -- 172.21.15.63:0/1849840403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 msgr2=0x55d728cbf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.103+0000 7f848fc53740 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf5a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f84700074b0 tx=0x7f847000f000 comp rx=0 tx=0).stop 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.103+0000 7f848fc53740 1 -- 172.21.15.63:0/1849840403 shutdown_connections 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.103+0000 7f848fc53740 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728c8fcf0 0x55d728cbfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.103+0000 7f848fc53740 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf5a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.103+0000 7f848fc53740 1 --2- 172.21.15.63:0/1849840403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbc810 0x55d728c8f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.103+0000 7f848fc53740 1 -- 172.21.15.63:0/1849840403 >> 172.21.15.63:0/1849840403 conn(0x55d728c91a20 msgr2=0x55d728cda5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:41.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.103+0000 7f848fc53740 1 -- 172.21.15.63:0/1849840403 shutdown_connections 2024-03-26T06:18:41.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.103+0000 7f848fc53740 1 -- 172.21.15.63:0/1849840403 wait complete. 2024-03-26T06:18:41.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.104+0000 7f848fc53740 1 -- start start 2024-03-26T06:18:41.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.104+0000 7f848fc53740 1 Processor -- start 2024-03-26T06:18:41.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.105+0000 7f848fc53740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cea410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.105+0000 7f848fc53740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbcbf0 0x55d728cd1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.105+0000 7f848fc53740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cae520 0x55d728cd4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.105+0000 7f848fc53740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d728c93fc0 con 0x55d728cae520 2024-03-26T06:18:41.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.105+0000 7f848fc53740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d728bb5e20 con 0x55d728cbcbf0 2024-03-26T06:18:41.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.105+0000 7f848fc53740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d728c933b0 con 0x55d728cbc810 2024-03-26T06:18:41.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.105+0000 7f848fc53740 10 client.0 _ll_register_callbacks cb 0x55d728bf08d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8486800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cae520 0x55d728cd4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8486800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cae520 0x55d728cd4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50032/0 (socket says 172.21.15.63:50032) 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8486800640 1 -- 172.21.15.63:0/969350805 learned_addr learned my addr 172.21.15.63:0/969350805 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8485e00640 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f847d400640 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbcbf0 0x55d728cd1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8486800640 1 -- 172.21.15.63:0/969350805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 msgr2=0x55d728cea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8486800640 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8486800640 1 -- 172.21.15.63:0/969350805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbcbf0 msgr2=0x55d728cd1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8486800640 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbcbf0 0x55d728cd1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8486800640 1 -- 172.21.15.63:0/969350805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d72890e2d0 con 0x55d728cae520 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8485e00640 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f8486800640 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cae520 0x55d728cd4d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f848002c6d0 tx=0x7f8480009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a0785a67fce8c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.106+0000 7f846b400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-03-26T06:18:41.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f846b400640 1 -- 172.21.15.63:0/969350805 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480003da0 con 0x55d728cae520 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f846b400640 1 -- 172.21.15.63:0/969350805 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f8480004030 con 0x55d728cae520 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f848fc53740 1 -- 172.21.15.63:0/969350805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8470005e20 con 0x55d728cae520 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f846b400640 1 -- 172.21.15.63:0/969350805 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f848004c050 con 0x55d728cae520 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f848fc53740 10 client.5544 fetch_fsmap learned FSMap version 18 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f848fc53740 1 -- 172.21.15.63:0/969350805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55d7289d86b0 con 0x55d728cae520 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f846b400640 1 -- 172.21.15.63:0/969350805 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8470005e20 con 0x55d728cae520 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f846b400640 1 -- 172.21.15.63:0/969350805 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f848004f020 con 0x55d728cae520 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f848fc53740 10 client.5544 fetch_fsmap finished waiting for FSMap version 18 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f848fc53740 10 client.5544 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f848fc53740 20 client.5544 populate_metadata read hostname 'smithi063' 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.107+0000 7f848fc53740 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] conn(0x55d728cf65e0 0x55d728cf89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.108+0000 7f848fc53740 4 client.5544 mds_command: new command op to 5373 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.108+0000 7f848fc53740 1 -- 172.21.15.63:0/969350805 --> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d728c06c30 con 0x55d728cf65e0 2024-03-26T06:18:41.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.108+0000 7f8485e00640 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] conn(0x55d728cf65e0 0x55d728cf89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.108+0000 7f8485e00640 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] conn(0x55d728cf65e0 0x55d728cf89d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea9ca757faee2a3a server_cookie=2ed89ca162c49e89 in_seq=0 out_seq=0 2024-03-26T06:18:41.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.108+0000 7f846b400640 10 client.5544 ms_handle_connect on v2:172.21.15.63:6836/2819968553 2024-03-26T06:18:41.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f846b400640 1 -- 172.21.15.63:0/969350805 <== mds.0 v2:172.21.15.63:6836/2819968553 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d728c06c30 con 0x55d728cf65e0 2024-03-26T06:18:41.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f846b400640 10 client.5544 handle_command_reply: tid=0 2024-03-26T06:18:41.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f848fc53740 1 client.5544 shutdown 2024-03-26T06:18:41.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f848fc53740 1 -- 172.21.15.63:0/969350805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cae520 msgr2=0x55d728cd4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f848fc53740 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cae520 0x55d728cd4d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f848002c6d0 tx=0x7f8480009750 comp rx=0 tx=0).stop 2024-03-26T06:18:41.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f848fc53740 1 -- 172.21.15.63:0/969350805 shutdown_connections 2024-03-26T06:18:41.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f848fc53740 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] conn(0x55d728cf65e0 0x55d728cf89d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f848fc53740 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cae520 0x55d728cd4d60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f848fc53740 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cbcbf0 0x55d728cd1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f848fc53740 1 --2- 172.21.15.63:0/969350805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f848fc53740 1 -- 172.21.15.63:0/969350805 >> 172.21.15.63:0/969350805 conn(0x55d728c8fcf0 msgr2=0x55d728cddab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:41.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.109+0000 7f846b400640 0 client.5544 ms_handle_reset on v2:172.21.15.63:6836/2819968553 2024-03-26T06:18:41.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.110+0000 7f848fc53740 1 -- 172.21.15.63:0/969350805 shutdown_connections 2024-03-26T06:18:41.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.110+0000 7f848fc53740 1 -- 172.21.15.63:0/969350805 wait complete. 2024-03-26T06:18:41.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.110+0000 7f848fc53740 20 client.5544 trim_cache size 0 max 16384 2024-03-26T06:18:41.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.127+0000 7f848fc53740 1 Processor -- start 2024-03-26T06:18:41.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.127+0000 7f848fc53740 1 -- start start 2024-03-26T06:18:41.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.128+0000 7f848fc53740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 0x55d728cbcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.128+0000 7f848fc53740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.128+0000 7f848fc53740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.128+0000 7f848fc53740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84881ffaa0 con 0x55d728cbcbf0 2024-03-26T06:18:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.128+0000 7f848fc53740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488154950 con 0x55d728cae520 2024-03-26T06:18:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.128+0000 7f848fc53740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84881ff4a0 con 0x55d728cbc810 2024-03-26T06:18:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.128+0000 7f8486800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.128+0000 7f8486800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50044/0 (socket says 172.21.15.63:50044) 2024-03-26T06:18:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.128+0000 7f8486800640 1 -- 172.21.15.63:0/1762717251 learned_addr learned my addr 172.21.15.63:0/1762717251 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:41.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.129+0000 7f8486800640 1 -- 172.21.15.63:0/1762717251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 msgr2=0x55d728cddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.129+0000 7f8486800640 1 --2- 172.21.15.63:0/1762717251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.129+0000 7f8486800640 1 -- 172.21.15.63:0/1762717251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 msgr2=0x55d728cbcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.129+0000 7f8486800640 1 --2- 172.21.15.63:0/1762717251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 0x55d728cbcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.129+0000 7f8486800640 1 -- 172.21.15.63:0/1762717251 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d728cde670 con 0x55d728cbcbf0 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.129+0000 7f8486800640 1 --2- 172.21.15.63:0/1762717251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf820 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8480009fd0 tx=0x7f848003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c201a650ec9aeb2 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.129+0000 7f8476000640 1 -- 172.21.15.63:0/1762717251 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480003ba0 con 0x55d728cbcbf0 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.129+0000 7f8476000640 1 -- 172.21.15.63:0/1762717251 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8480044070 con 0x55d728cbcbf0 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f8476000640 1 -- 172.21.15.63:0/1762717251 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480004320 con 0x55d728cbcbf0 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f848fc53740 1 -- 172.21.15.63:0/1762717251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 msgr2=0x55d728cbf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f848fc53740 1 --2- 172.21.15.63:0/1762717251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf820 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8480009fd0 tx=0x7f848003c000 comp rx=0 tx=0).stop 2024-03-26T06:18:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f848fc53740 1 -- 172.21.15.63:0/1762717251 shutdown_connections 2024-03-26T06:18:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f848fc53740 1 --2- 172.21.15.63:0/1762717251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cbf820 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f848fc53740 1 --2- 172.21.15.63:0/1762717251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f848fc53740 1 --2- 172.21.15.63:0/1762717251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 0x55d728cbcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f848fc53740 1 -- 172.21.15.63:0/1762717251 >> 172.21.15.63:0/1762717251 conn(0x55d728c8fcf0 msgr2=0x55d728c967d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f848fc53740 1 -- 172.21.15.63:0/1762717251 shutdown_connections 2024-03-26T06:18:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.130+0000 7f848fc53740 1 -- 172.21.15.63:0/1762717251 wait complete. 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.131+0000 7f848fc53740 1 -- start start 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.131+0000 7f848fc53740 1 Processor -- start 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f848fc53740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 0x55d728d3f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f848fc53740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cc25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f848fc53740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cc2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f848fc53740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d728cd2ce0 con 0x55d728cbcbf0 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f848fc53740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d728cd3000 con 0x55d728cae520 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f848fc53740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d728cc1e50 con 0x55d728cbc810 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f848fc53740 10 client.0 _ll_register_callbacks cb 0x7f8470001ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-26T06:18:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f8486800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cc2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f8486800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cc2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50058/0 (socket says 172.21.15.63:50058) 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.132+0000 7f8486800640 1 -- 172.21.15.63:0/2343679905 learned_addr learned my addr 172.21.15.63:0/2343679905 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f8485e00640 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 0x55d728d3f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f847d400640 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cc25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f8486800640 1 -- 172.21.15.63:0/2343679905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 msgr2=0x55d728cc25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f8486800640 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cc25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f8486800640 1 -- 172.21.15.63:0/2343679905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 msgr2=0x55d728d3f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f8486800640 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 0x55d728d3f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f8486800640 1 -- 172.21.15.63:0/2343679905 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d728c8f2d0 con 0x55d728cbcbf0 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f8485e00640 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 0x55d728d3f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f8486800640 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cc2b10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f848002c600 tx=0x7f8480030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1895a3a7af4277 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f846b400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f846b400640 1 -- 172.21.15.63:0/2343679905 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848003fe20 con 0x55d728cbcbf0 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f846b400640 1 -- 172.21.15.63:0/2343679905 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f8480034440 con 0x55d728cbcbf0 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.133+0000 7f848fc53740 1 -- 172.21.15.63:0/2343679905 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8480044070 con 0x55d728cbcbf0 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f846b400640 1 -- 172.21.15.63:0/2343679905 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f848006c050 con 0x55d728cbcbf0 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f848fc53740 10 client.5550 fetch_fsmap learned FSMap version 18 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f848fc53740 1 -- 172.21.15.63:0/2343679905 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55d728c8edb0 con 0x55d728cbcbf0 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f846b400640 1 -- 172.21.15.63:0/2343679905 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8480044070 con 0x55d728cbcbf0 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f846b400640 1 -- 172.21.15.63:0/2343679905 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f848006f020 con 0x55d728cbcbf0 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f848fc53740 10 client.5550 fetch_fsmap finished waiting for FSMap version 18 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f848fc53740 10 client.5550 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f848fc53740 20 client.5550 populate_metadata read hostname 'smithi063' 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f848fc53740 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] conn(0x55d728d45840 0x55d728cf2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f848fc53740 4 client.5550 mds_command: new command op to 5373 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-26T06:18:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f848fc53740 1 -- 172.21.15.63:0/2343679905 --> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d728c00f80 con 0x55d728d45840 2024-03-26T06:18:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.134+0000 7f8485e00640 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] conn(0x55d728d45840 0x55d728cf2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.135+0000 7f8485e00640 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] conn(0x55d728d45840 0x55d728cf2220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b14ad36289db528 server_cookie=a69222acedfec1d in_seq=0 out_seq=0 2024-03-26T06:18:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.135+0000 7f846b400640 10 client.5550 ms_handle_connect on v2:172.21.15.63:6836/2819968553 2024-03-26T06:18:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.135+0000 7f846b400640 1 -- 172.21.15.63:0/2343679905 <== mds.0 v2:172.21.15.63:6836/2819968553 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55d728c00f80 con 0x55d728d45840 2024-03-26T06:18:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.135+0000 7f846b400640 10 client.5550 handle_command_reply: tid=0 2024-03-26T06:18:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.135+0000 7f848fc53740 1 client.5550 shutdown 2024-03-26T06:18:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.135+0000 7f848fc53740 1 -- 172.21.15.63:0/2343679905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 msgr2=0x55d728cc2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.135+0000 7f848fc53740 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cc2b10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f848002c600 tx=0x7f8480030000 comp rx=0 tx=0).stop 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.135+0000 7f848fc53740 1 -- 172.21.15.63:0/2343679905 shutdown_connections 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f848fc53740 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.63:6836/2819968553,v1:172.21.15.63:6837/2819968553] conn(0x55d728d45840 0x55d728cf2220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f848fc53740 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d728cbcbf0 0x55d728cc2b10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f848fc53740 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d728cbc810 0x55d728cc25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f846b400640 0 client.5550 ms_handle_reset on v2:172.21.15.63:6836/2819968553 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f848fc53740 1 --2- 172.21.15.63:0/2343679905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d728cae520 0x55d728d3f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f848fc53740 1 -- 172.21.15.63:0/2343679905 >> 172.21.15.63:0/2343679905 conn(0x55d728c8fcf0 msgr2=0x55d728cdaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f848fc53740 1 -- 172.21.15.63:0/2343679905 shutdown_connections 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f848fc53740 1 -- 172.21.15.63:0/2343679905 wait complete. 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f848fc53740 20 client.5550 trim_cache size 0 max 16384 2024-03-26T06:18:41.140 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "82863fce-9065-4f8e-a61f-944fd870ef74", 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5373, 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 6.8150068780000002, 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 18, 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 41, 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 39, 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 15.637246113 2024-03-26T06:18:41.141 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-03-26T06:18:41.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f8487200640 1 -- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f846406bc00 msgr2=0x7f846406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f8487200640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f846406bc00 0x7f846406e0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f84700011e0 tx=0x7f84700014e0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.136+0000 7f8487200640 1 -- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 msgr2=0x7f848815b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.137+0000 7f8487200640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f848815b780 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f847800d4c0 tx=0x7f847800d980 comp rx=0 tx=0).stop 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.137+0000 7f8487200640 1 -- 172.21.15.63:0/2851135076 shutdown_connections 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.137+0000 7f8487200640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f846406bc00 0x7f846406e0c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.137+0000 7f8487200640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8488158840 0x7f84880b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.137+0000 7f8487200640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84881583c0 0x7f84880b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.137+0000 7f8487200640 1 --2- 172.21.15.63:0/2851135076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f846c0051c0 0x7f848815b780 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.137+0000 7f8487200640 1 -- 172.21.15.63:0/2851135076 >> 172.21.15.63:0/2851135076 conn(0x7f84880670b0 msgr2=0x7f84880cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.137+0000 7f8487200640 1 -- 172.21.15.63:0/2851135076 shutdown_connections 2024-03-26T06:18:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.137+0000 7f8487200640 1 -- 172.21.15.63:0/2851135076 wait complete. 2024-03-26T06:18:41.154 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-26T06:18:41.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.369+0000 7ff322c00640 1 Processor -- start 2024-03-26T06:18:41.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.369+0000 7ff322c00640 1 -- start start 2024-03-26T06:18:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.371+0000 7ff322c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff31c06b3a0 0x7ff31c0cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.371+0000 7ff322c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c0cb100 con 0x7ff31c15dd60 2024-03-26T06:18:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.371+0000 7ff322c00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c0cb3e0 con 0x7ff31c0cc740 2024-03-26T06:18:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.371+0000 7ff322c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c0cb6c0 con 0x7ff31c06b3a0 2024-03-26T06:18:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.371+0000 7ff320e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff31c06b3a0 0x7ff31c0cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.371+0000 7ff321800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff31c15dd60 0x7ff31c06ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:49266/0 (socket says 172.21.15.63:49266) 2024-03-26T06:18:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.371+0000 7ff321800640 1 -- 172.21.15.63:0/885100906 learned_addr learned my addr 172.21.15.63:0/885100906 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:18:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.372+0000 7ff320e00640 1 -- 172.21.15.63:0/885100906 >> v1:172.21.15.204:6789/0 conn(0x7ff31c0cc740 legacy=0x7ff31c06e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.372+0000 7ff320e00640 1 -- 172.21.15.63:0/885100906 >> v1:172.21.15.63:6789/0 conn(0x7ff31c15dd60 legacy=0x7ff31c06ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.372+0000 7ff320e00640 1 -- 172.21.15.63:0/885100906 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0cb9a0 con 0x7ff31c06b3a0 2024-03-26T06:18:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.372+0000 7ff31be00640 1 -- 172.21.15.63:0/885100906 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126509537 0 0) 0x7ff31c0cb100 con 0x7ff31c15dd60 2024-03-26T06:18:41.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.373+0000 7ff320e00640 1 --2- 172.21.15.63:0/885100906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 0x7ff31c0cab20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff3080097a0 tx=0x7ff30802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ae1294cfd60f75 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.373+0000 7ff31be00640 1 -- 172.21.15.63:0/885100906 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff308034070 con 0x7ff31c06b3a0 2024-03-26T06:18:41.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.373+0000 7ff31be00640 1 -- 172.21.15.63:0/885100906 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff308030610 con 0x7ff31c06b3a0 2024-03-26T06:18:41.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.373+0000 7ff31be00640 1 -- 172.21.15.63:0/885100906 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080309e0 con 0x7ff31c06b3a0 2024-03-26T06:18:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.374+0000 7ff322c00640 1 -- 172.21.15.63:0/885100906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 msgr2=0x7ff31c0cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.374+0000 7ff322c00640 1 --2- 172.21.15.63:0/885100906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 0x7ff31c0cab20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff3080097a0 tx=0x7ff30802b960 comp rx=0 tx=0).stop 2024-03-26T06:18:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.374+0000 7ff322c00640 1 -- 172.21.15.63:0/885100906 shutdown_connections 2024-03-26T06:18:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.374+0000 7ff322c00640 1 --2- 172.21.15.63:0/885100906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 0x7ff31c0cab20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.374+0000 7ff322c00640 1 -- 172.21.15.63:0/885100906 >> 172.21.15.63:0/885100906 conn(0x7ff31c099a70 msgr2=0x7ff31c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.374+0000 7ff322c00640 1 -- 172.21.15.63:0/885100906 shutdown_connections 2024-03-26T06:18:41.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.374+0000 7ff322c00640 1 -- 172.21.15.63:0/885100906 wait complete. 2024-03-26T06:18:41.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.376+0000 7ff322c00640 1 Processor -- start 2024-03-26T06:18:41.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.376+0000 7ff322c00640 1 -- start start 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.377+0000 7ff322c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 0x7ff31c149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.377+0000 7ff322c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff31c0cc740 0x7ff31c0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.377+0000 7ff322c00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31c15dd60 0x7ff31c0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.377+0000 7ff322c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0cc1a0 con 0x7ff31c06b3a0 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.377+0000 7ff322c00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0ce1f0 con 0x7ff31c0cc740 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.377+0000 7ff322c00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0c47b0 con 0x7ff31c15dd60 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.377+0000 7ff321800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 0x7ff31c149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.377+0000 7ff321800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 0x7ff31c149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50078/0 (socket says 172.21.15.63:50078) 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.377+0000 7ff321800640 1 -- 172.21.15.63:0/1068674829 learned_addr learned my addr 172.21.15.63:0/1068674829 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff321800640 1 -- 172.21.15.63:0/1068674829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31c15dd60 msgr2=0x7ff31c0c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff321800640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31c15dd60 0x7ff31c0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff321800640 1 -- 172.21.15.63:0/1068674829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff31c0cc740 msgr2=0x7ff31c0c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff321800640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff31c0cc740 0x7ff31c0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff321800640 1 -- 172.21.15.63:0/1068674829 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0c5b20 con 0x7ff31c06b3a0 2024-03-26T06:18:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff321800640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 0x7ff31c149990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c4d0 tx=0x7ff31000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff319600640 1 -- 172.21.15.63:0/1068674829 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310018070 con 0x7ff31c06b3a0 2024-03-26T06:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff319600640 1 -- 172.21.15.63:0/1068674829 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3100075a0 con 0x7ff31c06b3a0 2024-03-26T06:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c0c4160 con 0x7ff31c06b3a0 2024-03-26T06:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff319600640 1 -- 172.21.15.63:0/1068674829 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310004a20 con 0x7ff31c06b3a0 2024-03-26T06:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.378+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c0c6550 con 0x7ff31c06b3a0 2024-03-26T06:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.379+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c0c5e00 con 0x7ff31c06b3a0 2024-03-26T06:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.381+0000 7ff319600640 1 -- 172.21.15.63:0/1068674829 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff31001b070 con 0x7ff31c06b3a0 2024-03-26T06:18:41.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.382+0000 7ff319600640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff2fc06bbd0 0x7ff2fc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:18:41.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.382+0000 7ff319600640 1 -- 172.21.15.63:0/1068674829 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7ff310089ef0 con 0x7ff31c06b3a0 2024-03-26T06:18:41.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.382+0000 7ff320e00640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff2fc06bbd0 0x7ff2fc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.383+0000 7ff320e00640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff2fc06bbd0 0x7ff2fc06e090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff308036000 tx=0x7ff308030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:18:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.386+0000 7ff319600640 1 -- 172.21.15.63:0/1068674829 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7ff3100588c0 con 0x7ff31c06b3a0 2024-03-26T06:18:41.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.631+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff31c04f050 con 0x7ff31c06b3a0 2024-03-26T06:18:41.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.632+0000 7ff319600640 1 -- 172.21.15.63:0/1068674829 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff3100581c0 con 0x7ff31c06b3a0 2024-03-26T06:18:41.632 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff2fc06bbd0 msgr2=0x7ff2fc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff2fc06bbd0 0x7ff2fc06e090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff308036000 tx=0x7ff308030000 comp rx=0 tx=0).stop 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 msgr2=0x7ff31c149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 0x7ff31c149990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c4d0 tx=0x7ff31000c990 comp rx=0 tx=0).stop 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 shutdown_connections 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7ff2fc06bbd0 0x7ff2fc06e090 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31c15dd60 0x7ff31c0c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff31c0cc740 0x7ff31c0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 --2- 172.21.15.63:0/1068674829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff31c06b3a0 0x7ff31c149990 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 >> 172.21.15.63:0/1068674829 conn(0x7ff31c099a70 msgr2=0x7ff31c0afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 shutdown_connections 2024-03-26T06:18:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:18:41.635+0000 7ff322c00640 1 -- 172.21.15.63:0/1068674829 wait complete. 2024-03-26T06:18:41.654 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-26T06:18:41.654 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-26T06:18:41.654 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-03-26T06:18:41.654 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-26T06:18:41.654 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-26T06:18:41.654 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-26T06:18:41.654 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-26T06:18:41.654 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-26T06:18:41.654 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-26T06:18:41.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:41.655 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-03-26T06:18:41.705 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-26T06:18:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:18:41.706 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42431sec preferred_lft 42431sec 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 1a:b0:a6:2c:22:55 brd ff:ff:ff:ff:ff:ff 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::c84a:9ff:fe88:6746/64 scope link 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-26T06:18:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether a6:61:25:fb:2a:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-26T06:18:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::a461:25ff:fefb:2ae7/64 scope link 2024-03-26T06:18:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:18:41.708 INFO:teuthology.orchestra.run.smithi063.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-26T06:18:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 1a:b0:a6:2c:22:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-26T06:18:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::18b0:a6ff:fe2c:2255/64 scope link 2024-03-26T06:18:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-03-26T06:18:41.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:41.708 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-26T06:18:41.794 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-03-26T06:18:41.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:41.799 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-03-26T06:18:41.853 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-03-26T06:18:41.853 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-26T06:18:41.853 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-26T06:18:41.853 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-26T06:18:41.853 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-26T06:18:41.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:41.854 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2024-03-26T06:18:41.854 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-03-26T06:18:41.854 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-26T06:18:41.854 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-26T06:18:41.854 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-26T06:18:41.854 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-03-26T06:18:42.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:42.052 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-03-26T06:18:42.104 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-26T06:18:42.105 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-26T06:18:42.105 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-26T06:18:42.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:42.105 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-03-26T06:18:42.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:18:42.202 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-26T06:18:42.261 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-26T06:18:42.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-26T06:18:42.262 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-26T06:18:42.316 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-26T06:18:42.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:42.316 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:18:42.465 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:18:42.465 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:18:42.499 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-26T06:18:42.499 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-26T06:18:42.500 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.204:3300,172.21.15.204:3301" 2024-03-26T06:18:42.500 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 0@82863fce-9065-4f8e-a61f-944fd870ef74.cephfs=/ 2024-03-26T06:18:42.500 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.63:3300/172.21.15.204:3300/172.21.15.204:3301" will pass to kernel 2024-03-26T06:18:42.503 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-26T06:18:42.503 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-03-26T06:18:42.504 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-26T06:18:42.504 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-03-26T06:18:42.504 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-26T06:18:42.509 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-26T06:18:42.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:42.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-26T06:18:42.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:42.602 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-26T06:18:42.669 INFO:teuthology.orchestra.run.smithi063.stdout:client5562 2024-03-26T06:18:42.669 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:18:42.669 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T06:18:42.720 DEBUG:teuthology.orchestra.run.smithi063:> mktemp -d --suffix=xfstests-dev 2024-03-26T06:18:42.772 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.W8GLtFOA0Cxfstests-dev 2024-03-26T06:18:42.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:42.772 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.W8GLtFOA0Cxfstests-dev) 2024-03-26T06:18:42.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:42.867 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.W8GLtFOA0Cxfstests-dev) 2024-03-26T06:18:42.925 INFO:teuthology.orchestra.run.smithi063.stderr:Cloning into '/tmp/tmp.W8GLtFOA0Cxfstests-dev'... 2024-03-26T06:18:44.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:44.063 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-03-26T06:18:44.129 DEBUG:teuthology.orchestra.run.smithi063:> mktemp -d --suffix=test 2024-03-26T06:18:44.176 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.LsIyRsPUXptest 2024-03-26T06:18:44.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:18:44.177 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-03-26T06:18:44.281 DEBUG:teuthology.orchestra.run.smithi063:> mktemp -d --suffix=scratch 2024-03-26T06:18:44.339 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:18:44.339 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-03-26T06:18:44.340 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-03-26T06:18:45.212 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:05:03 ago on Tue 26 Mar 2024 06:13:42 AM UTC. 2024-03-26T06:18:45.312 INFO:teuthology.orchestra.run.smithi063.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-03-26T06:18:45.313 INFO:teuthology.orchestra.run.smithi063.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-03-26T06:18:45.314 INFO:teuthology.orchestra.run.smithi063.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-03-26T06:18:45.315 INFO:teuthology.orchestra.run.smithi063.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-03-26T06:18:45.317 INFO:teuthology.orchestra.run.smithi063.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-03-26T06:18:45.319 INFO:teuthology.orchestra.run.smithi063.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-03-26T06:18:45.321 INFO:teuthology.orchestra.run.smithi063.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-03-26T06:18:45.322 INFO:teuthology.orchestra.run.smithi063.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-03-26T06:18:45.324 INFO:teuthology.orchestra.run.smithi063.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-03-26T06:18:45.327 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-03-26T06:18:45.328 INFO:teuthology.orchestra.run.smithi063.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-03-26T06:18:45.331 INFO:teuthology.orchestra.run.smithi063.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-03-26T06:18:45.332 INFO:teuthology.orchestra.run.smithi063.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-03-26T06:18:45.333 INFO:teuthology.orchestra.run.smithi063.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-03-26T06:18:45.334 INFO:teuthology.orchestra.run.smithi063.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-03-26T06:18:45.335 INFO:teuthology.orchestra.run.smithi063.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-03-26T06:18:45.336 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-03-26T06:18:45.337 INFO:teuthology.orchestra.run.smithi063.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-03-26T06:18:45.338 INFO:teuthology.orchestra.run.smithi063.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-03-26T06:18:45.342 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-03-26T06:18:45.416 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-devel x86_64 5.14.0-432.el9 appstream 16 M 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-03-26T06:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: cpp x86_64 11.4.1-3.el9 appstream 11 M 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: device-mapper x86_64 9:1.02.197-2.el9 baseos 141 k 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 baseos 34 k 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 baseos 32 k 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 baseos 179 k 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: e2fsprogs x86_64 1.46.5-5.el9 baseos 1.0 M 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 baseos 222 k 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: gcc x86_64 11.4.1-3.el9 appstream 32 M 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-c++ x86_64 11.4.1-3.el9 appstream 13 M 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 appstream 47 k 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: git x86_64 2.43.0-1.el9 appstream 51 k 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: git-core x86_64 2.43.0-1.el9 appstream 4.4 M 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: git-core-doc noarch 2.43.0-1.el9 appstream 2.9 M 2024-03-26T06:18:45.421 INFO:teuthology.orchestra.run.smithi063.stdout: libcom_err x86_64 1.46.5-5.el9 baseos 26 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: libgcc x86_64 11.4.1-3.el9 baseos 92 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: libgomp x86_64 11.4.1-3.el9 baseos 268 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: libss x86_64 1.46.5-5.el9 baseos 32 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: libstdc++ x86_64 11.4.1-3.el9 baseos 743 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: libstdc++-devel x86_64 11.4.1-3.el9 appstream 2.4 M 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: lvm2 x86_64 9:2.03.23-2.el9 baseos 1.5 M 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 baseos 1.0 M 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: make x86_64 1:4.3-8.el9 baseos 536 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: perl-Git noarch 2.43.0-1.el9 appstream 38 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-03-26T06:18:45.422 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-26T06:18:45.423 INFO:teuthology.orchestra.run.smithi063.stdout:Install 17 Packages 2024-03-26T06:18:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 28 Packages 2024-03-26T06:18:45.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:18:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 103 M 2024-03-26T06:18:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-26T06:18:46.832 INFO:teuthology.orchestra.run.smithi063.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 43 kB/s | 17 kB 00:00 2024-03-26T06:18:46.873 INFO:teuthology.orchestra.run.smithi063.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 33 kB/s | 14 kB 00:00 2024-03-26T06:18:46.990 INFO:teuthology.orchestra.run.smithi063.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 88 kB/s | 13 kB 00:00 2024-03-26T06:18:47.024 INFO:teuthology.orchestra.run.smithi063.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 98 kB/s | 15 kB 00:00 2024-03-26T06:18:47.391 INFO:teuthology.orchestra.run.smithi063.stdout:(5/45): fio-3.35-1.el9.x86_64.rpm 6.5 MB/s | 6.2 MB 00:00 2024-03-26T06:18:47.416 INFO:teuthology.orchestra.run.smithi063.stdout:(6/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 50 kB/s | 20 kB 00:00 2024-03-26T06:18:47.441 INFO:teuthology.orchestra.run.smithi063.stdout:(7/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 34 kB/s | 15 kB 00:00 2024-03-26T06:18:47.475 INFO:teuthology.orchestra.run.smithi063.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 576 kB/s | 33 kB 00:00 2024-03-26T06:18:47.534 INFO:teuthology.orchestra.run.smithi063.stdout:(9/45): sqlite-3.34.1-7.el9.x86_64.rpm 6.3 MB/s | 747 kB 00:00 2024-03-26T06:18:47.559 INFO:teuthology.orchestra.run.smithi063.stdout:(10/45): udftools-2.2-5.el9.x86_64.rpm 1.3 MB/s | 144 kB 00:00 2024-03-26T06:18:47.593 INFO:teuthology.orchestra.run.smithi063.stdout:(11/45): rmt-1.6-6.el9.x86_64.rpm 395 kB/s | 45 kB 00:00 2024-03-26T06:18:47.785 INFO:teuthology.orchestra.run.smithi063.stdout:(12/45): libnbd-1.18.1-3.el9.x86_64.rpm 745 kB/s | 166 kB 00:00 2024-03-26T06:18:48.052 INFO:teuthology.orchestra.run.smithi063.stdout:(13/45): gdbm-1.19-4.el9.x86_64.rpm 289 kB/s | 132 kB 00:00 2024-03-26T06:18:48.169 INFO:teuthology.orchestra.run.smithi063.stdout:(14/45): gdbm-devel-1.19-4.el9.x86_64.rpm 153 kB/s | 59 kB 00:00 2024-03-26T06:18:48.252 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:18:48.261 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:18:48.453 INFO:teuthology.orchestra.run.smithi063.stdout:(15/45): dump-0.4-0.51.b47.el9.x86_64.rpm 220 kB/s | 88 kB 00:00 2024-03-26T06:18:48.511 INFO:teuthology.orchestra.run.smithi063.stdout:(16/45): python-unversioned-command-3.9.18-3.el 145 kB/s | 8.3 kB 00:00 2024-03-26T06:18:48.654 INFO:teuthology.orchestra.run.smithi063.stdout:(17/45): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 204 kB 00:00 2024-03-26T06:18:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:(18/45): indent-2.2.13-5.el9.x86_64.rpm 347 kB/s | 179 kB 00:00 2024-03-26T06:18:48.712 INFO:teuthology.orchestra.run.smithi063.stdout:(19/45): python3-3.9.18-3.el9.x86_64.rpm 437 kB/s | 25 kB 00:00 2024-03-26T06:18:48.888 INFO:teuthology.orchestra.run.smithi063.stdout:(20/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 3.5 MB/s | 619 kB 00:00 2024-03-26T06:18:49.030 INFO:teuthology.orchestra.run.smithi063.stdout:(21/45): python3-libs-3.9.18-3.el9.x86_64.rpm 21 MB/s | 7.3 MB 00:00 2024-03-26T06:18:49.180 INFO:teuthology.orchestra.run.smithi063.stdout:(22/45): device-mapper-event-1.02.197-2.el9.x86 230 kB/s | 34 kB 00:00 2024-03-26T06:18:49.264 INFO:teuthology.orchestra.run.smithi063.stdout:(23/45): device-mapper-event-libs-1.02.197-2.el 389 kB/s | 32 kB 00:00 2024-03-26T06:18:49.289 INFO:teuthology.orchestra.run.smithi063.stdout:(24/45): device-mapper-1.02.197-2.el9.x86_64.rp 355 kB/s | 141 kB 00:00 2024-03-26T06:18:49.439 INFO:teuthology.orchestra.run.smithi063.stdout:(25/45): device-mapper-libs-1.02.197-2.el9.x86_ 1.0 MB/s | 179 kB 00:00 2024-03-26T06:18:49.656 INFO:teuthology.orchestra.run.smithi063.stdout:(26/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 1.0 MB/s | 222 kB 00:00 2024-03-26T06:18:49.748 INFO:teuthology.orchestra.run.smithi063.stdout:(27/45): libcom_err-1.46.5-5.el9.x86_64.rpm 291 kB/s | 26 kB 00:00 2024-03-26T06:18:49.840 INFO:teuthology.orchestra.run.smithi063.stdout:(28/45): libgcc-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 92 kB 00:00 2024-03-26T06:18:49.957 INFO:teuthology.orchestra.run.smithi063.stdout:(29/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2024-03-26T06:18:51.982 INFO:teuthology.orchestra.run.smithi063.stdout:(30/45): libss-1.46.5-5.el9.x86_64.rpm 16 kB/s | 32 kB 00:02 2024-03-26T06:18:52.349 INFO:teuthology.orchestra.run.smithi063.stdout:(31/45): kernel-devel-5.14.0-432.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-03-26T06:18:52.383 INFO:teuthology.orchestra.run.smithi063.stdout:(32/45): libgomp-11.4.1-3.el9.x86_64.rpm 106 kB/s | 268 kB 00:02 2024-03-26T06:18:52.566 INFO:teuthology.orchestra.run.smithi063.stdout:(33/45): libstdc++-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 743 kB 00:00 2024-03-26T06:18:52.850 INFO:teuthology.orchestra.run.smithi063.stdout:(34/45): make-4.3-8.el9.x86_64.rpm 1.9 MB/s | 536 kB 00:00 2024-03-26T06:18:53.375 INFO:teuthology.orchestra.run.smithi063.stdout:(35/45): lvm2-2.03.23-2.el9.x86_64.rpm 1.5 MB/s | 1.5 MB 00:01 2024-03-26T06:18:54.959 INFO:teuthology.orchestra.run.smithi063.stdout:(36/45): cpp-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 11 MB 00:02 2024-03-26T06:18:55.359 INFO:teuthology.orchestra.run.smithi063.stdout:(37/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 343 kB/s | 1.0 MB 00:02 2024-03-26T06:18:55.501 INFO:teuthology.orchestra.run.smithi063.stdout:(38/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 336 kB/s | 47 kB 00:00 2024-03-26T06:18:55.593 INFO:teuthology.orchestra.run.smithi063.stdout:(39/45): git-2.43.0-1.el9.x86_64.rpm 559 kB/s | 51 kB 00:00 2024-03-26T06:18:56.444 INFO:teuthology.orchestra.run.smithi063.stdout:(40/45): gcc-11.4.1-3.el9.x86_64.rpm 11 MB/s | 32 MB 00:03 2024-03-26T06:18:56.644 INFO:teuthology.orchestra.run.smithi063.stdout:(41/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 7.6 MB/s | 13 MB 00:01 2024-03-26T06:18:56.911 INFO:teuthology.orchestra.run.smithi063.stdout:(42/45): git-core-doc-2.43.0-1.el9.noarch.rpm 6.3 MB/s | 2.9 MB 00:00 2024-03-26T06:18:56.986 INFO:teuthology.orchestra.run.smithi063.stdout:(43/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 7.1 MB/s | 2.4 MB 00:00 2024-03-26T06:18:57.003 INFO:teuthology.orchestra.run.smithi063.stdout:(44/45): perl-Git-2.43.0-1.el9.noarch.rpm 417 kB/s | 38 kB 00:00 2024-03-26T06:18:57.437 INFO:teuthology.orchestra.run.smithi063.stdout:(45/45): git-core-2.43.0-1.el9.x86_64.rpm 2.4 MB/s | 4.4 MB 00:01 2024-03-26T06:18:57.441 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-26T06:18:57.441 INFO:teuthology.orchestra.run.smithi063.stdout:Total 8.6 MB/s | 103 MB 00:12 2024-03-26T06:18:59.177 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-26T06:18:59.607 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-26T06:18:59.608 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-26T06:19:01.245 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-26T06:19:01.245 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-26T06:19:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-26T06:19:04.603 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-26T06:19:04.686 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-26T06:19:04.787 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-03-26T06:19:04.855 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-03-26T06:19:04.961 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-03-26T06:19:05.058 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-03-26T06:19:05.101 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-03-26T06:19:05.443 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-03-26T06:19:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 8/73 2024-03-26T06:19:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : make-1:4.3-8.el9.x86_64 9/73 2024-03-26T06:19:07.344 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 10/73 2024-03-26T06:19:07.539 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 11/73 2024-03-26T06:19:07.566 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 12/73 2024-03-26T06:19:08.559 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 13/73 2024-03-26T06:19:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-03-26T06:19:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-03-26T06:19:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-03-26T06:19:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-26T06:19:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-26T06:19:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-03-26T06:19:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-03-26T06:19:10.434 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-03-26T06:19:10.672 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 21/73 2024-03-26T06:19:11.772 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 22/73 2024-03-26T06:19:11.984 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-03-26T06:19:12.104 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-03-26T06:19:12.151 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-03-26T06:19:12.189 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 25/73 2024-03-26T06:19:12.222 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 26/73 2024-03-26T06:19:12.256 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 27/73 2024-03-26T06:19:12.290 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 28/73 2024-03-26T06:19:12.324 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 29/73 2024-03-26T06:19:12.357 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 30/73 2024-03-26T06:19:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 31/73 2024-03-26T06:19:12.653 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-3.35-1.el9.x86_64 32/73 2024-03-26T06:19:12.693 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rmt-2:1.6-6.el9.x86_64 33/73 2024-03-26T06:19:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-03-26T06:19:18.401 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:19:18.410 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:19:24.667 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-03-26T06:19:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-devel-5.14.0-432.el9.x86_64 36/73 2024-03-26T06:19:48.562 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:19:48.569 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:20:17.619 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-devel-5.14.0-432.el9.x86_64 36/73 2024-03-26T06:20:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-03-26T06:20:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-26T06:20:17.968 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-26T06:20:18.214 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-03-26T06:20:18.215 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-26T06:20:18.215 INFO:teuthology.orchestra.run.smithi063.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-03-26T06:20:18.215 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:20:18.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:20:18.708 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:20:18.759 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-26T06:20:18.810 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-03-26T06:20:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-03-26T06:20:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-03-26T06:20:19.077 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-03-26T06:20:19.112 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-03-26T06:20:19.153 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-03-26T06:20:19.206 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 47/73 2024-03-26T06:20:19.259 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 48/73 2024-03-26T06:20:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 49/73 2024-03-26T06:20:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-03-26T06:20:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-03-26T06:20:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-26T06:20:19.490 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-26T06:20:19.543 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 53/73 2024-03-26T06:20:19.576 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-26T06:20:19.576 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-26T06:20:19.731 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-26T06:20:19.835 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 55/73 2024-03-26T06:20:19.884 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 56/73 2024-03-26T06:20:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 57/73 2024-03-26T06:20:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 58/73 2024-03-26T06:20:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-26T06:20:20.014 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-26T06:20:20.053 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 60/73 2024-03-26T06:20:20.095 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 61/73 2024-03-26T06:20:20.162 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-03-26T06:20:20.195 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-03-26T06:20:20.230 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-03-26T06:20:20.373 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-03-26T06:20:20.442 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-03-26T06:20:20.474 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-03-26T06:20:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-03-26T06:20:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-26T06:20:20.667 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-26T06:20:20.721 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 70/73 2024-03-26T06:20:20.761 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 71/73 2024-03-26T06:20:20.805 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 72/73 2024-03-26T06:20:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : make-1:4.3-7.el9.x86_64 73/73 2024-03-26T06:20:22.805 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: make-1:4.3-7.el9.x86_64 73/73 2024-03-26T06:20:22.805 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-03-26T06:20:22.805 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-03-26T06:20:22.805 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-03-26T06:20:22.805 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-03-26T06:20:22.805 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-03-26T06:20:22.805 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-03-26T06:20:22.805 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-03-26T06:20:22.805 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 9/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-devel-5.14.0-432.el9.x86_64 12/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 18/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 19/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 20/73 2024-03-26T06:20:22.806 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 21/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-3.9.18-3.el9.x86_64 22/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-3.9.17-2.el9.x86_64 23/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 24/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 25/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 26/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 27/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 28/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 29/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 30/73 2024-03-26T06:20:22.807 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 31/73 2024-03-26T06:20:22.811 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 32/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 33/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 34/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 35/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 36/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 37/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 38/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 39/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 40/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 41/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 42/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 43/73 2024-03-26T06:20:22.812 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 44/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 45/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libss-1.46.5-5.el9.x86_64 46/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libss-1.46.5-3.el9.x86_64 47/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 48/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 49/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 50/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 51/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 52/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : make-1:4.3-8.el9.x86_64 54/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : make-1:4.3-7.el9.x86_64 55/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 56/73 2024-03-26T06:20:22.813 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 57/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 58/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 59/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 60/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 61/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 62/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 63/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : git-2.43.0-1.el9.x86_64 64/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : git-2.39.3-1.el9.x86_64 65/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 66/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 67/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 68/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 69/73 2024-03-26T06:20:22.814 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 70/73 2024-03-26T06:20:22.815 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 71/73 2024-03-26T06:20:22.815 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 72/73 2024-03-26T06:20:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 73/73 2024-03-26T06:20:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:20:23.828 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-03-26T06:20:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: cpp-11.4.1-3.el9.x86_64 2024-03-26T06:20:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-03-26T06:20:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-11.4.1-3.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: git-2.43.0-1.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: git-core-2.43.0-1.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: libgcc-11.4.1-3.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: libgomp-11.4.1-3.el9.x86_64 2024-03-26T06:20:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: libss-1.46.5-5.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: make-1:4.3-8.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: perl-Git-2.43.0-1.el9.noarch 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: python3-3.9.18-3.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-03-26T06:20:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-03-26T06:20:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-03-26T06:20:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-03-26T06:20:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-03-26T06:20:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-432.el9.x86_64 2024-03-26T06:20:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-26T06:20:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-03-26T06:20:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: udftools-2.2-5.el9.x86_64 2024-03-26T06:20:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:20:23.831 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-26T06:20:24.433 DEBUG:teuthology.orchestra.run.smithi063:> sudo useradd -m fsgqa 2024-03-26T06:20:24.509 INFO:teuthology.orchestra.run.smithi063.stderr:useradd: user 'fsgqa' already exists 2024-03-26T06:20:24.512 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-26T06:20:24.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo groupadd fsgqa 2024-03-26T06:20:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:groupadd: group 'fsgqa' already exists 2024-03-26T06:20:24.584 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-26T06:20:24.584 DEBUG:teuthology.orchestra.run.smithi063:> sudo useradd fsgqa2 2024-03-26T06:20:25.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo useradd 123456-fsgqa 2024-03-26T06:20:25.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-03-26T06:20:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.126+0000 7fa393200640 1 Processor -- start 2024-03-26T06:20:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.126+0000 7fa393200640 1 -- start start 2024-03-26T06:20:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.128+0000 7fa393200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 0x7fa38c06ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.128+0000 7fa393200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa38c06ef70 0x7fa38c071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.128+0000 7fa393200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c15bf80 con 0x7fa38c071890 2024-03-26T06:20:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.128+0000 7fa393200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c0a86e0 con 0x7fa38c06ef70 2024-03-26T06:20:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.128+0000 7fa393200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c06e2f0 con 0x7fa38c145100 2024-03-26T06:20:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.128+0000 7fa391200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa38c071890 0x7fa38c15f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:47024/0 (socket says 172.21.15.63:47024) 2024-03-26T06:20:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.128+0000 7fa391200640 1 -- 172.21.15.63:0/2539104867 learned_addr learned my addr 172.21.15.63:0/2539104867 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:20:26.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.129+0000 7fa38be00640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 0x7fa38c06ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.129+0000 7fa383e00640 1 --2- 172.21.15.63:0/2539104867 >> v2:172.21.15.204:3300/0 conn(0x7fa38c06ef70 0x7fa38c071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.129+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455716061 0 0) 0x7fa38c15bf80 con 0x7fa38c071890 2024-03-26T06:20:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.129+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa370003520 con 0x7fa38c071890 2024-03-26T06:20:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 188455164 0 0) 0x7fa370003520 con 0x7fa38c071890 2024-03-26T06:20:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 msgr2=0x7fa38c06ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:20:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 0x7fa38c06ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 >> v2:172.21.15.204:3300/0 conn(0x7fa38c06ef70 msgr2=0x7fa38c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:20:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 --2- 172.21.15.63:0/2539104867 >> v2:172.21.15.204:3300/0 conn(0x7fa38c06ef70 0x7fa38c071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c06d770 con 0x7fa38c071890 2024-03-26T06:20:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38be00640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 0x7fa38c06ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T06:20:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7fa3840019f0 con 0x7fa38c071890 2024-03-26T06:20:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 >> v1:172.21.15.63:6789/0 conn(0x7fa38c071890 legacy=0x7fa38c15f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700039b0 0x7fa370003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 0x7fa370004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa370004d40 0x7fa3700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c06e2f0 con 0x7fa370004d40 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37000b9c0 con 0x7fa3700039b0 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37000bb40 con 0x7fa38c145100 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa391200640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa370004d40 0x7fa3700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.130+0000 7fa383e00640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 0x7fa370004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.131+0000 7fa38be00640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700039b0 0x7fa370003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.131+0000 7fa391200640 1 -- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 msgr2=0x7fa370004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.131+0000 7fa391200640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 0x7fa370004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.131+0000 7fa391200640 1 -- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700039b0 msgr2=0x7fa370003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.131+0000 7fa391200640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700039b0 0x7fa370003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.131+0000 7fa391200640 1 -- 172.21.15.63:0/2539104867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370003520 con 0x7fa370004d40 2024-03-26T06:20:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.131+0000 7fa383e00640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c145100 0x7fa370004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-26T06:20:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.132+0000 7fa391200640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa370004d40 0x7fa3700051c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa38400a920 tx=0x7fa370005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff63b7d5da2330e server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:20:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.132+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38400a4c0 con 0x7fa370004d40 2024-03-26T06:20:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.132+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa384034650 con 0x7fa370004d40 2024-03-26T06:20:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.132+0000 7fa38b400640 1 -- 172.21.15.63:0/2539104867 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384034a40 con 0x7fa370004d40 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.133+0000 7fa393200640 1 -- 172.21.15.63:0/2539104867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa370004d40 msgr2=0x7fa3700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.133+0000 7fa393200640 1 --2- 172.21.15.63:0/2539104867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa370004d40 0x7fa3700051c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa38400a920 tx=0x7fa370005830 comp rx=0 tx=0).stop 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.133+0000 7fa391200640 1 -- 172.21.15.63:0/2539104867 reap_dead start 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.133+0000 7fa393200640 1 -- 172.21.15.63:0/2539104867 shutdown_connections 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.133+0000 7fa393200640 1 -- 172.21.15.63:0/2539104867 >> 172.21.15.63:0/2539104867 conn(0x7fa38c06ac90 msgr2=0x7fa38c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.133+0000 7fa393200640 1 -- 172.21.15.63:0/2539104867 shutdown_connections 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.133+0000 7fa393200640 1 -- 172.21.15.63:0/2539104867 wait complete. 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.135+0000 7fa393200640 1 Processor -- start 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.135+0000 7fa393200640 1 -- start start 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.136+0000 7fa393200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa370004d40 0x7fa38c15e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.136+0000 7fa393200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c1f2f10 0x7fa38c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.136+0000 7fa393200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c1f6c50 0x7fa38c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.136+0000 7fa393200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c06e010 con 0x7fa38c1f2f10 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.136+0000 7fa393200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c06dd30 con 0x7fa370004d40 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.136+0000 7fa393200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1454e0 con 0x7fa38c1f6c50 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.136+0000 7fa383e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c1f2f10 0x7fa38c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.136+0000 7fa383e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c1f2f10 0x7fa38c0cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38598/0 (socket says 172.21.15.63:38598) 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.136+0000 7fa383e00640 1 -- 172.21.15.63:0/3783893443 learned_addr learned my addr 172.21.15.63:0/3783893443 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.137+0000 7fa38be00640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa370004d40 0x7fa38c15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.137+0000 7fa391200640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c1f6c50 0x7fa38c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.137+0000 7fa383e00640 1 -- 172.21.15.63:0/3783893443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c1f6c50 msgr2=0x7fa38c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.137+0000 7fa383e00640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c1f6c50 0x7fa38c15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.137+0000 7fa383e00640 1 -- 172.21.15.63:0/3783893443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa370004d40 msgr2=0x7fa38c15e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.137+0000 7fa383e00640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa370004d40 0x7fa38c15e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.137+0000 7fa383e00640 1 -- 172.21.15.63:0/3783893443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c1f36d0 con 0x7fa38c1f2f10 2024-03-26T06:20:26.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.137+0000 7fa383e00640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c1f2f10 0x7fa38c0cc560 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa3740116d0 tx=0x7fa374011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:20:26.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.138+0000 7fa388c00640 1 -- 172.21.15.63:0/3783893443 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400f9c0 con 0x7fa38c1f2f10 2024-03-26T06:20:26.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.138+0000 7fa388c00640 1 -- 172.21.15.63:0/3783893443 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37400fb60 con 0x7fa38c1f2f10 2024-03-26T06:20:26.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.138+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c1f39b0 con 0x7fa38c1f2f10 2024-03-26T06:20:26.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.138+0000 7fa388c00640 1 -- 172.21.15.63:0/3783893443 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374015460 con 0x7fa38c1f2f10 2024-03-26T06:20:26.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.138+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c1f3390 con 0x7fa38c1f2f10 2024-03-26T06:20:26.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.140+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c1f6880 con 0x7fa38c1f2f10 2024-03-26T06:20:26.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.140+0000 7fa388c00640 1 -- 172.21.15.63:0/3783893443 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa374015600 con 0x7fa38c1f2f10 2024-03-26T06:20:26.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.141+0000 7fa388c00640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa36806bbd0 0x7fa36806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.141+0000 7fa388c00640 1 -- 172.21.15.63:0/3783893443 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fa37408b5d0 con 0x7fa38c1f2f10 2024-03-26T06:20:26.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.142+0000 7fa38be00640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa36806bbd0 0x7fa36806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.142+0000 7fa38be00640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa36806bbd0 0x7fa36806e090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009560 tx=0x7fa37c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:20:26.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.146+0000 7fa388c00640 1 -- 172.21.15.63:0/3783893443 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa374019030 con 0x7fa38c1f2f10 2024-03-26T06:20:26.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.432+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa38c074730 con 0x7fa38c1f2f10 2024-03-26T06:20:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.432+0000 7fa388c00640 1 -- 172.21.15.63:0/3783893443 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1285 (secure 0 0 0) 0x7fa374059fa0 con 0x7fa38c1f2f10 2024-03-26T06:20:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:20:26.433 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":1,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","modified":"2024-03-26T06:15:50.070963Z","created":"2024-03-26T06:15:50.070963Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:3300","nonce":0},{"type":"v1","addr":"172.21.15.204:6789","nonce":0}]},"addr":"172.21.15.204:6789/0","public_addr":"172.21.15.204:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:3301","nonce":0},{"type":"v1","addr":"172.21.15.204:6790","nonce":0}]},"addr":"172.21.15.204:6790/0","public_addr":"172.21.15.204:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-26T06:20:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:dumped monmap epoch 1 2024-03-26T06:20:26.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa36806bbd0 msgr2=0x7fa36806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa36806bbd0 0x7fa36806e090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009560 tx=0x7fa37c008040 comp rx=0 tx=0).stop 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c1f2f10 msgr2=0x7fa38c0cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c1f2f10 0x7fa38c0cc560 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa3740116d0 tx=0x7fa374011b90 comp rx=0 tx=0).stop 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 shutdown_connections 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fa36806bbd0 0x7fa36806e090 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa38c1f6c50 0x7fa38c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c1f2f10 0x7fa38c0cc560 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 --2- 172.21.15.63:0/3783893443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa370004d40 0x7fa38c15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 >> 172.21.15.63:0/3783893443 conn(0x7fa38c06ac90 msgr2=0x7fa38c0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 shutdown_connections 2024-03-26T06:20:26.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.435+0000 7fa393200640 1 -- 172.21.15.63:0/3783893443 wait complete. 2024-03-26T06:20:26.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-03-26T06:20:26.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.637+0000 7f2fa2e00640 1 Processor -- start 2024-03-26T06:20:26.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.637+0000 7f2fa2e00640 1 -- start start 2024-03-26T06:20:26.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.638+0000 7f2fa2e00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2f9c0ae570 0x7f2f9c0ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.638+0000 7f2fa2e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c15efb0 con 0x7f2f9c0b32e0 2024-03-26T06:20:26.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.638+0000 7f2fa2e00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c15e3a0 con 0x7f2f9c157f90 2024-03-26T06:20:26.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.638+0000 7f2fa2e00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c15e680 con 0x7f2f9c0ae570 2024-03-26T06:20:26.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.639+0000 7f2fa0e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2f9c0b32e0 0x7f2f9c161920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:47038/0 (socket says 172.21.15.63:47038) 2024-03-26T06:20:26.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.639+0000 7f2fa0e00640 1 -- 172.21.15.63:0/3064606472 learned_addr learned my addr 172.21.15.63:0/3064606472 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T06:20:26.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.639+0000 7f2f9b400640 1 --2- 172.21.15.63:0/3064606472 >> v2:172.21.15.204:3300/0 conn(0x7f2f9c0ae570 0x7f2f9c0ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.639+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435955488 0 0) 0x7f2f9c15efb0 con 0x7f2f9c0b32e0 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.639+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f80003520 con 0x7f2f9c0b32e0 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3376058045 0 0) 0x7f2f80003520 con 0x7f2f9c0b32e0 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 >> v2:172.21.15.204:3300/0 conn(0x7f2f9c0ae570 msgr2=0x7f2f9c0ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 --2- 172.21.15.63:0/3064606472 >> v2:172.21.15.204:3300/0 conn(0x7f2f9c0ae570 0x7f2f9c0ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 >> v1:172.21.15.204:6789/0 conn(0x7f2f9c157f90 legacy=0x7f2f9c0acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c15e960 con 0x7f2f9c0b32e0 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3185143928 0 0) 0x7f2f940019f0 con 0x7f2f9c0b32e0 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 >> v1:172.21.15.63:6789/0 conn(0x7f2f9c0b32e0 legacy=0x7f2f9c161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f800039b0 0x7f2f80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f80004800 0x7f2f80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f800051c0 0x7f2f8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c15e680 con 0x7f2f80004800 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8000c060 con 0x7f2f800039b0 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8000c260 con 0x7f2f800051c0 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.640+0000 7f2f9b400640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f80004800 0x7f2f80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.641+0000 7f2fa0e00640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f800051c0 0x7f2f8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.641+0000 7f2f9b400640 1 -- 172.21.15.63:0/3064606472 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f800051c0 msgr2=0x7f2f8000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.641+0000 7f2f9b400640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f800051c0 0x7f2f8000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.641+0000 7f2f9b400640 1 -- 172.21.15.63:0/3064606472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f800039b0 msgr2=0x7f2f80003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.641+0000 7f2f9b400640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f800039b0 0x7f2f80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.641+0000 7f2f9b400640 1 -- 172.21.15.63:0/3064606472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80003520 con 0x7f2f80004800 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.641+0000 7f2fa0e00640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f800051c0 0x7f2f8000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:20:26.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.641+0000 7f2fa0e00640 1 -- 172.21.15.63:0/3064606472 reap_dead start 2024-03-26T06:20:26.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.642+0000 7f2f9b400640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f80004800 0x7f2f80004c80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009ac0 tx=0x7f2f80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5ea57f380e2e36 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:20:26.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.642+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88039070 con 0x7f2f80004800 2024-03-26T06:20:26.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.642+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8802c6d0 con 0x7f2f80004800 2024-03-26T06:20:26.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.642+0000 7f2f9aa00640 1 -- 172.21.15.63:0/3064606472 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88009690 con 0x7f2f80004800 2024-03-26T06:20:26.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.643+0000 7f2fa2e00640 1 -- 172.21.15.63:0/3064606472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f80004800 msgr2=0x7f2f80004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.643+0000 7f2fa2e00640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f80004800 0x7f2f80004c80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009ac0 tx=0x7f2f80005830 comp rx=0 tx=0).stop 2024-03-26T06:20:26.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.643+0000 7f2fa2e00640 1 -- 172.21.15.63:0/3064606472 shutdown_connections 2024-03-26T06:20:26.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.643+0000 7f2fa2e00640 1 --2- 172.21.15.63:0/3064606472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f80004800 0x7f2f80004c80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.643+0000 7f2fa2e00640 1 -- 172.21.15.63:0/3064606472 >> 172.21.15.63:0/3064606472 conn(0x7f2f9c06ac90 msgr2=0x7f2f9c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:20:26.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.643+0000 7f2fa2e00640 1 -- 172.21.15.63:0/3064606472 shutdown_connections 2024-03-26T06:20:26.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.643+0000 7f2fa2e00640 1 -- 172.21.15.63:0/3064606472 wait complete. 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.645+0000 7f2fa2e00640 1 Processor -- start 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.645+0000 7f2fa2e00640 1 -- start start 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2fa2e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f80004800 0x7f2f9c13c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2fa2e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f9c13eae0 0x7f2f9c13d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2fa2e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f9c13dc50 0x7f2f9c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2fa2e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c158370 con 0x7f2f9c13eae0 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2fa2e00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c15e050 con 0x7f2f80004800 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2fa2e00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c13c670 con 0x7f2f9c13dc50 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2f9b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f9c13eae0 0x7f2f9c13d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2f9b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f9c13eae0 0x7f2f9c13d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38614/0 (socket says 172.21.15.63:38614) 2024-03-26T06:20:26.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2f9b400640 1 -- 172.21.15.63:0/831735061 learned_addr learned my addr 172.21.15.63:0/831735061 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.646+0000 7f2f9be00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f80004800 0x7f2f9c13c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2fa0e00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f9c13dc50 0x7f2f9c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f9b400640 1 -- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f9c13dc50 msgr2=0x7f2f9c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f9b400640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f9c13dc50 0x7f2f9c154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f9b400640 1 -- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f80004800 msgr2=0x7f2f9c13c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f9b400640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f80004800 0x7f2f9c13c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f9b400640 1 -- 172.21.15.63:0/831735061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c13c950 con 0x7f2f9c13eae0 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f9be00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f80004800 0x7f2f9c13c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2fa0e00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f9c13dc50 0x7f2f9c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f9b400640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f9c13eae0 0x7f2f9c13d710 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009ac0 tx=0x7f2f88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f93e00640 1 -- 172.21.15.63:0/831735061 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88039050 con 0x7f2f9c13eae0 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f93e00640 1 -- 172.21.15.63:0/831735061 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88045070 con 0x7f2f9c13eae0 2024-03-26T06:20:26.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.647+0000 7f2f93e00640 1 -- 172.21.15.63:0/831735061 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880044e0 con 0x7f2f9c13eae0 2024-03-26T06:20:26.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.648+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c13cc30 con 0x7f2f9c13eae0 2024-03-26T06:20:26.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.648+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c13d1f0 con 0x7f2f9c13eae0 2024-03-26T06:20:26.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.649+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c074730 con 0x7f2f9c13eae0 2024-03-26T06:20:26.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.650+0000 7f2f93e00640 1 -- 172.21.15.63:0/831735061 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2f88003a50 con 0x7f2f9c13eae0 2024-03-26T06:20:26.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.651+0000 7f2f93e00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f7c06bbd0 0x7f2f7c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T06:20:26.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.651+0000 7f2f93e00640 1 -- 172.21.15.63:0/831735061 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f2f880ac860 con 0x7f2f9c13eae0 2024-03-26T06:20:26.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.651+0000 7f2f9be00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f7c06bbd0 0x7f2f7c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T06:20:26.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.652+0000 7f2f9be00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f7c06bbd0 0x7f2f7c06e090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c001710 tx=0x7f2f8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T06:20:26.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.656+0000 7f2f93e00640 1 -- 172.21.15.63:0/831735061 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2f8804e020 con 0x7f2f9c13eae0 2024-03-26T06:20:26.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.964+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f2f9c06b210 con 0x7f2f9c13eae0 2024-03-26T06:20:26.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.964+0000 7f2f93e00640 1 -- 172.21.15.63:0/831735061 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v14) v1 ==== 92+0+63 (secure 0 0 0) 0x7f2f8807b1a0 con 0x7f2f9c13eae0 2024-03-26T06:20:26.965 INFO:teuthology.orchestra.run.smithi063.stdout:[client.admin] 2024-03-26T06:20:26.965 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== 2024-03-26T06:20:26.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.967+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f7c06bbd0 msgr2=0x7f2f7c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.967+0000 7f2fa2e00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f7c06bbd0 0x7f2f7c06e090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c001710 tx=0x7f2f8c009040 comp rx=0 tx=0).stop 2024-03-26T06:20:26.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.967+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f9c13eae0 msgr2=0x7f2f9c13d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T06:20:26.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.967+0000 7f2fa2e00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f9c13eae0 0x7f2f9c13d710 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009ac0 tx=0x7f2f88004730 comp rx=0 tx=0).stop 2024-03-26T06:20:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.968+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 shutdown_connections 2024-03-26T06:20:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.968+0000 7f2fa2e00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f2f7c06bbd0 0x7f2f7c06e090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.968+0000 7f2fa2e00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f9c13dc50 0x7f2f9c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.968+0000 7f2fa2e00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f9c13eae0 0x7f2f9c13d710 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.968+0000 7f2fa2e00640 1 --2- 172.21.15.63:0/831735061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f80004800 0x7f2f9c13c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T06:20:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.968+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 >> 172.21.15.63:0/831735061 conn(0x7f2f9c06ac90 msgr2=0x7f2f9c1571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T06:20:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.968+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 shutdown_connections 2024-03-26T06:20:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T06:20:26.968+0000 7f2fa2e00640 1 -- 172.21.15.63:0/831735061 wait complete. 2024-03-26T06:20:26.988 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:20:26.988 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/tmp/tmp.W8GLtFOA0Cxfstests-dev/local.config 2024-03-26T06:20:27.063 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.63:6789:/test export TEST_DIR=/tmp/tmp.LsIyRsPUXptest export SCRATCH_DEV=172.21.15.63:6789:/scratch export SCRATCH_MNT=/tmp/tmp.IruX4MVgMUscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg==" 2024-03-26T06:20:27.064 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T06:20:27.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/tmp/tmp.W8GLtFOA0Cxfstests-dev/ceph.exclude 2024-03-26T06:20:27.182 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo make) 2024-03-26T06:20:27.314 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize -cfi 2024-03-26T06:20:27.903 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: putting auxiliary files in '.'. 2024-03-26T06:20:27.903 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './config.guess' 2024-03-26T06:20:27.914 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './config.sub' 2024-03-26T06:20:27.925 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './install-sh' 2024-03-26T06:20:27.936 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './ltmain.sh' 2024-03-26T06:20:28.007 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-03-26T06:20:28.007 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-03-26T06:20:28.021 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-03-26T06:20:28.035 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-03-26T06:20:28.050 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-03-26T06:20:28.063 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-03-26T06:20:28.082 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-03-26T06:20:28.086 INFO:teuthology.orchestra.run.smithi063.stdout:cp include/install-sh . 2024-03-26T06:20:28.088 INFO:teuthology.orchestra.run.smithi063.stdout:aclocal -I m4 2024-03-26T06:20:29.746 INFO:teuthology.orchestra.run.smithi063.stdout:autoheader 2024-03-26T06:20:30.173 INFO:teuthology.orchestra.run.smithi063.stdout:autoconf 2024-03-26T06:20:30.442 INFO:teuthology.orchestra.run.smithi063.stdout:./configure \ 2024-03-26T06:20:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: --libexecdir=/usr/lib \ 2024-03-26T06:20:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: --exec_prefix=/var/lib 2024-03-26T06:20:30.912 INFO:teuthology.orchestra.run.smithi063.stdout:checking build system type... x86_64-pc-linux-gnu 2024-03-26T06:20:30.912 INFO:teuthology.orchestra.run.smithi063.stdout:checking host system type... x86_64-pc-linux-gnu 2024-03-26T06:20:30.917 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to print strings... printf 2024-03-26T06:20:30.918 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc... gcc 2024-03-26T06:20:31.080 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether the C compiler works... yes 2024-03-26T06:20:31.080 INFO:teuthology.orchestra.run.smithi063.stdout:checking for C compiler default output file name... a.out 2024-03-26T06:20:31.156 INFO:teuthology.orchestra.run.smithi063.stdout:checking for suffix of executables... 2024-03-26T06:20:31.265 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether we are cross compiling... no 2024-03-26T06:20:31.319 INFO:teuthology.orchestra.run.smithi063.stdout:checking for suffix of object files... o 2024-03-26T06:20:31.363 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether we are using the GNU C compiler... yes 2024-03-26T06:20:31.413 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether gcc accepts -g... yes 2024-03-26T06:20:31.482 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-26T06:20:31.492 INFO:teuthology.orchestra.run.smithi063.stdout:checking for a sed that does not truncate output... /bin/sed 2024-03-26T06:20:31.500 INFO:teuthology.orchestra.run.smithi063.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-03-26T06:20:31.506 INFO:teuthology.orchestra.run.smithi063.stdout:checking for egrep... /bin/grep -E 2024-03-26T06:20:31.512 INFO:teuthology.orchestra.run.smithi063.stdout:checking for fgrep... /bin/grep -F 2024-03-26T06:20:31.526 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ld used by gcc... /bin/ld 2024-03-26T06:20:31.533 INFO:teuthology.orchestra.run.smithi063.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-03-26T06:20:31.549 INFO:teuthology.orchestra.run.smithi063.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-03-26T06:20:32.603 INFO:teuthology.orchestra.run.smithi063.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-03-26T06:20:32.604 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether ln -s works... yes 2024-03-26T06:20:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:checking the maximum length of command line arguments... 1572864 2024-03-26T06:20:32.635 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-03-26T06:20:32.635 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-03-26T06:20:32.635 INFO:teuthology.orchestra.run.smithi063.stdout:checking for /bin/ld option to reload object files... -r 2024-03-26T06:20:32.636 INFO:teuthology.orchestra.run.smithi063.stdout:checking for objdump... objdump 2024-03-26T06:20:32.636 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to recognize dependent libraries... pass_all 2024-03-26T06:20:32.636 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dlltool... no 2024-03-26T06:20:32.637 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-03-26T06:20:32.637 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ar... ar 2024-03-26T06:20:32.755 INFO:teuthology.orchestra.run.smithi063.stdout:checking for archiver @FILE support... @ 2024-03-26T06:20:32.756 INFO:teuthology.orchestra.run.smithi063.stdout:checking for strip... strip 2024-03-26T06:20:32.757 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ranlib... ranlib 2024-03-26T06:20:32.758 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gawk... gawk 2024-03-26T06:20:32.950 INFO:teuthology.orchestra.run.smithi063.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-03-26T06:20:32.955 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sysroot... no 2024-03-26T06:20:32.967 INFO:teuthology.orchestra.run.smithi063.stdout:checking for a working dd... /bin/dd 2024-03-26T06:20:32.978 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-03-26T06:20:33.024 INFO:teuthology.orchestra.run.smithi063.stdout:checking for mt... no 2024-03-26T06:20:33.035 INFO:teuthology.orchestra.run.smithi063.stdout:checking if : is a manifest tool... no 2024-03-26T06:20:33.144 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to run the C preprocessor... gcc -E 2024-03-26T06:20:33.510 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ANSI C header files... yes 2024-03-26T06:20:33.573 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/types.h... yes 2024-03-26T06:20:33.658 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/stat.h... yes 2024-03-26T06:20:33.731 INFO:teuthology.orchestra.run.smithi063.stdout:checking for stdlib.h... yes 2024-03-26T06:20:33.802 INFO:teuthology.orchestra.run.smithi063.stdout:checking for string.h... yes 2024-03-26T06:20:33.889 INFO:teuthology.orchestra.run.smithi063.stdout:checking for memory.h... yes 2024-03-26T06:20:33.967 INFO:teuthology.orchestra.run.smithi063.stdout:checking for strings.h... yes 2024-03-26T06:20:34.057 INFO:teuthology.orchestra.run.smithi063.stdout:checking for inttypes.h... yes 2024-03-26T06:20:34.132 INFO:teuthology.orchestra.run.smithi063.stdout:checking for stdint.h... yes 2024-03-26T06:20:34.221 INFO:teuthology.orchestra.run.smithi063.stdout:checking for unistd.h... yes 2024-03-26T06:20:34.289 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dlfcn.h... yes 2024-03-26T06:20:34.304 INFO:teuthology.orchestra.run.smithi063.stdout:checking for objdir... .libs 2024-03-26T06:20:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-03-26T06:20:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-03-26T06:20:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-03-26T06:20:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc static flag -static works... no 2024-03-26T06:20:34.696 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc supports -c -o file.o... yes 2024-03-26T06:20:34.697 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-03-26T06:20:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-03-26T06:20:34.793 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether -lc should be explicitly linked in... no 2024-03-26T06:20:34.933 INFO:teuthology.orchestra.run.smithi063.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-03-26T06:20:34.933 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to hardcode library paths into programs... immediate 2024-03-26T06:20:34.937 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether stripping libraries is possible... yes 2024-03-26T06:20:34.937 INFO:teuthology.orchestra.run.smithi063.stdout:checking if libtool supports shared libraries... yes 2024-03-26T06:20:34.937 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether to build shared libraries... yes 2024-03-26T06:20:34.937 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether to build static libraries... yes 2024-03-26T06:20:34.958 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc... (cached) gcc 2024-03-26T06:20:35.012 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-26T06:20:35.012 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-26T06:20:35.012 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-26T06:20:35.013 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gmake... /usr/bin/gmake 2024-03-26T06:20:35.013 INFO:teuthology.orchestra.run.smithi063.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-03-26T06:20:35.014 INFO:teuthology.orchestra.run.smithi063.stdout:checking for tar... /bin/tar 2024-03-26T06:20:35.014 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gzip... /bin/gzip 2024-03-26T06:20:35.041 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether gcc -MM is supported... yes 2024-03-26T06:20:35.041 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sort... /bin/sort 2024-03-26T06:20:35.041 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether ln -s works... yes 2024-03-26T06:20:35.042 INFO:teuthology.orchestra.run.smithi063.stdout:checking for rpm... /bin/rpm 2024-03-26T06:20:35.053 INFO:teuthology.orchestra.run.smithi063.stdout:checking for rpmbuild... no 2024-03-26T06:20:35.125 INFO:teuthology.orchestra.run.smithi063.stdout:checking assert.h usability... yes 2024-03-26T06:20:35.152 INFO:teuthology.orchestra.run.smithi063.stdout:checking assert.h presence... yes 2024-03-26T06:20:35.153 INFO:teuthology.orchestra.run.smithi063.stdout:checking for assert.h... yes 2024-03-26T06:20:35.230 INFO:teuthology.orchestra.run.smithi063.stdout:checking bstring.h usability... no 2024-03-26T06:20:35.275 INFO:teuthology.orchestra.run.smithi063.stdout:checking bstring.h presence... no 2024-03-26T06:20:35.276 INFO:teuthology.orchestra.run.smithi063.stdout:checking for bstring.h... no 2024-03-26T06:20:35.356 INFO:teuthology.orchestra.run.smithi063.stdout:checking libgen.h usability... yes 2024-03-26T06:20:35.383 INFO:teuthology.orchestra.run.smithi063.stdout:checking libgen.h presence... yes 2024-03-26T06:20:35.383 INFO:teuthology.orchestra.run.smithi063.stdout:checking for libgen.h... yes 2024-03-26T06:20:35.472 INFO:teuthology.orchestra.run.smithi063.stdout:checking dirent.h usability... yes 2024-03-26T06:20:35.506 INFO:teuthology.orchestra.run.smithi063.stdout:checking dirent.h presence... yes 2024-03-26T06:20:35.506 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dirent.h... yes 2024-03-26T06:20:35.608 INFO:teuthology.orchestra.run.smithi063.stdout:checking errno.h usability... yes 2024-03-26T06:20:35.638 INFO:teuthology.orchestra.run.smithi063.stdout:checking errno.h presence... yes 2024-03-26T06:20:35.638 INFO:teuthology.orchestra.run.smithi063.stdout:checking for errno.h... yes 2024-03-26T06:20:35.734 INFO:teuthology.orchestra.run.smithi063.stdout:checking malloc.h usability... yes 2024-03-26T06:20:35.767 INFO:teuthology.orchestra.run.smithi063.stdout:checking malloc.h presence... yes 2024-03-26T06:20:35.767 INFO:teuthology.orchestra.run.smithi063.stdout:checking for malloc.h... yes 2024-03-26T06:20:35.852 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid.h usability... no 2024-03-26T06:20:35.895 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid.h presence... no 2024-03-26T06:20:35.895 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid.h... no 2024-03-26T06:20:35.987 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid/uuid.h usability... yes 2024-03-26T06:20:36.021 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid/uuid.h presence... yes 2024-03-26T06:20:36.022 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid/uuid.h... yes 2024-03-26T06:20:36.107 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/uuid.h usability... no 2024-03-26T06:20:36.152 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/uuid.h presence... no 2024-03-26T06:20:36.152 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/uuid.h... no 2024-03-26T06:20:36.231 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/file.h usability... yes 2024-03-26T06:20:36.262 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/file.h presence... yes 2024-03-26T06:20:36.262 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/file.h... yes 2024-03-26T06:20:36.350 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fcntl.h usability... yes 2024-03-26T06:20:36.380 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fcntl.h presence... yes 2024-03-26T06:20:36.380 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/fcntl.h... yes 2024-03-26T06:20:36.466 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/syssgi.h usability... no 2024-03-26T06:20:36.510 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/syssgi.h presence... no 2024-03-26T06:20:36.510 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/syssgi.h... no 2024-03-26T06:20:36.601 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/param.h usability... yes 2024-03-26T06:20:36.638 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/param.h presence... yes 2024-03-26T06:20:36.639 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/param.h... yes 2024-03-26T06:20:36.659 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/stat.h... (cached) yes 2024-03-26T06:20:36.740 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/statvfs.h usability... yes 2024-03-26T06:20:36.771 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/statvfs.h presence... yes 2024-03-26T06:20:36.771 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/statvfs.h... yes 2024-03-26T06:20:36.855 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/time.h usability... yes 2024-03-26T06:20:36.885 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/time.h presence... yes 2024-03-26T06:20:36.885 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/time.h... yes 2024-03-26T06:20:36.981 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/ioctl.h usability... yes 2024-03-26T06:20:37.010 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/ioctl.h presence... yes 2024-03-26T06:20:37.010 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/ioctl.h... yes 2024-03-26T06:20:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/wait.h usability... yes 2024-03-26T06:20:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/wait.h presence... yes 2024-03-26T06:20:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/wait.h... yes 2024-03-26T06:20:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/types.h... (cached) yes 2024-03-26T06:20:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:checking for strings.h... (cached) yes 2024-03-26T06:20:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:checking err.h usability... yes 2024-03-26T06:20:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:checking err.h presence... yes 2024-03-26T06:20:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:checking for err.h... yes 2024-03-26T06:20:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/falloc.h usability... yes 2024-03-26T06:20:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/falloc.h presence... yes 2024-03-26T06:20:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/falloc.h... yes 2024-03-26T06:20:37.460 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-03-26T06:20:37.504 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-03-26T06:20:37.504 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/fs/xfs_fsops.h... no 2024-03-26T06:20:37.581 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_itable.h usability... no 2024-03-26T06:20:37.622 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_itable.h presence... no 2024-03-26T06:20:37.622 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/fs/xfs_itable.h... no 2024-03-26T06:20:37.699 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/platform_defs.h usability... no 2024-03-26T06:20:37.742 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/platform_defs.h presence... no 2024-03-26T06:20:37.742 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/platform_defs.h... no 2024-03-26T06:20:37.814 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfs/ioctl.h usability... no 2024-03-26T06:20:37.853 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfs/ioctl.h presence... no 2024-03-26T06:20:37.854 INFO:teuthology.orchestra.run.smithi063.stdout:checking for btrfs/ioctl.h... no 2024-03-26T06:20:37.928 INFO:teuthology.orchestra.run.smithi063.stdout:checking cifs/ioctl.h usability... no 2024-03-26T06:20:37.970 INFO:teuthology.orchestra.run.smithi063.stdout:checking cifs/ioctl.h presence... no 2024-03-26T06:20:37.970 INFO:teuthology.orchestra.run.smithi063.stdout:checking for cifs/ioctl.h... no 2024-03-26T06:20:38.043 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/mman.h usability... yes 2024-03-26T06:20:38.072 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/mman.h presence... yes 2024-03-26T06:20:38.072 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/mman.h... yes 2024-03-26T06:20:38.127 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/xfs_log_format.h... no 2024-03-26T06:20:38.227 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid_compare... no 2024-03-26T06:20:38.314 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid_compare in -luuid... yes 2024-03-26T06:20:38.456 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/xfs.h... yes 2024-03-26T06:20:38.506 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/libxfs.h... no 2024-03-26T06:20:38.568 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether xlog_assign_lsn is declared... no 2024-03-26T06:20:38.646 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/xqm.h... yes 2024-03-26T06:20:38.765 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfsctl from xfs/xfs.h... ok 2024-03-26T06:20:38.832 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/handle.h usability... yes 2024-03-26T06:20:38.860 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/handle.h presence... yes 2024-03-26T06:20:38.860 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/handle.h... yes 2024-03-26T06:20:38.952 INFO:teuthology.orchestra.run.smithi063.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-03-26T06:20:39.019 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/acl.h usability... yes 2024-03-26T06:20:39.050 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/acl.h presence... yes 2024-03-26T06:20:39.050 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/acl.h... yes 2024-03-26T06:20:39.120 INFO:teuthology.orchestra.run.smithi063.stdout:checking acl/libacl.h usability... yes 2024-03-26T06:20:39.152 INFO:teuthology.orchestra.run.smithi063.stdout:checking acl/libacl.h presence... yes 2024-03-26T06:20:39.152 INFO:teuthology.orchestra.run.smithi063.stdout:checking for acl/libacl.h... yes 2024-03-26T06:20:39.246 INFO:teuthology.orchestra.run.smithi063.stdout:checking for acl_init in -lacl... yes 2024-03-26T06:20:39.310 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm-ndbm.h usability... no 2024-03-26T06:20:39.349 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm-ndbm.h presence... no 2024-03-26T06:20:39.349 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gdbm-ndbm.h... no 2024-03-26T06:20:39.414 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm/ndbm.h usability... yes 2024-03-26T06:20:39.447 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm/ndbm.h presence... yes 2024-03-26T06:20:39.447 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gdbm/ndbm.h... yes 2024-03-26T06:20:39.544 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_open in -lgdbm... no 2024-03-26T06:20:39.646 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_fetch in -lgdbm... no 2024-03-26T06:20:39.745 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_store in -lgdbm... no 2024-03-26T06:20:39.848 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_close in -lgdbm... no 2024-03-26T06:20:39.958 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-03-26T06:20:40.046 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-03-26T06:20:40.129 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-03-26T06:20:40.220 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-03-26T06:20:40.287 INFO:teuthology.orchestra.run.smithi063.stdout:checking libaio.h usability... yes 2024-03-26T06:20:40.321 INFO:teuthology.orchestra.run.smithi063.stdout:checking libaio.h presence... yes 2024-03-26T06:20:40.321 INFO:teuthology.orchestra.run.smithi063.stdout:checking for libaio.h... yes 2024-03-26T06:20:40.389 INFO:teuthology.orchestra.run.smithi063.stdout:checking liburing.h usability... no 2024-03-26T06:20:40.432 INFO:teuthology.orchestra.run.smithi063.stdout:checking liburing.h presence... no 2024-03-26T06:20:40.432 INFO:teuthology.orchestra.run.smithi063.stdout:checking for liburing.h... no 2024-03-26T06:20:40.501 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/capability.h usability... yes 2024-03-26T06:20:40.536 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/capability.h presence... yes 2024-03-26T06:20:40.536 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/capability.h... yes 2024-03-26T06:20:40.607 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fiemap.h usability... yes 2024-03-26T06:20:40.637 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fiemap.h presence... yes 2024-03-26T06:20:40.637 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/fiemap.h... yes 2024-03-26T06:20:40.732 INFO:teuthology.orchestra.run.smithi063.stdout:checking for fallocate... yes 2024-03-26T06:20:40.823 INFO:teuthology.orchestra.run.smithi063.stdout:checking for open_by_handle_at... yes 2024-03-26T06:20:40.893 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fs.h usability... yes 2024-03-26T06:20:40.921 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fs.h presence... yes 2024-03-26T06:20:40.921 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/fs.h... yes 2024-03-26T06:20:40.985 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfsutil.h usability... no 2024-03-26T06:20:41.025 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfsutil.h presence... no 2024-03-26T06:20:41.025 INFO:teuthology.orchestra.run.smithi063.stdout:checking for btrfsutil.h... no 2024-03-26T06:20:41.128 INFO:teuthology.orchestra.run.smithi063.stdout:checking for copy_file_range... yes 2024-03-26T06:20:41.222 INFO:teuthology.orchestra.run.smithi063.stdout:checking for SEEK_DATA... yes 2024-03-26T06:20:41.345 INFO:teuthology.orchestra.run.smithi063.stdout:checking for BMV_OF_SHARED... yes 2024-03-26T06:20:41.441 INFO:teuthology.orchestra.run.smithi063.stdout:checking for nftw... yes 2024-03-26T06:20:41.540 INFO:teuthology.orchestra.run.smithi063.stdout:checking for RLIMIT_NOFILE... yes 2024-03-26T06:20:41.625 INFO:teuthology.orchestra.run.smithi063.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-03-26T06:20:41.718 INFO:teuthology.orchestra.run.smithi063.stdout:checking for FICLONE... yes 2024-03-26T06:20:41.808 INFO:teuthology.orchestra.run.smithi063.stdout:checking for renameat2... yes 2024-03-26T06:20:41.900 INFO:teuthology.orchestra.run.smithi063.stdout:checking for reallocarray... yes 2024-03-26T06:20:42.004 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct mount_attr... yes 2024-03-26T06:20:42.115 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_qgroup_limit... yes 2024-03-26T06:20:42.226 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-03-26T06:20:42.340 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-03-26T06:20:42.446 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-03-26T06:20:42.544 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-03-26T06:20:42.652 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-03-26T06:20:42.765 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-03-26T06:20:42.845 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs.h usability... yes 2024-03-26T06:20:42.874 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs.h presence... yes 2024-03-26T06:20:42.874 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/btrfs.h... yes 2024-03-26T06:20:42.970 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs_tree.h usability... yes 2024-03-26T06:20:42.997 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs_tree.h presence... yes 2024-03-26T06:20:42.998 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/btrfs_tree.h... yes 2024-03-26T06:20:43.064 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-03-26T06:20:43.134 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-03-26T06:20:43.172 INFO:teuthology.orchestra.run.smithi063.stdout:configure: creating ./config.status 2024-03-26T06:20:44.434 INFO:teuthology.orchestra.run.smithi063.stdout:config.status: creating include/builddefs 2024-03-26T06:20:44.477 INFO:teuthology.orchestra.run.smithi063.stdout:config.status: creating include/config.h 2024-03-26T06:20:44.510 INFO:teuthology.orchestra.run.smithi063.stdout:config.status: executing libtool commands 2024-03-26T06:20:44.608 INFO:teuthology.orchestra.run.smithi063.stdout:Building include 2024-03-26T06:20:44.616 INFO:teuthology.orchestra.run.smithi063.stdout:Building lib 2024-03-26T06:20:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: [LTDEP] 2024-03-26T06:20:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dataascii.lo 2024-03-26T06:20:45.257 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] databin.lo 2024-03-26T06:20:45.569 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] datapid.lo 2024-03-26T06:20:45.834 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] file_lock.lo 2024-03-26T06:20:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] forker.lo 2024-03-26T06:20:46.450 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] pattern.lo 2024-03-26T06:20:46.710 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] open_flags.lo 2024-03-26T06:20:47.023 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] random_range.lo 2024-03-26T06:20:47.424 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] string_to_tokens.lo 2024-03-26T06:20:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] str_to_bytes.lo 2024-03-26T06:20:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] tlibio.lo 2024-03-26T06:20:48.405 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] write_log.lo 2024-03-26T06:20:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] random.lo 2024-03-26T06:20:48.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:20:48.852 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:20:49.040 INFO:teuthology.orchestra.run.smithi063.stdout: [LD] 2024-03-26T06:20:49.265 INFO:teuthology.orchestra.run.smithi063.stdout:Building ltp 2024-03-26T06:20:49.274 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-03-26T06:20:49.575 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] doio 2024-03-26T06:20:50.485 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsstress 2024-03-26T06:20:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsx 2024-03-26T06:20:53.125 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] growfiles 2024-03-26T06:20:53.832 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] iogen 2024-03-26T06:20:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-stress 2024-03-26T06:20:55.071 INFO:teuthology.orchestra.run.smithi063.stdout:Building src 2024-03-26T06:20:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-03-26T06:20:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-03-26T06:20:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-03-26T06:20:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-03-26T06:20:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-03-26T06:20:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dirstress 2024-03-26T06:21:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fill 2024-03-26T06:21:00.732 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fill2 2024-03-26T06:21:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] getpagesize 2024-03-26T06:21:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] holes 2024-03-26T06:21:01.859 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] lstat64 2024-03-26T06:21:02.235 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] nametest 2024-03-26T06:21:02.713 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] permname 2024-03-26T06:21:03.127 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] randholes 2024-03-26T06:21:03.557 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] runas 2024-03-26T06:21:03.954 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] truncfile 2024-03-26T06:21:04.344 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] usemem 2024-03-26T06:21:04.678 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mmapcat 2024-03-26T06:21:05.032 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] append_reader 2024-03-26T06:21:05.380 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] append_writer 2024-03-26T06:21:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dirperf 2024-03-26T06:21:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] metaperf 2024-03-26T06:21:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] devzero 2024-03-26T06:21:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] feature 2024-03-26T06:21:07.424 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] alloc 2024-03-26T06:21:07.851 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fault 2024-03-26T06:21:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fstest 2024-03-26T06:21:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_access_root 2024-03-26T06:21:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] godown 2024-03-26T06:21:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] resvtest 2024-03-26T06:21:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] writemod 2024-03-26T06:21:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] writev_on_pagefault 2024-03-26T06:21:10.407 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] makeextents 2024-03-26T06:21:10.815 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] itrash 2024-03-26T06:21:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] rename 2024-03-26T06:21:11.459 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] multi_open_unlink 2024-03-26T06:21:11.824 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] unwritten_sync 2024-03-26T06:21:12.206 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] genhashnames 2024-03-26T06:21:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_holes 2024-03-26T06:21:12.904 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_writev 2024-03-26T06:21:13.241 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_truncate_cmtime 2024-03-26T06:21:13.606 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dirhash_collide 2024-03-26T06:21:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_rename_overwrite 2024-03-26T06:21:14.324 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] holetest 2024-03-26T06:21:14.751 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_truncate_self 2024-03-26T06:21:15.098 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] af_unix 2024-03-26T06:21:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_stale_pmd 2024-03-26T06:21:15.799 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_cow_race 2024-03-26T06:21:16.184 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_fallocate 2024-03-26T06:21:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsync-err 2024-03-26T06:21:16.961 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_write_ro 2024-03-26T06:21:17.307 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_ext4_dax_journal_corruption 2024-03-26T06:21:17.674 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_ext4_dax_inline_corruption 2024-03-26T06:21:18.013 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_ofd_locks 2024-03-26T06:21:18.422 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_collision 2024-03-26T06:21:18.845 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mmap-write-concurrent 2024-03-26T06:21:18.984 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:21:18.993 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:21:19.201 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_get_file_time 2024-03-26T06:21:19.507 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_create_short_dirs 2024-03-26T06:21:19.835 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_create_long_dirs 2024-03-26T06:21:20.203 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_enospc 2024-03-26T06:21:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_writev_overlap 2024-03-26T06:21:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] checkpoint_journal 2024-03-26T06:21:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mmap-rw-fault 2024-03-26T06:21:21.682 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] allocstale 2024-03-26T06:21:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_cow_memory_failure 2024-03-26T06:21:22.455 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fake-dump-rootino 2024-03-26T06:21:22.804 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-buf-fault 2024-03-26T06:21:23.134 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] rewinddir-test 2024-03-26T06:21:23.480 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] readdir-while-renames 2024-03-26T06:21:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] xfsctl 2024-03-26T06:21:24.273 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bstat 2024-03-26T06:21:24.688 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mtab 2024-03-26T06:21:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] getdevicesize 2024-03-26T06:21:25.440 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] preallo_rw_pattern_reader 2024-03-26T06:21:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] preallo_rw_pattern_writer 2024-03-26T06:21:26.145 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] ftrunc 2024-03-26T06:21:26.490 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] trunc 2024-03-26T06:21:26.855 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fs_perms 2024-03-26T06:21:27.221 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] testx 2024-03-26T06:21:27.567 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] looptest 2024-03-26T06:21:27.972 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] locktest 2024-03-26T06:21:28.504 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] unwritten_mmap 2024-03-26T06:21:28.832 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bulkstat_unlink_test 2024-03-26T06:21:29.257 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] deduperace 2024-03-26T06:21:29.664 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bulkstat_unlink_test_modified 2024-03-26T06:21:30.087 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_dir_offset 2024-03-26T06:21:30.419 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_futimens 2024-03-26T06:21:30.747 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_immutable 2024-03-26T06:21:31.625 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] stale_handle 2024-03-26T06:21:31.975 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] pwrite_mmap_blocked 2024-03-26T06:21:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_dir_offset2 2024-03-26T06:21:32.716 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] seek_sanity_test 2024-03-26T06:21:33.420 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] seek_copy_test 2024-03-26T06:21:33.782 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_readdir_1 2024-03-26T06:21:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_readdir_2 2024-03-26T06:21:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsync-tester 2024-03-26T06:21:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] nsexec 2024-03-26T06:21:35.278 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] cloner 2024-03-26T06:21:35.670 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] renameat2 2024-03-26T06:21:36.049 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_getcwd 2024-03-26T06:21:36.400 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] e4compact 2024-03-26T06:21:36.789 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] test-nextquota 2024-03-26T06:21:37.136 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] punch-alternating 2024-03-26T06:21:37.507 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] attr-list-by-handle-cursor-test 2024-03-26T06:21:37.884 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] listxattr 2024-03-26T06:21:38.203 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-interleaved 2024-03-26T06:21:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_dir_type 2024-03-26T06:21:38.900 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-invalidate-cache 2024-03-26T06:21:39.321 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] stat_test 2024-03-26T06:21:39.846 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_encrypted_d_revalidate 2024-03-26T06:21:40.202 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] attr_replace_test 2024-03-26T06:21:40.566 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] swapon 2024-03-26T06:21:40.931 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mkswap 2024-03-26T06:21:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_attr_corruption 2024-03-26T06:21:41.609 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_open_tmpfiles 2024-03-26T06:21:41.982 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fscrypt-crypt-util 2024-03-26T06:21:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bulkstat_null_ocount 2024-03-26T06:21:43.289 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] splice-test 2024-03-26T06:21:43.676 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] chprojid_fail 2024-03-26T06:21:44.049 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] detached_mounts_propagation 2024-03-26T06:21:44.419 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] ext4_resize 2024-03-26T06:21:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_readdir_3 2024-03-26T06:21:45.163 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] splice2pipe 2024-03-26T06:21:45.535 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] uuid_ioctl 2024-03-26T06:21:45.861 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_snapshot_deleted_subvolume 2024-03-26T06:21:46.249 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fiemap-tester 2024-03-26T06:21:46.720 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_stripealign 2024-03-26T06:21:47.079 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] open_by_handle 2024-03-26T06:21:47.530 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dbtest 2024-03-26T06:21:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_dio 2024-03-26T06:21:48.320 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] xfsfind 2024-03-26T06:21:48.721 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_reflink_read_race 2024-03-26T06:21:49.123 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fssum 2024-03-26T06:21:49.159 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:21:49.165 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:21:49.776 INFO:teuthology.orchestra.run.smithi063.stdout:Building log-writes 2024-03-26T06:21:49.789 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] replay-log 2024-03-26T06:21:50.306 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-03-26T06:21:50.317 INFO:teuthology.orchestra.run.smithi063.stdout:Building aio-dio-regress 2024-03-26T06:21:50.331 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aiocp 2024-03-26T06:21:50.754 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-append-write-fallocate-race 2024-03-26T06:21:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-append-write-read-race 2024-03-26T06:21:51.503 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-cow-race 2024-03-26T06:21:51.860 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-cycle-write 2024-03-26T06:21:52.216 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-eof-race 2024-03-26T06:21:52.574 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-extend-stat 2024-03-26T06:21:52.949 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-fcntl-race 2024-03-26T06:21:53.316 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-hole-filling-race 2024-03-26T06:21:53.664 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-invalidate-failure 2024-03-26T06:21:54.031 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-invalidate-readahead 2024-03-26T06:21:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aiodio_sparse2 2024-03-26T06:21:54.826 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-subblock-eof-read 2024-03-26T06:21:55.172 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-write-verify 2024-03-26T06:21:55.562 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-03-26T06:21:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-03-26T06:21:56.206 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-last-ref-held-by-io 2024-03-26T06:21:56.547 INFO:teuthology.orchestra.run.smithi063.stdout:Building vfs 2024-03-26T06:21:56.563 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] vfstest 2024-03-26T06:22:00.731 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mount-idmapped 2024-03-26T06:22:01.333 INFO:teuthology.orchestra.run.smithi063.stdout:Building m4 2024-03-26T06:22:01.343 INFO:teuthology.orchestra.run.smithi063.stdout:Building common 2024-03-26T06:22:01.356 INFO:teuthology.orchestra.run.smithi063.stdout:Building tests 2024-03-26T06:22:01.371 INFO:teuthology.orchestra.run.smithi063.stdout:Building btrfs 2024-03-26T06:22:01.385 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/btrfs/group.list 2024-03-26T06:22:01.618 INFO:teuthology.orchestra.run.smithi063.stdout:Building ceph 2024-03-26T06:22:01.633 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ceph/group.list 2024-03-26T06:22:01.691 INFO:teuthology.orchestra.run.smithi063.stdout:Building cifs 2024-03-26T06:22:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/cifs/group.list 2024-03-26T06:22:01.753 INFO:teuthology.orchestra.run.smithi063.stdout:Building ext4 2024-03-26T06:22:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ext4/group.list 2024-03-26T06:22:01.918 INFO:teuthology.orchestra.run.smithi063.stdout:Building f2fs 2024-03-26T06:22:01.933 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/f2fs/group.list 2024-03-26T06:22:02.001 INFO:teuthology.orchestra.run.smithi063.stdout:Building generic 2024-03-26T06:22:02.021 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/generic/group.list 2024-03-26T06:22:02.427 INFO:teuthology.orchestra.run.smithi063.stdout:Building nfs 2024-03-26T06:22:02.443 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/nfs/group.list 2024-03-26T06:22:02.498 INFO:teuthology.orchestra.run.smithi063.stdout:Building ocfs2 2024-03-26T06:22:02.514 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ocfs2/group.list 2024-03-26T06:22:02.566 INFO:teuthology.orchestra.run.smithi063.stdout:Building overlay 2024-03-26T06:22:02.582 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/overlay/group.list 2024-03-26T06:22:02.740 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-03-26T06:22:02.755 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/perf/group.list 2024-03-26T06:22:02.799 INFO:teuthology.orchestra.run.smithi063.stdout:Building selftest 2024-03-26T06:22:02.815 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/selftest/group.list 2024-03-26T06:22:02.863 INFO:teuthology.orchestra.run.smithi063.stdout:Building shared 2024-03-26T06:22:02.879 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/shared/group.list 2024-03-26T06:22:02.942 INFO:teuthology.orchestra.run.smithi063.stdout:Building tmpfs 2024-03-26T06:22:02.955 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/tmpfs/group.list 2024-03-26T06:22:02.999 INFO:teuthology.orchestra.run.smithi063.stdout:Building udf 2024-03-26T06:22:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/udf/group.list 2024-03-26T06:22:03.055 INFO:teuthology.orchestra.run.smithi063.stdout:Building xfs 2024-03-26T06:22:03.073 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/xfs/group.list 2024-03-26T06:22:03.449 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo make install) 2024-03-26T06:22:03.583 INFO:teuthology.orchestra.run.smithi063.stdout:Building include 2024-03-26T06:22:03.594 INFO:teuthology.orchestra.run.smithi063.stdout:Building lib 2024-03-26T06:22:03.606 INFO:teuthology.orchestra.run.smithi063.stdout:Building ltp 2024-03-26T06:22:03.617 INFO:teuthology.orchestra.run.smithi063.stdout:Building src 2024-03-26T06:22:03.710 INFO:teuthology.orchestra.run.smithi063.stdout:Building log-writes 2024-03-26T06:22:03.721 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-03-26T06:22:03.732 INFO:teuthology.orchestra.run.smithi063.stdout:Building aio-dio-regress 2024-03-26T06:22:03.744 INFO:teuthology.orchestra.run.smithi063.stdout:Building vfs 2024-03-26T06:22:03.756 INFO:teuthology.orchestra.run.smithi063.stdout:Building m4 2024-03-26T06:22:03.767 INFO:teuthology.orchestra.run.smithi063.stdout:Building common 2024-03-26T06:22:03.778 INFO:teuthology.orchestra.run.smithi063.stdout:Building tests 2024-03-26T06:22:03.793 INFO:teuthology.orchestra.run.smithi063.stdout:Building btrfs 2024-03-26T06:22:03.809 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/btrfs/group.list 2024-03-26T06:22:04.036 INFO:teuthology.orchestra.run.smithi063.stdout:Building ceph 2024-03-26T06:22:04.051 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ceph/group.list 2024-03-26T06:22:04.106 INFO:teuthology.orchestra.run.smithi063.stdout:Building cifs 2024-03-26T06:22:04.121 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/cifs/group.list 2024-03-26T06:22:04.165 INFO:teuthology.orchestra.run.smithi063.stdout:Building ext4 2024-03-26T06:22:04.180 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ext4/group.list 2024-03-26T06:22:04.330 INFO:teuthology.orchestra.run.smithi063.stdout:Building f2fs 2024-03-26T06:22:04.346 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/f2fs/group.list 2024-03-26T06:22:04.415 INFO:teuthology.orchestra.run.smithi063.stdout:Building generic 2024-03-26T06:22:04.434 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/generic/group.list 2024-03-26T06:22:04.799 INFO:teuthology.orchestra.run.smithi063.stdout:Building nfs 2024-03-26T06:22:04.815 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/nfs/group.list 2024-03-26T06:22:04.871 INFO:teuthology.orchestra.run.smithi063.stdout:Building ocfs2 2024-03-26T06:22:04.886 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ocfs2/group.list 2024-03-26T06:22:04.938 INFO:teuthology.orchestra.run.smithi063.stdout:Building overlay 2024-03-26T06:22:04.953 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/overlay/group.list 2024-03-26T06:22:05.113 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-03-26T06:22:05.129 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/perf/group.list 2024-03-26T06:22:05.173 INFO:teuthology.orchestra.run.smithi063.stdout:Building selftest 2024-03-26T06:22:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/selftest/group.list 2024-03-26T06:22:05.235 INFO:teuthology.orchestra.run.smithi063.stdout:Building shared 2024-03-26T06:22:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/shared/group.list 2024-03-26T06:22:05.316 INFO:teuthology.orchestra.run.smithi063.stdout:Building tmpfs 2024-03-26T06:22:05.331 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/tmpfs/group.list 2024-03-26T06:22:05.384 INFO:teuthology.orchestra.run.smithi063.stdout:Building udf 2024-03-26T06:22:05.399 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/udf/group.list 2024-03-26T06:22:05.442 INFO:teuthology.orchestra.run.smithi063.stdout:Building xfs 2024-03-26T06:22:05.461 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/xfs/group.list 2024-03-26T06:22:05.817 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-03-26T06:22:05.820 INFO:teuthology.orchestra.run.smithi063.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-26T06:22:05.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-03-26T06:22:05.828 INFO:teuthology.orchestra.run.smithi063.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-26T06:22:05.828 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-03-26T06:22:05.833 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-03-26T06:22:05.866 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-03-26T06:22:06.118 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-03-26T06:22:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-03-26T06:22:06.201 INFO:teuthology.orchestra.run.smithi063.stdout:Building log-writes 2024-03-26T06:22:06.213 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-03-26T06:22:06.224 INFO:teuthology.orchestra.run.smithi063.stdout:Building aio-dio-regress 2024-03-26T06:22:06.237 INFO:teuthology.orchestra.run.smithi063.stdout:Building vfs 2024-03-26T06:22:06.245 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C log-writes install 2024-03-26T06:22:06.249 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-03-26T06:22:06.284 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-03-26T06:22:06.319 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C perf install 2024-03-26T06:22:06.323 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-03-26T06:22:06.357 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-03-26T06:22:06.443 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-03-26T06:22:06.448 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-03-26T06:22:06.483 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-03-26T06:22:06.694 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C vfs install 2024-03-26T06:22:06.698 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-03-26T06:22:06.735 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-03-26T06:22:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-03-26T06:22:06.818 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-03-26T06:22:11.511 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-03-26T06:22:11.860 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-03-26T06:22:11.936 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-03-26T06:22:11.940 INFO:teuthology.orchestra.run.smithi063.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-26T06:22:11.940 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-03-26T06:22:11.943 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-03-26T06:22:11.977 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-03-26T06:22:12.555 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-03-26T06:22:12.559 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/btrfs/ install 2024-03-26T06:22:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/btrfs/group.list 2024-03-26T06:22:12.804 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-03-26T06:22:12.839 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 /var/lib/xfstests/tests/btrfs 2024-03-26T06:22:16.545 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-03-26T06:22:16.582 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out /var/lib/xfstests/tests/btrfs 2024-03-26T06:22:19.323 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:22:19.331 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:22:20.204 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ceph/ install 2024-03-26T06:22:20.211 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ceph/group.list 2024-03-26T06:22:20.268 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-03-26T06:22:20.301 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-03-26T06:22:20.377 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-03-26T06:22:20.411 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-03-26T06:22:20.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/cifs/ install 2024-03-26T06:22:20.495 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/cifs/group.list 2024-03-26T06:22:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-03-26T06:22:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-03-26T06:22:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-03-26T06:22:20.648 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-03-26T06:22:20.682 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ext4/ install 2024-03-26T06:22:20.689 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ext4/group.list 2024-03-26T06:22:20.839 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-03-26T06:22:20.874 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-03-26T06:22:21.634 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-03-26T06:22:21.669 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-03-26T06:22:22.526 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/f2fs/ install 2024-03-26T06:22:22.534 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/f2fs/group.list 2024-03-26T06:22:22.599 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-03-26T06:22:22.634 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-03-26T06:22:22.678 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-03-26T06:22:22.713 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-03-26T06:22:22.758 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/generic/ install 2024-03-26T06:22:22.767 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/generic/group.list 2024-03-26T06:22:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-03-26T06:22:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-03-26T06:22:31.997 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-03-26T06:22:32.034 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-03-26T06:22:40.782 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/nfs/ install 2024-03-26T06:22:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/nfs/group.list 2024-03-26T06:22:40.846 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-03-26T06:22:40.881 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-03-26T06:22:40.915 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-03-26T06:22:40.949 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-03-26T06:22:40.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ocfs2/ install 2024-03-26T06:22:40.992 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/ocfs2/group.list 2024-03-26T06:22:41.040 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-03-26T06:22:41.076 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-03-26T06:22:41.111 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-03-26T06:22:41.145 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-03-26T06:22:41.181 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/overlay/ install 2024-03-26T06:22:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/overlay/group.list 2024-03-26T06:22:41.349 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-03-26T06:22:41.382 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-03-26T06:22:42.524 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-03-26T06:22:42.559 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-03-26T06:22:43.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/perf/ install 2024-03-26T06:22:43.714 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/perf/group.list 2024-03-26T06:22:43.755 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-03-26T06:22:43.790 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-03-26T06:22:43.824 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-03-26T06:22:43.859 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-03-26T06:22:43.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/selftest/ install 2024-03-26T06:22:43.903 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/selftest/group.list 2024-03-26T06:22:43.949 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-03-26T06:22:43.983 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-03-26T06:22:44.072 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-03-26T06:22:44.108 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-03-26T06:22:44.199 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/shared/ install 2024-03-26T06:22:44.205 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/shared/group.list 2024-03-26T06:22:44.270 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-03-26T06:22:44.305 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-03-26T06:22:44.361 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-03-26T06:22:44.395 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-03-26T06:22:44.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/tmpfs/ install 2024-03-26T06:22:44.459 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/tmpfs/group.list 2024-03-26T06:22:44.508 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-03-26T06:22:44.542 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-03-26T06:22:44.577 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-03-26T06:22:44.611 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-03-26T06:22:44.646 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/udf/ install 2024-03-26T06:22:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/udf/group.list 2024-03-26T06:22:44.694 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-03-26T06:22:44.727 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-03-26T06:22:44.762 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-03-26T06:22:44.796 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-03-26T06:22:44.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/xfs/ install 2024-03-26T06:22:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.W8GLtFOA0Cxfstests-dev/tests/xfs/group.list 2024-03-26T06:22:45.223 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-03-26T06:22:45.254 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-03-26T06:22:49.462 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:22:49.469 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:22:53.326 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-03-26T06:22:53.360 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-03-26T06:23:01.849 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-03-26T06:23:01.885 INFO:teuthology.orchestra.run.smithi063.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-03-26T06:23:01.919 INFO:teuthology.orchestra.run.smithi063.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-03-26T06:23:01.953 INFO:teuthology.orchestra.run.smithi063.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-03-26T06:23:01.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T06:23:01.994 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec ls tests/generic) 2024-03-26T06:23:02.053 INFO:teuthology.orchestra.run.smithi063.stdout:001 2024-03-26T06:23:02.053 INFO:teuthology.orchestra.run.smithi063.stdout:001.out 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:002 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:002.out 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:003 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:003.out 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:004 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:004.out 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:005 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:005.out 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:006 2024-03-26T06:23:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:006.out 2024-03-26T06:23:02.055 INFO:teuthology.orchestra.run.smithi063.stdout:007 2024-03-26T06:23:02.055 INFO:teuthology.orchestra.run.smithi063.stdout:007.out 2024-03-26T06:23:02.055 INFO:teuthology.orchestra.run.smithi063.stdout:008 2024-03-26T06:23:02.055 INFO:teuthology.orchestra.run.smithi063.stdout:008.out 2024-03-26T06:23:02.055 INFO:teuthology.orchestra.run.smithi063.stdout:009 2024-03-26T06:23:02.055 INFO:teuthology.orchestra.run.smithi063.stdout:009.out 2024-03-26T06:23:02.055 INFO:teuthology.orchestra.run.smithi063.stdout:010 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:010.out 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:011 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:011.out 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:012 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:012.out 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:013 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:013.out 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:014 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:014.out 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:015 2024-03-26T06:23:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:015.out 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:016 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:016.out 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:017 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:017.out 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:018 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:018.out 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:019 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:019.out 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:020 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:020.out 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:021 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:021.out 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:022 2024-03-26T06:23:02.057 INFO:teuthology.orchestra.run.smithi063.stdout:022.out 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:023 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:023.out 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:024 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:024.out 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:025 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:025.out 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:026 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:026.out 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:027 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:027.out 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:028 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:028.out 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:029 2024-03-26T06:23:02.058 INFO:teuthology.orchestra.run.smithi063.stdout:029.out 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:030 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:030.out 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:031 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:031.out 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:032 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:032.out 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:033 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:033.out 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:034 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:034.out 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:035 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:035.cfg 2024-03-26T06:23:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:035.out.default 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:035.out.nfs 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:036 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:036.out 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:037 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:037.out 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:038 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:038.out 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:039 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:039.out 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:040 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:040.out 2024-03-26T06:23:02.060 INFO:teuthology.orchestra.run.smithi063.stdout:041 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:041.out 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:042 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:042.out 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:043 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:043.out 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:044 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:044.out 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:045 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:045.out 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:046 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:046.out 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:047 2024-03-26T06:23:02.061 INFO:teuthology.orchestra.run.smithi063.stdout:047.out 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:048 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:048.out 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:049 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:049.out 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:050 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:050.cfg 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:050.out.default 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:050.out.nojournal 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:050.out.xfsquota 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:051 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:051.out 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:052 2024-03-26T06:23:02.062 INFO:teuthology.orchestra.run.smithi063.stdout:052.out 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:053 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:053.out 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:054 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:054.out 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:055 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:055.out 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:056 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:056.out 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:057 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:057.out 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:058 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:058.out 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:059 2024-03-26T06:23:02.063 INFO:teuthology.orchestra.run.smithi063.stdout:059.out 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:060 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:060.out 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:061 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:061.out 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:062 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:062.out 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:063 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:063.out 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:064 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:064.out 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:065 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:065.out 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:066 2024-03-26T06:23:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:066.out 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:067 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:067.out 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:068 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:068.out 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:069 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:069.out 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:070 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:070.out 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:071 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:071.out 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:072 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:072.out 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:073 2024-03-26T06:23:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:073.out 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:074 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:074.out 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:075 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:075.out 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:076 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:076.out 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:077 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:077.out 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:078 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:078.out 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:079 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:079.out 2024-03-26T06:23:02.066 INFO:teuthology.orchestra.run.smithi063.stdout:080 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:080.out 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:081 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:081.out 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:082 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:082.out 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:083 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:083.out 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:084 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:084.out 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:085 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:085.out 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:086 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:086.out 2024-03-26T06:23:02.067 INFO:teuthology.orchestra.run.smithi063.stdout:087 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:087.out 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:088 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:088.out 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:089 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:089.out 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:090 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:090.out 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:091 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:091.out 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:092 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:092.out 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:093 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:093.out 2024-03-26T06:23:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:094 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:094.out 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:095 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:095.out 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:096 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:096.out 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:097 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:097.out 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:098 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:098.out 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:099 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:099.out 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:100 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:100.out 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:101 2024-03-26T06:23:02.069 INFO:teuthology.orchestra.run.smithi063.stdout:101.out 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:102 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:102.out 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:103 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:103.out 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:104 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:104.out 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:105 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:105.out 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:106 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:106.out 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:107 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:107.out 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:108 2024-03-26T06:23:02.070 INFO:teuthology.orchestra.run.smithi063.stdout:108.out 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:109 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:109.out 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:110 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:110.out 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:111 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:111.out 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:112 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:112.out 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:113 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:113.out 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:114 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:114.out 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:115 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:115.out 2024-03-26T06:23:02.071 INFO:teuthology.orchestra.run.smithi063.stdout:116 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:116.out 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:117 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:117.out 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:118 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:118.out 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:119 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:119.out 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:120 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:120.out 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:121 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:121.out 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:122 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:122.out 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:123 2024-03-26T06:23:02.072 INFO:teuthology.orchestra.run.smithi063.stdout:123.out 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:124 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:124.out 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:125 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:125.out 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:126 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:126.out 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:127 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:127.out 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:128 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:128.out 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:129 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:129.out 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:130 2024-03-26T06:23:02.073 INFO:teuthology.orchestra.run.smithi063.stdout:130.out 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:131 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:131.out 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:132 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:132.out 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:133 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:133.out 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:134 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:134.out 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:135 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:135.out 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:136 2024-03-26T06:23:02.074 INFO:teuthology.orchestra.run.smithi063.stdout:136.out 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:137 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:137.out 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:138 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:138.out 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:139 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:139.out 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:140 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:140.out 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:141 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:141.out 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:142 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:142.out 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:143 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:143.out 2024-03-26T06:23:02.075 INFO:teuthology.orchestra.run.smithi063.stdout:144 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:144.out 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:145 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:145.out 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:146 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:146.out 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:147 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:147.out 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:148 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:148.out 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:149 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:149.out 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:150 2024-03-26T06:23:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:150.out 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:151 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:151.out 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:152 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:152.out 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:153 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:153.out 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:154 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:154.out 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:155 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:155.out 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:156 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:156.out 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:157 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:157.out 2024-03-26T06:23:02.077 INFO:teuthology.orchestra.run.smithi063.stdout:158 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:158.out 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:159 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:159.out 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:160 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:160.out 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:161 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:161.out 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:162 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:162.out 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:163 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:163.out 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:164 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:164.out 2024-03-26T06:23:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:165 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:165.out 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:166 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:166.out 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:167 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:167.out 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:168 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:168.out 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:169 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:169.out 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:170 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:170.out 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:171 2024-03-26T06:23:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:171.out 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:172 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:172.out 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:173 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:173.out 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:174 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:174.out 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:175 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:175.out 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:176 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:176.out 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:177 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:177.out 2024-03-26T06:23:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:178 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:178.out 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:179 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:179.out 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:180 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:180.out 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:181 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:181.out 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:182 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:182.out 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:183 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:183.out 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:184 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:184.out 2024-03-26T06:23:02.081 INFO:teuthology.orchestra.run.smithi063.stdout:185 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:185.out 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:186 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:186.out 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:187 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:187.out 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:188 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:188.out 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:189 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:189.out 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:190 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:190.out 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:191 2024-03-26T06:23:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:191.out 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:192 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:192.out 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:193 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:193.out 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:194 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:194.out 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:195 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:195.out 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:196 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:196.out 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:197 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:197.out 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:198 2024-03-26T06:23:02.083 INFO:teuthology.orchestra.run.smithi063.stdout:198.out 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:199 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:199.out 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:200 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:200.out 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:201 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:201.out 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:202 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:202.out 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:203 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:203.out 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:204 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:204.out 2024-03-26T06:23:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:205 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:205.out 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:206 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:206.out 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:207 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:207.out 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:208 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:208.out 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:209 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:209.out 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:210 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:210.out 2024-03-26T06:23:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:211 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:211.out 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:212 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:212.out 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:213 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:213.out 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:214 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:214.out 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:215 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:215.out 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:216 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:216.out 2024-03-26T06:23:02.086 INFO:teuthology.orchestra.run.smithi063.stdout:217 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:217.out 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:218 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:218.out 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:219 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:219.out 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:220 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:220.out 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:221 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:221.out 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:222 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:222.out 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:223 2024-03-26T06:23:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:223.out 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:224 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:224.out 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:225 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:225.out 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:226 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:226.out 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:227 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:227.out 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:228 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:228.out 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:229 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:229.out 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:230 2024-03-26T06:23:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:230.out 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:231 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:231.out 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:232 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:232.out 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:233 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:233.out 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:234 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:234.out 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:235 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:235.out 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:236 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:236.out 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:237 2024-03-26T06:23:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:237.out 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:238 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:238.out 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:239 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:239.out 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:240 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:240.out 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:241 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:241.out 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:242 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:242.out 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:243 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:243.out 2024-03-26T06:23:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:244 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:244.out 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:245 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:245.out 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:246 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:246.out 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:247 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:247.out 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:248 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:248.out 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:249 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:249.out 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:250 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:250.out 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:251 2024-03-26T06:23:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:251.out 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:252 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:252.out 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:253 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:253.out 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:254 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:254.out 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:255 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:255.out 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:256 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:256.out 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:257 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:257.out 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:258 2024-03-26T06:23:02.092 INFO:teuthology.orchestra.run.smithi063.stdout:258.out 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:259 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:259.out 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:260 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:260.out 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:261 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:261.out 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:262 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:262.out 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:263 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:263.out 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:264 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:264.out 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:265 2024-03-26T06:23:02.093 INFO:teuthology.orchestra.run.smithi063.stdout:265.out 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:266 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:266.out 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:267 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:267.out 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:268 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:268.out 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:269 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:269.out 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:270 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:270.out 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:271 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:271.out 2024-03-26T06:23:02.094 INFO:teuthology.orchestra.run.smithi063.stdout:272 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:272.out 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:273 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:273.out 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:274 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:274.out 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:275 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:275.out 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:276 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:276.out 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:277 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:277.out 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:278 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:278.out 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:279 2024-03-26T06:23:02.095 INFO:teuthology.orchestra.run.smithi063.stdout:279.out 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:280 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:280.out 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:281 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:281.out 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:282 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:282.out 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:283 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:283.out 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:284 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:284.out 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:285 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:285.out 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:286 2024-03-26T06:23:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:286.out 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:287 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:287.out 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:288 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:288.out 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:289 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:289.out 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:290 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:290.out 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:291 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:291.out 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:292 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:292.out 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:293 2024-03-26T06:23:02.097 INFO:teuthology.orchestra.run.smithi063.stdout:293.out 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:294 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:294.out 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:295 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:295.out 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:296 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:296.out 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:297 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:297.out 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:298 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:298.out 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:299 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:299.out 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:300 2024-03-26T06:23:02.098 INFO:teuthology.orchestra.run.smithi063.stdout:300.out 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:301 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:301.out 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:302 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:302.out 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:303 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:303.out 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:304 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:304.out 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:305 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:305.out 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:306 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:306.out 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:307 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:307.out 2024-03-26T06:23:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:308 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:308.out 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:309 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:309.out 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:310 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:310.out 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:311 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:311.out 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:312 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:312.out 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:313 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:313.out 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:314 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:314.out 2024-03-26T06:23:02.100 INFO:teuthology.orchestra.run.smithi063.stdout:315 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:315.out 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:316 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:316.out 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:317 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:317.out 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:318 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:318.out 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:319 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:319.out 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:320 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:320.out 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:321 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:321.out 2024-03-26T06:23:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:322 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:322.out 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:323 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:323.out 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:324 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:324.out 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:325 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:325.out 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:326 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:326.out 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:327 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:327.out 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:328 2024-03-26T06:23:02.102 INFO:teuthology.orchestra.run.smithi063.stdout:328.out 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:329 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:329.out 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:330 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:330.out 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:331 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:331.out 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:332 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:332.out 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:333 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:333.out 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:334 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:334.out 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:335 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:335.out 2024-03-26T06:23:02.103 INFO:teuthology.orchestra.run.smithi063.stdout:336 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:336.out 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:337 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:337.out 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:338 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:338.out 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:339 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:339.out 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:340 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:340.out 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:341 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:341.out 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:342 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:342.out 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:343 2024-03-26T06:23:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:343.out 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:344 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:344.out 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:345 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:345.out 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:346 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:346.out 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:347 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:347.out 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:348 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:348.out 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:349 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:349.out 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:350 2024-03-26T06:23:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:350.out 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:351 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:351.out 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:352 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:352.out 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:353 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:353.out 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:354 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:354.out 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:355 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:355.out 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:356 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:356.out 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:357 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:357.out 2024-03-26T06:23:02.106 INFO:teuthology.orchestra.run.smithi063.stdout:358 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:358.out 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:359 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:359.out 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:360 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:360.out 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:361 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:361.out 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:362 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:362.out 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:363 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:363.out 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:364 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:364.out 2024-03-26T06:23:02.107 INFO:teuthology.orchestra.run.smithi063.stdout:365 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:365.out 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:366 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:366.out 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:367 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:367.out 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:368 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:368.out 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:369 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:369.out 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:370 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:370.out 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:371 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:371.out 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:372 2024-03-26T06:23:02.108 INFO:teuthology.orchestra.run.smithi063.stdout:372.out 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:373 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:373.out 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:374 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:374.out 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:375 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:375.out 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:376 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:376.out 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:377 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:377.out 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:378 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:378.out 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:379 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:379.out 2024-03-26T06:23:02.109 INFO:teuthology.orchestra.run.smithi063.stdout:380 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:380.out 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:381 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:381.out 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:382 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:382.out 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:383 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:383.out 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:384 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:384.out 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:385 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:385.out 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:386 2024-03-26T06:23:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:386.out 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:387 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:387.out 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:388 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:388.out 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:389 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:389.out 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:390 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:390.out 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:391 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:391.out 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:392 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:392.out 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:393 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:393.out 2024-03-26T06:23:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:394 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:394.out 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:395 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:395.out 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:396 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:396.out 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:397 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:397.out 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:398 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:398.out 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:399 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:399.out 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:400 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:400.out 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:401 2024-03-26T06:23:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:401.out 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:402 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:402.out 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:403 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:403.out 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:404 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:404.out 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:405 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:405.out 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:406 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:406.out 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:407 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:407.out 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:408 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:408.out 2024-03-26T06:23:02.113 INFO:teuthology.orchestra.run.smithi063.stdout:409 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:409.out 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:410 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:410.out 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:411 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:411.out 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:412 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:412.out 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:413 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:413.out 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:414 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:414.out 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:415 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:415.out 2024-03-26T06:23:02.114 INFO:teuthology.orchestra.run.smithi063.stdout:416 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:416.out 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:417 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:417.out 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:418 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:418.out 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:419 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:419.out 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:420 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:420.out 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:421 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:421.out 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:422 2024-03-26T06:23:02.115 INFO:teuthology.orchestra.run.smithi063.stdout:422.out 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:423 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:423.out 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:424 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:424.out 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:425 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:425.out 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:426 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:426.out 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:427 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:427.out 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:428 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:428.out 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:429 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:429.out 2024-03-26T06:23:02.116 INFO:teuthology.orchestra.run.smithi063.stdout:430 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:430.out 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:431 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:431.out 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:432 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:432.out 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:433 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:433.out 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:434 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:434.out 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:435 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:435.out 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:436 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:436.out 2024-03-26T06:23:02.117 INFO:teuthology.orchestra.run.smithi063.stdout:437 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:437.out 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:438 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:438.out 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:439 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:439.out 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:440 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:440.out 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:441 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:441.out 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:442 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:442.out 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:443 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:443.out 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:444 2024-03-26T06:23:02.118 INFO:teuthology.orchestra.run.smithi063.stdout:444.out 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:445 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:445.out 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:446 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:446.out 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:447 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:447.out 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:448 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:448.out 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:449 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:449.out 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:450 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:450.out 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:451 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:451.out 2024-03-26T06:23:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:452 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:452.out 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:453 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:453.out 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:454 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:454.out 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:455 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:455.out 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:456 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:456.out 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:457 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:457.out 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:458 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:458.out 2024-03-26T06:23:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:459 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:459.out 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:460 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:460.out 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:461 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:461.out 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:462 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:462.out 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:463 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:463.out 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:464 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:464.out 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:465 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:465.out 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:466 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:466.out 2024-03-26T06:23:02.121 INFO:teuthology.orchestra.run.smithi063.stdout:467 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:467.out 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:468 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:468.out 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:469 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:469.out 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:470 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:470.out 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:471 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:471.out 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:472 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:472.out 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:473 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:473.out 2024-03-26T06:23:02.122 INFO:teuthology.orchestra.run.smithi063.stdout:474 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:474.out 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:475 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:475.out 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:476 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:476.out 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:477 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:477.out 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:478 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:478.out 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:479 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:479.out 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:480 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:480.out 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:481 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:481.out 2024-03-26T06:23:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:482 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:482.out 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:483 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:483.out 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:484 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:484.out 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:485 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:485.out 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:486 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:486.out 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:487 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:487.out 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:488 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:488.out 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:489 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:489.out 2024-03-26T06:23:02.124 INFO:teuthology.orchestra.run.smithi063.stdout:490 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:490.out 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:491 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:491.out 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:492 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:492.out 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:493 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:493.out 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:494 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:494.out 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:495 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:495.out 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:496 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:496.out 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:497 2024-03-26T06:23:02.125 INFO:teuthology.orchestra.run.smithi063.stdout:497.out 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:498 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:498.out 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:499 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:499.out 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:500 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:500.out 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:501 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:501.out 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:502 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:502.out 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:503 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:503.out 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:504 2024-03-26T06:23:02.126 INFO:teuthology.orchestra.run.smithi063.stdout:504.out 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:505 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:505.out 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:506 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:506.out 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:507 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:507.out 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:508 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:508.out 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:509 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:509.out 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:510 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:510.out 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:511 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:511.out 2024-03-26T06:23:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:512 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:512.out 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:513 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:513.out 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:514 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:514.out 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:515 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:515.out 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:516 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:516.out 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:517 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:517.out 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:518 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:518.out 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:519 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:519.out 2024-03-26T06:23:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:520 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:520.out 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:521 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:521.out 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:522 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:522.out 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:523 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:523.out 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:524 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:524.out 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:525 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:525.out 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:526 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:526.out 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:527 2024-03-26T06:23:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:527.out 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:528 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:528.out 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:529 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:529.out 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:530 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:530.out 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:531 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:531.out 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:532 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:532.out 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:533 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:533.out 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:534 2024-03-26T06:23:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:534.out 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:535 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:535.out 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:536 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:536.out 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:537 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:537.out 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:538 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:538.out 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:539 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:539.out 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:540 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:540.out 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:541 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:541.out 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:542 2024-03-26T06:23:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:542.out 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:543 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:543.out 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:544 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:544.out 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:545 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:545.out 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:546 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:546.out 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:547 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:547.out 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:548 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:548.out 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:549 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:549.out 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:550 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:550.out 2024-03-26T06:23:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:551 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:551.out 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:552 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:552.out 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:553 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:553.out 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:554 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:554.out 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:555 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:555.out 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:556 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:556.out 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:557 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:557.out 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:558 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:558.out 2024-03-26T06:23:02.133 INFO:teuthology.orchestra.run.smithi063.stdout:559 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:559.out 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:560 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:560.out 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:561 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:561.out 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:562 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:562.out 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:563 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:563.out 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:564 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:564.out 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:565 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:565.out 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:566 2024-03-26T06:23:02.134 INFO:teuthology.orchestra.run.smithi063.stdout:566.out 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:567 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:567.out 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:568 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:568.out 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:569 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:569.out 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:570 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:570.out 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:571 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:571.out 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:572 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:572.out 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:573 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:573.out 2024-03-26T06:23:02.135 INFO:teuthology.orchestra.run.smithi063.stdout:574 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:574.out 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:575 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:575.out 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:576 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:576.out 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:577 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:577.out 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:578 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:578.out 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:579 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:579.out 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:580 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:580.out 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:581 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:581.out 2024-03-26T06:23:02.136 INFO:teuthology.orchestra.run.smithi063.stdout:582 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:582.out 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:583 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:583.out 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:584 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:584.out 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:585 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:585.out 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:586 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:586.out 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:587 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:587.out 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:588 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:588.out 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:589 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:589.out 2024-03-26T06:23:02.137 INFO:teuthology.orchestra.run.smithi063.stdout:590 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:590.out 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:591 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:591.out 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:592 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:592.out 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:593 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:593.out 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:594 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:594.out 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:595 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:595.out 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:596 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:596.out 2024-03-26T06:23:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:597 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:597.out 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:598 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:598.out 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:599 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:599.out 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:600 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:600.out 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:601 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:601.out 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:602 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:602.out 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:603 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:603.out 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:604 2024-03-26T06:23:02.139 INFO:teuthology.orchestra.run.smithi063.stdout:604.out 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:605 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:605.out 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:606 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:606.out 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:607 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:607.out 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:608 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:608.out 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:609 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:609.out 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:610 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:610.out 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:611 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:611.out 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:612 2024-03-26T06:23:02.140 INFO:teuthology.orchestra.run.smithi063.stdout:612.out 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:613 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:613.out 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:614 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:614.out 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:615 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:615.out 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:616 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:616.out 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:617 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:617.out 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:618 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:618.out 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:619 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:619.out 2024-03-26T06:23:02.141 INFO:teuthology.orchestra.run.smithi063.stdout:620 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:620.out 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:621 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:621.out 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:622 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:622.out 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:623 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:623.out 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:624 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:624.out 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:625 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:625.out 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:626 2024-03-26T06:23:02.142 INFO:teuthology.orchestra.run.smithi063.stdout:626.out 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:627 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:627.out 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:628 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:628.out 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:629 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:629.out 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:630 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:630.out 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:631 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:631.out 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:632 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:632.out 2024-03-26T06:23:02.143 INFO:teuthology.orchestra.run.smithi063.stdout:633 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:633.out 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:634 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:634.out 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:635 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:635.out 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:636 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:636.out 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:637 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:637.out 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:638 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:638.out 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:639 2024-03-26T06:23:02.144 INFO:teuthology.orchestra.run.smithi063.stdout:639.out 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:640 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:640.out 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:641 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:641.out 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:642 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:642.out 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:643 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:643.out 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:644 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:644.out 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:645 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:645.out 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:646 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:646.out 2024-03-26T06:23:02.145 INFO:teuthology.orchestra.run.smithi063.stdout:647 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:647.out 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:648 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:648.out 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:649 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:649.out 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:650 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:650.out 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:651 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:651.out 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:652 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:652.out 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:653 2024-03-26T06:23:02.146 INFO:teuthology.orchestra.run.smithi063.stdout:653.out 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:654 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:654.out 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:655 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:655.out 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:656 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:656.out 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:657 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:657.out 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:658 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:658.out 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:659 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:659.out 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:660 2024-03-26T06:23:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:660.out 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:661 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:661.out 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:662 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:662.out 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:663 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:663.out 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:664 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:664.out 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:665 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:665.out 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:666 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:666.out 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:667 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:667.out 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:668 2024-03-26T06:23:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:668.out 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:669 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:669.out 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:670 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:670.out 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:671 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:671.out 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:672 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:672.out 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:673 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:673.out 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:674 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:674.out 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:675 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:675.out 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:676 2024-03-26T06:23:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:676.out 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:677 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:677.out 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:678 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:678.out 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:679 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:679.out 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:680 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:680.out 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:681 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:681.out 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:682 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:682.out 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:683 2024-03-26T06:23:02.150 INFO:teuthology.orchestra.run.smithi063.stdout:683.out 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:684 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:684.out 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:685 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:685.out 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:686 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:686.out 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:687 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:687.out 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:688 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:688.out 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:689 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:689.out 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:690 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:690.out 2024-03-26T06:23:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:691 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:691.out 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:692 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:692.out 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:693 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:693.out 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:694 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:694.out 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:695 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:695.out 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:696 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:696.out 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:697 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:697.out 2024-03-26T06:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:698 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:698.out 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:699 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:699.out 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:700 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:700.out 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:701 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:701.out 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:702 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:702.out 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:703 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:703.out 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:704 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:704.out 2024-03-26T06:23:02.153 INFO:teuthology.orchestra.run.smithi063.stdout:705 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:705.out 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:706 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:706.out 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:707 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:707.out 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:708 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:708.out 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:709 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:709.out 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:710 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:710.out 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:711 2024-03-26T06:23:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:711.out 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:712 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:712.out 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:713 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:713.out 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:714 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:714.out 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:715 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:715.out 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:716 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:716.out 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:717 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:717.out 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:718 2024-03-26T06:23:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:718.out 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:719 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:719.out 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:720 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:720.out 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:721 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:721.out 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:722 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:722.out 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:723 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:723.out 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:724 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:724.out 2024-03-26T06:23:02.156 INFO:teuthology.orchestra.run.smithi063.stdout:725 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:725.out 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:726 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:726.out 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:727 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:727.out 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:728 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:728.out 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:729 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:729.out 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:730 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:730.out 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:731 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:731.out 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:732 2024-03-26T06:23:02.157 INFO:teuthology.orchestra.run.smithi063.stdout:732.out 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:733 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:733.out 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:734 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:734.out 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:735 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:735.out 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:736 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:736.out 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:737 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:737.out 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:738 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:738.out 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:739 2024-03-26T06:23:02.158 INFO:teuthology.orchestra.run.smithi063.stdout:739.out 2024-03-26T06:23:02.159 INFO:teuthology.orchestra.run.smithi063.stdout:group.list 2024-03-26T06:23:02.159 INFO:teuthology.orchestra.run.smithi063.stdout:Makefile 2024-03-26T06:23:02.159 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-03-26T06:23:02.784 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:23:02.800 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:23:02.801 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:23:02.805 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:23:02.805 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:13.934 INFO:teuthology.orchestra.run.smithi063.stdout:generic/001 10s 2024-03-26T06:23:13.950 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/001 2024-03-26T06:23:13.951 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:23:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:14.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:23:14.301 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-03-26T06:23:14.837 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:23:14.858 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:23:14.860 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:23:14.865 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:23:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:16.062 INFO:teuthology.orchestra.run.smithi063.stdout:generic/002 1s 2024-03-26T06:23:16.077 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/002 2024-03-26T06:23:16.077 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:23:16.086 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:16.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:23:16.145 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-03-26T06:23:16.666 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:23:16.679 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:23:16.681 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:23:16.684 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:23:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:17.285 INFO:teuthology.orchestra.run.smithi063.stdout:generic/003 [not run] atime not maintained by ceph 2024-03-26T06:23:17.298 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/003 2024-03-26T06:23:17.298 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/003 2024-03-26T06:23:17.298 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:23:17.307 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:17.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:23:17.349 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-03-26T06:23:17.956 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:23:17.968 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:23:17.970 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:23:17.973 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:23:17.973 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:18.625 INFO:teuthology.orchestra.run.smithi063.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-03-26T06:23:18.640 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/004 2024-03-26T06:23:18.640 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/004 2024-03-26T06:23:18.640 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:23:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:18.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:23:18.689 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-03-26T06:23:19.348 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:23:19.363 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:23:19.365 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:23:19.369 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:23:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:19.602 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:23:19.610 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:23:20.355 INFO:teuthology.orchestra.run.smithi063.stdout:generic/005 1s 2024-03-26T06:23:20.370 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/005 2024-03-26T06:23:20.370 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:23:20.378 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:20.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:23:20.441 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-03-26T06:23:20.932 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:23:20.945 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:23:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:23:20.949 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:23:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:23:49.762 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:23:49.770 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:24:00.545 INFO:teuthology.orchestra.run.smithi063.stdout:generic/006 39s 2024-03-26T06:24:00.820 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/006 2024-03-26T06:24:00.821 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:24:00.829 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:24:00.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:24:00.899 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-03-26T06:24:01.423 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:24:01.437 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:24:01.439 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:24:01.443 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:24:01.443 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:24:19.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:24:19.889 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:24:50.020 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:24:50.029 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:25:20.176 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:25:20.198 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:25:29.945 INFO:teuthology.orchestra.run.smithi063.stdout:generic/007 88s 2024-03-26T06:25:29.962 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/007 2024-03-26T06:25:29.962 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:25:29.970 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:25:30.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:25:30.085 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-03-26T06:25:30.658 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:25:30.669 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:25:30.670 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:25:30.673 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:25:30.673 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:25:31.459 INFO:teuthology.orchestra.run.smithi063.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-26T06:25:31.475 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/008 2024-03-26T06:25:31.475 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/008 2024-03-26T06:25:31.475 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:25:31.486 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:25:31.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:25:31.550 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-03-26T06:25:32.210 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:25:32.225 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:25:32.227 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:25:32.232 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:25:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:25:33.065 INFO:teuthology.orchestra.run.smithi063.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-26T06:25:33.080 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/009 2024-03-26T06:25:33.080 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/009 2024-03-26T06:25:33.080 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:25:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:25:33.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:25:33.143 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-03-26T06:25:33.742 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:25:33.755 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:25:33.756 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:25:33.759 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:25:33.759 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:25:35.016 INFO:teuthology.orchestra.run.smithi063.stdout:generic/010 2s 2024-03-26T06:25:35.033 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/010 2024-03-26T06:25:35.033 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:25:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:25:35.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:25:35.133 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-03-26T06:25:35.634 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:25:35.649 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:25:35.650 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:25:35.654 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:25:35.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:25:50.323 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:25:50.331 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:26:21.324 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:26:21.334 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:26:26.828 INFO:teuthology.orchestra.run.smithi063.stdout:generic/011 51s 2024-03-26T06:26:26.851 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/011 2024-03-26T06:26:26.851 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:26:26.861 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:26:26.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:26:26.942 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-03-26T06:26:27.506 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:26:27.519 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:26:27.521 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:26:27.524 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:26:27.524 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:26:28.395 INFO:teuthology.orchestra.run.smithi063.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:26:28.409 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/012 2024-03-26T06:26:28.410 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/012 2024-03-26T06:26:28.410 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:26:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:26:28.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:26:28.517 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-03-26T06:26:29.034 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:26:29.048 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:26:29.049 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:26:29.053 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:26:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:26:51.522 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:26:51.529 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:27:22.071 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:27:22.078 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:27:41.130 INFO:teuthology.orchestra.run.smithi063.stdout:generic/013 72s 2024-03-26T06:27:41.766 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/013 2024-03-26T06:27:41.766 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:27:41.777 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:41.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:27:41.847 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-03-26T06:27:42.641 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:27:42.657 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:27:42.659 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:27:42.665 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:27:42.665 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:43.884 INFO:teuthology.orchestra.run.smithi063.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-03-26T06:27:43.896 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/014 2024-03-26T06:27:43.896 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/014 2024-03-26T06:27:43.896 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:27:43.906 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:43.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:27:43.953 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-03-26T06:27:44.626 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:27:44.641 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:27:44.643 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:27:44.647 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:27:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:45.310 INFO:teuthology.orchestra.run.smithi063.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T06:27:45.322 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/015 2024-03-26T06:27:45.323 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/015 2024-03-26T06:27:45.323 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:27:45.333 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:45.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:27:45.378 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-03-26T06:27:46.020 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:27:46.035 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:27:46.037 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:27:46.040 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:27:46.041 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:46.940 INFO:teuthology.orchestra.run.smithi063.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:27:46.954 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/016 2024-03-26T06:27:46.954 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/016 2024-03-26T06:27:46.954 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:27:46.963 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:47.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:27:47.032 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-03-26T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:27:47.792 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:27:47.793 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:27:47.798 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:27:47.798 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:48.499 INFO:teuthology.orchestra.run.smithi063.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-26T06:27:48.510 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/017 2024-03-26T06:27:48.511 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/017 2024-03-26T06:27:48.511 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:27:48.522 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:48.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:27:48.571 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-03-26T06:27:49.236 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:27:49.253 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:27:49.254 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:27:49.259 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:27:49.259 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:50.112 INFO:teuthology.orchestra.run.smithi063.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-03-26T06:27:50.577 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/018 2024-03-26T06:27:50.577 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/018 2024-03-26T06:27:50.577 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:27:50.588 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:50.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:27:50.635 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-03-26T06:27:51.291 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:27:51.306 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:27:51.308 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:27:51.311 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:27:51.311 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:51.976 INFO:teuthology.orchestra.run.smithi063.stdout:generic/019 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:27:51.989 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/019 2024-03-26T06:27:51.989 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/019 2024-03-26T06:27:51.989 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:27:51.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:27:52.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:27:52.037 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-03-26T06:27:52.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:27:52.220 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:27:52.763 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:27:52.778 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:27:52.779 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:27:52.784 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:27:52.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:01.256 INFO:teuthology.orchestra.run.smithi063.stdout:generic/020 8s 2024-03-26T06:28:01.276 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/020 2024-03-26T06:28:01.277 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:01.287 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:01.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:01.378 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-03-26T06:28:02.039 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:02.054 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:02.056 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:02.059 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:02.060 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:02.960 INFO:teuthology.orchestra.run.smithi063.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:28:02.974 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/021 2024-03-26T06:28:02.974 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/021 2024-03-26T06:28:02.974 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:02.982 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:03.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:03.079 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-03-26T06:28:03.746 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:03.762 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:03.764 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:03.766 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:03.767 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:04.675 INFO:teuthology.orchestra.run.smithi063.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:28:04.689 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/022 2024-03-26T06:28:04.689 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/022 2024-03-26T06:28:04.689 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:04.699 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:04.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:04.783 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-03-26T06:28:05.454 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:05.470 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:05.474 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:05.477 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:05.477 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:07.915 INFO:teuthology.orchestra.run.smithi063.stdout:generic/023 2s 2024-03-26T06:28:07.937 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/023 2024-03-26T06:28:07.937 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:07.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:08.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:08.072 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-03-26T06:28:08.743 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:08.758 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:08.759 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:08.765 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:09.446 INFO:teuthology.orchestra.run.smithi063.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-03-26T06:28:09.459 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/024 2024-03-26T06:28:09.459 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/024 2024-03-26T06:28:09.459 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:09.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:09.561 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-03-26T06:28:10.213 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:10.227 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:10.228 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:10.230 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:10.940 INFO:teuthology.orchestra.run.smithi063.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-03-26T06:28:10.952 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/025 2024-03-26T06:28:10.952 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/025 2024-03-26T06:28:10.952 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:11.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:11.055 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-03-26T06:28:11.723 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:11.740 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:11.741 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:11.744 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:12.503 INFO:teuthology.orchestra.run.smithi063.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-03-26T06:28:12.517 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/026 2024-03-26T06:28:12.517 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/026 2024-03-26T06:28:12.517 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:12.527 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:12.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:12.571 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-03-26T06:28:13.192 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:13.210 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:13.213 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:13.216 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:13.217 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:13.861 INFO:teuthology.orchestra.run.smithi063.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T06:28:13.874 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/027 2024-03-26T06:28:13.874 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/027 2024-03-26T06:28:13.874 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:13.886 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:13.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:13.924 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-03-26T06:28:14.546 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:14.567 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:14.567 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:21.162 INFO:teuthology.orchestra.run.smithi063.stdout:generic/028 6s 2024-03-26T06:28:21.183 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/028 2024-03-26T06:28:21.183 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:21.193 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:21.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:21.233 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-03-26T06:28:21.886 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:21.901 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:21.904 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:21.908 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:21.908 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:23.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:28:23.518 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:28:26.308 INFO:teuthology.orchestra.run.smithi063.stdout:generic/029 4s 2024-03-26T06:28:26.328 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/029 2024-03-26T06:28:26.329 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:26.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:26.369 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-03-26T06:28:27.005 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:27.018 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:27.020 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:27.024 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:27.024 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:29.698 INFO:teuthology.orchestra.run.smithi063.stdout:generic/030 2s 2024-03-26T06:28:29.718 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/030 2024-03-26T06:28:29.718 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:29.727 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:29.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:29.755 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-03-26T06:28:30.378 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:30.392 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:30.393 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:30.397 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:30.397 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:31.231 INFO:teuthology.orchestra.run.smithi063.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-26T06:28:31.242 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/031 2024-03-26T06:28:31.242 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/031 2024-03-26T06:28:31.242 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:31.252 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:31.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:31.303 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-03-26T06:28:31.936 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:31.954 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:31.955 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:31.957 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:31.957 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:32.623 INFO:teuthology.orchestra.run.smithi063.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:28:32.637 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/032 2024-03-26T06:28:32.637 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/032 2024-03-26T06:28:32.637 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:32.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:32.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:32.699 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-03-26T06:28:33.333 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:33.348 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:33.349 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:33.352 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:33.352 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:34.172 INFO:teuthology.orchestra.run.smithi063.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-26T06:28:34.186 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/033 2024-03-26T06:28:34.186 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/033 2024-03-26T06:28:34.186 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:34.196 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:34.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:34.246 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-03-26T06:28:34.874 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:34.892 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:34.893 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:34.897 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:35.589 INFO:teuthology.orchestra.run.smithi063.stdout:generic/034 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:28:35.603 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/034 2024-03-26T06:28:35.604 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/034 2024-03-26T06:28:35.604 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:35.614 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:35.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:35.650 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-03-26T06:28:36.280 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:36.295 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:36.297 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:36.302 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:36.302 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:generic/035 1s 2024-03-26T06:28:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/035 2024-03-26T06:28:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:37.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:37.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:37.206 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-03-26T06:28:37.863 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:37.879 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:37.881 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:37.884 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:37.884 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:48.674 INFO:teuthology.orchestra.run.smithi063.stdout:generic/036 10s 2024-03-26T06:28:48.694 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/036 2024-03-26T06:28:48.694 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:28:48.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:48.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:28:48.795 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-03-26T06:28:49.468 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:28:49.485 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:28:49.487 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:28:49.491 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:28:49.491 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:28:55.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:28:55.824 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:29:02.283 INFO:teuthology.orchestra.run.smithi063.stdout:generic/037 13s 2024-03-26T06:29:02.303 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/037 2024-03-26T06:29:02.303 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:02.312 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:02.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:02.342 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-03-26T06:29:02.970 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:02.987 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:02.988 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:02.991 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:02.991 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:03.663 INFO:teuthology.orchestra.run.smithi063.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:29:03.676 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/038 2024-03-26T06:29:03.676 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/038 2024-03-26T06:29:03.676 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:03.686 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:03.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:03.735 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-03-26T06:29:04.366 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:04.379 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:04.381 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:04.383 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:04.383 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:05.106 INFO:teuthology.orchestra.run.smithi063.stdout:generic/039 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:29:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/039 2024-03-26T06:29:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/039 2024-03-26T06:29:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:05.129 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:05.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:05.178 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-03-26T06:29:05.828 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:06.554 INFO:teuthology.orchestra.run.smithi063.stdout:generic/040 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:29:06.567 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/040 2024-03-26T06:29:06.568 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/040 2024-03-26T06:29:06.568 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:06.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:06.630 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-03-26T06:29:07.264 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:07.279 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:07.281 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:07.286 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:07.286 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:08.008 INFO:teuthology.orchestra.run.smithi063.stdout:generic/041 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:29:08.020 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/041 2024-03-26T06:29:08.021 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/041 2024-03-26T06:29:08.021 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:08.029 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:08.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:08.077 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-03-26T06:29:08.712 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:08.726 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:08.727 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:08.730 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:09.545 INFO:teuthology.orchestra.run.smithi063.stdout:generic/042 [not run] ceph does not support shutdown 2024-03-26T06:29:09.564 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/042 2024-03-26T06:29:09.565 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/042 2024-03-26T06:29:09.565 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:09.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:09.613 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-03-26T06:29:10.233 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:10.248 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:10.250 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:10.253 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:11.078 INFO:teuthology.orchestra.run.smithi063.stdout:generic/043 [not run] ceph does not support shutdown 2024-03-26T06:29:11.100 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/043 2024-03-26T06:29:11.100 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/043 2024-03-26T06:29:11.100 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:11.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:11.147 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-03-26T06:29:11.759 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:11.774 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:11.775 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:11.778 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:11.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:12.611 INFO:teuthology.orchestra.run.smithi063.stdout:generic/044 [not run] ceph does not support shutdown 2024-03-26T06:29:12.633 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/044 2024-03-26T06:29:12.633 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/044 2024-03-26T06:29:12.633 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:12.644 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:12.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:12.680 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-03-26T06:29:13.288 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:13.303 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:13.304 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:13.308 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:13.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:14.161 INFO:teuthology.orchestra.run.smithi063.stdout:generic/045 [not run] ceph does not support shutdown 2024-03-26T06:29:14.184 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/045 2024-03-26T06:29:14.185 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/045 2024-03-26T06:29:14.185 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:14.193 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:14.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:14.230 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-03-26T06:29:14.861 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:14.874 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:14.875 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:14.878 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:15.723 INFO:teuthology.orchestra.run.smithi063.stdout:generic/046 [not run] ceph does not support shutdown 2024-03-26T06:29:15.745 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/046 2024-03-26T06:29:15.745 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/046 2024-03-26T06:29:15.745 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:15.753 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:15.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:15.790 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-03-26T06:29:16.398 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:16.414 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:16.415 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:16.418 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:16.418 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:17.251 INFO:teuthology.orchestra.run.smithi063.stdout:generic/047 [not run] ceph does not support shutdown 2024-03-26T06:29:17.273 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/047 2024-03-26T06:29:17.273 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/047 2024-03-26T06:29:17.273 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:17.281 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:17.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:17.317 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-03-26T06:29:17.937 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:17.952 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:17.953 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:17.956 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:17.956 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:18.791 INFO:teuthology.orchestra.run.smithi063.stdout:generic/048 [not run] ceph does not support shutdown 2024-03-26T06:29:18.813 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/048 2024-03-26T06:29:18.813 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/048 2024-03-26T06:29:18.813 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:18.824 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:18.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:18.867 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-03-26T06:29:19.465 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:19.482 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:19.482 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:19.486 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:19.486 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:20.335 INFO:teuthology.orchestra.run.smithi063.stdout:generic/049 [not run] ceph does not support shutdown 2024-03-26T06:29:20.355 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/049 2024-03-26T06:29:20.356 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/049 2024-03-26T06:29:20.356 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:20.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:20.400 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-03-26T06:29:21.037 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:21.052 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:21.055 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:21.059 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:21.060 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:21.876 INFO:teuthology.orchestra.run.smithi063.stdout:generic/050 [not run] ceph does not support shutdown 2024-03-26T06:29:21.900 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/050 2024-03-26T06:29:21.900 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/050 2024-03-26T06:29:21.900 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:21.914 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:21.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:21.953 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-03-26T06:29:22.579 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:22.595 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:22.596 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:22.599 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:22.599 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:23.477 INFO:teuthology.orchestra.run.smithi063.stdout:generic/051 [not run] ceph does not support shutdown 2024-03-26T06:29:23.492 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/051 2024-03-26T06:29:23.492 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/051 2024-03-26T06:29:23.492 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:23.503 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:23.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:23.538 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-03-26T06:29:24.153 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:24.167 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:24.169 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:24.172 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:24.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:25.016 INFO:teuthology.orchestra.run.smithi063.stdout:generic/052 [not run] ceph does not support shutdown 2024-03-26T06:29:25.035 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/052 2024-03-26T06:29:25.036 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/052 2024-03-26T06:29:25.036 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:25.046 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:25.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:25.084 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-03-26T06:29:25.674 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:25.688 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:25.689 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:25.694 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:27.196 INFO:teuthology.orchestra.run.smithi063.stdout:generic/053 2s 2024-03-26T06:29:28.267 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:29:28.272 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:29:28.312 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/053 2024-03-26T06:29:28.312 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:28.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:28.351 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-03-26T06:29:29.133 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:29.149 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:29.150 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:29.154 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:29.154 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:30.025 INFO:teuthology.orchestra.run.smithi063.stdout:generic/054 [not run] ceph does not support shutdown 2024-03-26T06:29:30.045 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/054 2024-03-26T06:29:30.046 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/054 2024-03-26T06:29:30.046 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:30.055 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:30.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:30.087 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-03-26T06:29:30.745 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:30.762 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:30.763 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:30.767 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:30.767 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:31.595 INFO:teuthology.orchestra.run.smithi063.stdout:generic/055 [not run] ceph does not support shutdown 2024-03-26T06:29:31.615 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/055 2024-03-26T06:29:31.615 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/055 2024-03-26T06:29:31.615 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:31.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:31.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:31.661 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-03-26T06:29:32.285 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:32.300 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:32.301 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:32.304 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:32.994 INFO:teuthology.orchestra.run.smithi063.stdout:generic/056 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:29:33.010 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/056 2024-03-26T06:29:33.010 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/056 2024-03-26T06:29:33.010 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:33.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:33.072 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-03-26T06:29:33.705 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:33.724 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:33.725 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:33.728 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:33.728 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:34.428 INFO:teuthology.orchestra.run.smithi063.stdout:generic/057 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:29:34.443 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/057 2024-03-26T06:29:34.443 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/057 2024-03-26T06:29:34.443 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:34.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:34.497 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-03-26T06:29:35.142 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:35.157 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:35.157 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:35.160 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:35.161 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:36.074 INFO:teuthology.orchestra.run.smithi063.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:29:36.088 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/058 2024-03-26T06:29:36.088 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/058 2024-03-26T06:29:36.088 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:36.098 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:36.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:36.167 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-03-26T06:29:36.862 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:36.876 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:36.877 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:36.880 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:36.880 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:37.561 INFO:teuthology.orchestra.run.smithi063.stdout:generic/059 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:29:37.578 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/059 2024-03-26T06:29:37.578 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/059 2024-03-26T06:29:37.578 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:37.590 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:37.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:37.632 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-03-26T06:29:38.266 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:38.279 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:38.280 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:38.283 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:38.283 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:39.151 INFO:teuthology.orchestra.run.smithi063.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:29:39.162 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/060 2024-03-26T06:29:39.162 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/060 2024-03-26T06:29:39.162 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:39.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:39.249 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-03-26T06:29:39.941 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:39.954 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:39.957 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:39.961 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:40.833 INFO:teuthology.orchestra.run.smithi063.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:29:40.845 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/061 2024-03-26T06:29:40.845 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/061 2024-03-26T06:29:40.845 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:40.855 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:40.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:40.958 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-03-26T06:29:41.640 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:41.659 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:41.661 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:41.663 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:45.343 INFO:teuthology.orchestra.run.smithi063.stdout:generic/062 4s 2024-03-26T06:29:45.381 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/062 2024-03-26T06:29:45.382 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:45.398 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:45.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:45.441 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-03-26T06:29:46.105 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:46.120 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:46.122 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:46.126 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:47.092 INFO:teuthology.orchestra.run.smithi063.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:29:47.106 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/063 2024-03-26T06:29:47.106 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/063 2024-03-26T06:29:47.106 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:47.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:47.190 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-03-26T06:29:47.900 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:47.918 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:47.919 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:47.922 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:48.621 INFO:teuthology.orchestra.run.smithi063.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-26T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/064 2024-03-26T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/064 2024-03-26T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:48.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:48.686 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-03-26T06:29:49.314 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:49.331 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:49.332 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:49.335 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:49.335 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:50.024 INFO:teuthology.orchestra.run.smithi063.stdout:generic/065 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:29:50.037 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/065 2024-03-26T06:29:50.037 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/065 2024-03-26T06:29:50.037 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:50.050 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:50.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:50.095 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-03-26T06:29:50.714 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:50.729 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:50.731 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:50.734 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:50.737 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:51.407 INFO:teuthology.orchestra.run.smithi063.stdout:generic/066 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:29:51.420 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/066 2024-03-26T06:29:51.421 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/066 2024-03-26T06:29:51.421 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:51.430 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:51.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:51.474 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-03-26T06:29:52.105 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:52.120 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:52.121 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:52.125 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:52.852 INFO:teuthology.orchestra.run.smithi063.stdout:generic/067 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:29:52.866 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/067 2024-03-26T06:29:52.866 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/067 2024-03-26T06:29:52.867 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:52.876 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:52.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:52.914 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-03-26T06:29:53.540 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:53.557 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:53.558 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:53.563 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:53.563 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:generic/068 [not run] ceph does not support freezing 2024-03-26T06:29:54.279 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/068 2024-03-26T06:29:54.279 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/068 2024-03-26T06:29:54.279 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:29:54.288 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:29:54.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:29:54.329 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-03-26T06:29:54.940 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:29:54.953 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:29:54.955 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:29:54.958 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:29:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:30:00.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:30:00.188 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:30:23.428 INFO:teuthology.orchestra.run.smithi063.stdout:generic/069 28s 2024-03-26T06:30:23.467 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/069 2024-03-26T06:30:23.467 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:30:23.478 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:30:23.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:30:23.523 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-03-26T06:30:24.127 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:30:24.142 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:30:24.144 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:30:24.147 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:30:24.147 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:30:31.929 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:30:31.938 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:31:00.001 INFO:teuthology.orchestra.run.smithi063.stdout:generic/070 35s 2024-03-26T06:31:00.018 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/070 2024-03-26T06:31:00.018 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:31:00.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:31:00.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:31:00.159 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-03-26T06:31:00.825 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:31:00.842 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:31:00.843 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:31:00.846 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:31:00.846 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:31:01.526 INFO:teuthology.orchestra.run.smithi063.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-26T06:31:01.539 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/071 2024-03-26T06:31:01.539 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/071 2024-03-26T06:31:01.539 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:31:01.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:31:01.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:31:01.590 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-03-26T06:31:02.211 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:31:02.226 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:31:02.228 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:31:02.230 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:31:02.231 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:31:03.084 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:31:03.092 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:31:03.228 INFO:teuthology.orchestra.run.smithi063.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-26T06:31:03.241 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/072 2024-03-26T06:31:03.241 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/072 2024-03-26T06:31:03.241 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:31:03.250 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:31:03.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:31:03.295 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-03-26T06:31:04.000 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:31:04.019 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:31:04.019 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:31:04.023 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:31:04.023 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:31:04.672 INFO:teuthology.orchestra.run.smithi063.stdout:generic/073 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:31:04.682 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/073 2024-03-26T06:31:04.683 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/073 2024-03-26T06:31:04.683 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:31:04.694 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:31:04.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:31:04.734 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-03-26T06:31:05.336 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:31:05.350 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:31:05.351 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:31:05.355 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:31:05.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:31:34.062 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:31:34.072 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:31:53.336 INFO:teuthology.orchestra.run.smithi063.stdout:generic/074 48s 2024-03-26T06:31:53.354 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/074 2024-03-26T06:31:53.354 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:31:53.365 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:31:54.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:31:54.289 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-03-26T06:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:04.274 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:32:04.282 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:32:22.101 INFO:teuthology.orchestra.run.smithi063.stdout:generic/075 27s 2024-03-26T06:32:22.501 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/075 2024-03-26T06:32:22.501 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:22.510 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:22.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:22.611 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-03-26T06:32:23.332 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:23.346 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:23.348 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:23.351 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:23.351 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:23.991 INFO:teuthology.orchestra.run.smithi063.stdout:generic/076 [not run] require 172.21.15.63:6789:/scratch to be local device 2024-03-26T06:32:24.002 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/076 2024-03-26T06:32:24.003 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/076 2024-03-26T06:32:24.003 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:24.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:24.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:24.055 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-03-26T06:32:24.666 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:24.681 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:24.683 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:24.686 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:24.686 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:26.490 INFO:teuthology.orchestra.run.smithi063.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T06:32:26.502 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/077 2024-03-26T06:32:26.502 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/077 2024-03-26T06:32:26.503 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:26.512 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:26.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:26.615 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-03-26T06:32:27.344 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:27.359 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:27.362 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:27.366 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:27.366 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:28.047 INFO:teuthology.orchestra.run.smithi063.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-03-26T06:32:28.059 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/078 2024-03-26T06:32:28.060 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/078 2024-03-26T06:32:28.060 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:28.070 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:28.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:28.168 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-03-26T06:32:28.899 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:28.911 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:28.913 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:28.917 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:29.572 INFO:teuthology.orchestra.run.smithi063.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-03-26T06:32:29.584 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/079 2024-03-26T06:32:29.584 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/079 2024-03-26T06:32:29.584 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:29.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:29.646 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-03-26T06:32:30.259 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:30.274 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:30.276 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:30.280 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:33.028 INFO:teuthology.orchestra.run.smithi063.stdout:generic/080 3s 2024-03-26T06:32:33.048 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/080 2024-03-26T06:32:33.049 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:33.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:33.104 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-03-26T06:32:33.703 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:33.722 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:33.724 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:33.726 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:33.727 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:34.416 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:32:34.422 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:32:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:generic/081 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:32:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/081 2024-03-26T06:32:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/081 2024-03-26T06:32:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:34.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:34.592 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-03-26T06:32:35.238 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:35.252 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:35.257 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:35.257 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:35.900 INFO:teuthology.orchestra.run.smithi063.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T06:32:35.911 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/082 2024-03-26T06:32:35.912 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/082 2024-03-26T06:32:35.912 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:35.919 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:35.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:35.959 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-03-26T06:32:36.590 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:36.600 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:36.601 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:36.604 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:36.604 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T06:32:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/083 2024-03-26T06:32:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/083 2024-03-26T06:32:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:37.275 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:37.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:37.314 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-03-26T06:32:37.933 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:37.948 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:37.950 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:37.953 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:44.043 INFO:teuthology.orchestra.run.smithi063.stdout:generic/084 6s 2024-03-26T06:32:44.083 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/084 2024-03-26T06:32:44.083 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:44.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:44.149 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-03-26T06:32:44.728 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:44.743 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:44.744 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:44.747 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:45.454 INFO:teuthology.orchestra.run.smithi063.stdout:generic/085 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:32:45.466 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/085 2024-03-26T06:32:45.466 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/085 2024-03-26T06:32:45.466 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:45.474 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:45.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:45.517 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-03-26T06:32:46.106 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:46.118 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:46.120 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:46.124 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:46.782 INFO:teuthology.orchestra.run.smithi063.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:32:46.795 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/086 2024-03-26T06:32:46.795 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/086 2024-03-26T06:32:46.795 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:46.802 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:46.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:46.842 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-03-26T06:32:47.452 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:47.468 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:47.469 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:47.472 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:47.472 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:48.277 INFO:teuthology.orchestra.run.smithi063.stdout:generic/087 1s 2024-03-26T06:32:48.331 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/087 2024-03-26T06:32:48.331 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:48.339 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:48.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:48.473 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-03-26T06:32:49.201 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:49.215 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:49.216 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:49.219 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:49.219 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:49.906 INFO:teuthology.orchestra.run.smithi063.stdout:generic/088 0s 2024-03-26T06:32:49.926 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/088 2024-03-26T06:32:49.926 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:32:49.936 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:32:50.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:32:50.022 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-03-26T06:32:50.748 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:32:50.763 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:32:50.764 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:32:50.768 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:32:50.768 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:33:04.580 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:33:04.588 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:33:34.723 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:33:34.728 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:33:35.338 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T06:33:35.336+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 170122) UID: 0 2024-03-26T06:33:35.339 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T06:33:35.338+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 170122) UID: 0 2024-03-26T06:36:47.460 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:36:47.477 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:37:17.865 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:37:17.877 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:37:48.029 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:37:48.037 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:38:22.168 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:38:22.181 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:38:52.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:38:52.314 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:39:22.440 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:39:22.451 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:39:52.578 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:39:52.588 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:40:22.741 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:40:22.750 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:40:52.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:40:52.881 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:40:52.992 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T06:40:52.989+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 170507) UID: 0 2024-03-26T06:40:52.992 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T06:40:52.990+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 170507) UID: 0 2024-03-26T06:43:46.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:43:46.123 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:44:16.262 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:44:16.271 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:44:46.422 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:44:46.430 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:45:16.928 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:45:16.938 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:45:47.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:45:47.075 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:46:17.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:46:17.224 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:46:48.392 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:46:48.401 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:47:18.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:47:18.551 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:47:48.683 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:47:48.692 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:48:18.823 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:48:18.833 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:48:48.990 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:48:48.999 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:48:49.093 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T06:48:49.089+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 172726) UID: 0 2024-03-26T06:48:49.094 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T06:48:49.089+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 172726) UID: 0 2024-03-26T06:49:00.306 INFO:teuthology.orchestra.run.smithi063.stdout:generic/089 970s 2024-03-26T06:49:00.354 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/089 2024-03-26T06:49:00.355 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:49:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:49:00.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:49:00.626 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-03-26T06:49:01.542 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:49:01.557 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:49:01.558 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:49:01.561 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:49:01.562 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:49:02.284 INFO:teuthology.orchestra.run.smithi063.stdout:generic/090 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:49:02.299 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/090 2024-03-26T06:49:02.299 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/090 2024-03-26T06:49:02.299 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:49:02.311 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:49:02.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:49:02.351 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-03-26T06:49:02.904 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:49:02.918 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:49:02.919 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:49:02.923 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:49:02.923 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:51:37.210 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:51:37.221 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:52:07.362 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:52:07.371 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:52:13.690 INFO:teuthology.orchestra.run.smithi063.stdout:generic/091 [failed, exit status 1]- output mismatch (see /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/091.out.bad) 2024-03-26T06:52:13.713 INFO:teuthology.orchestra.run.smithi063.stdout: --- tests/generic/091.out 2024-03-26 06:18:43.806450170 +0000 2024-03-26T06:52:13.713 INFO:teuthology.orchestra.run.smithi063.stdout: +++ /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/091.out.bad 2024-03-26 06:52:13.680783560 +0000 2024-03-26T06:52:13.713 INFO:teuthology.orchestra.run.smithi063.stdout: @@ -5,3 +5,527 @@ 2024-03-26T06:52:13.713 INFO:teuthology.orchestra.run.smithi063.stdout: fsx -N 10000 -o 8192 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -R -W 2024-03-26T06:52:13.713 INFO:teuthology.orchestra.run.smithi063.stdout: fsx -N 10000 -o 32768 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -R -W 2024-03-26T06:52:13.713 INFO:teuthology.orchestra.run.smithi063.stdout: fsx -N 10000 -o 128000 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -W 2024-03-26T06:52:13.713 INFO:teuthology.orchestra.run.smithi063.stdout: +mapped writes DISABLED 2024-03-26T06:52:13.713 INFO:teuthology.orchestra.run.smithi063.stdout: +Seed set to 1 2024-03-26T06:52:13.713 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode 0, disabling! 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_ZERO_RANGE, disabling! 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support clone range, disabling! 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support dedupe range, disabling! 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support exchange range, disabling! 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +skipping zero size read 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +copying to largest ever: 0x4b000 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +copying to largest ever: 0x7a000 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +READ BAD DATA: offset = 0x1f000, size = 0x111f5, fname = /tmp/tmp.LsIyRsPUXptest/junk 2024-03-26T06:52:13.714 INFO:teuthology.orchestra.run.smithi063.stdout: +OFFSET GOOD BAD RANGE 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28000 0x94dd 0x0000 0x0 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28001 0xdd94 0x0000 0x1 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28002 0x94f9 0x0000 0x2 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28003 0xf994 0x0000 0x3 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28004 0x9422 0x0000 0x4 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28005 0x2294 0x0000 0x5 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28006 0x9458 0x0000 0x6 2024-03-26T06:52:13.715 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28007 0x5894 0x0000 0x7 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28008 0x94a3 0x0000 0x8 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +0x28009 0xa394 0x0000 0x9 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2800a 0x943d 0x0000 0xa 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2800b 0x3d94 0x0000 0xb 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2800c 0x94cd 0x0000 0xc 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2800d 0xcd94 0x0000 0xd 2024-03-26T06:52:13.716 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2800e 0x941b 0x0000 0xe 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2800f 0x1b94 0x0000 0xf 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +LOG DUMP (473 total operations): 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +1( 1 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2( 2 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +3( 3 mod 256): WRITE 0x69000 thru 0x78fff (0x10000 bytes) HOLE ***WWWW 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +4( 4 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +5( 5 mod 256): READ 0x63000 thru 0x70fff (0xe000 bytes) 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +6( 6 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +7( 7 mod 256): MAPREAD 0x29000 thru 0x40364 (0x17365 bytes) ***RRRR*** 2024-03-26T06:52:13.717 INFO:teuthology.orchestra.run.smithi063.stdout: +8( 8 mod 256): PUNCH 0x3867a thru 0x3be42 (0x37c9 bytes) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +9( 9 mod 256): PUNCH 0x6ea38 thru 0x78fff (0xa5c8 bytes) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +10( 10 mod 256): COPY 0x1f000 thru 0x29fff (0xb000 bytes) to 0x40000 thru 0x4afff 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +11( 11 mod 256): READ 0x73000 thru 0x77fff (0x5000 bytes) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +12( 12 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +13( 13 mod 256): WRITE 0x2f000 thru 0x49fff (0x1b000 bytes) ***WWWW 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +14( 14 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +15( 15 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +16( 16 mod 256): WRITE 0x4d000 thru 0x54fff (0x8000 bytes) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +17( 17 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +18( 18 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +19( 19 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +20( 20 mod 256): MAPREAD 0x55000 thru 0x6e2fc (0x192fd bytes) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +21( 21 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.718 INFO:teuthology.orchestra.run.smithi063.stdout: +22( 22 mod 256): TRUNCATE DOWN from 0x79000 to 0x1f000 ******WWWW 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +23( 23 mod 256): WRITE 0x61000 thru 0x65fff (0x5000 bytes) HOLE ***WWWW 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +24( 24 mod 256): PUNCH 0x3e5ff thru 0x3ed80 (0x782 bytes) 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +25( 25 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +26( 26 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +27( 27 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +28( 28 mod 256): COPY 0x61000 thru 0x64fff (0x4000 bytes) to 0x25000 thru 0x28fff 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +29( 29 mod 256): TRUNCATE DOWN from 0x66000 to 0x3a000 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +30( 30 mod 256): MAPREAD 0x39000 thru 0x39449 (0x44a bytes) 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +31( 31 mod 256): TRUNCATE UP from 0x3a000 to 0x40000 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +32( 32 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +33( 33 mod 256): COPY 0x1a000 thru 0x35fff (0x1c000 bytes) to 0x5e000 thru 0x79fff EEEE****** 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +34( 34 mod 256): MAPREAD 0x2000 thru 0x1ec96 (0x1cc97 bytes) 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +35( 35 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.719 INFO:teuthology.orchestra.run.smithi063.stdout: +36( 36 mod 256): WRITE 0x71000 thru 0x78fff (0x8000 bytes) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +37( 37 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +38( 38 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +39( 39 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +40( 40 mod 256): COPY 0x49000 thru 0x5ffff (0x17000 bytes) to 0x22000 thru 0x38fff ******EEEE 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +41( 41 mod 256): WRITE 0x29000 thru 0x38fff (0x10000 bytes) ***WWWW 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +42( 42 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +43( 43 mod 256): READ 0x65000 thru 0x68fff (0x4000 bytes) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +44( 44 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +45( 45 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +46( 46 mod 256): WRITE 0x3d000 thru 0x46fff (0xa000 bytes) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +47( 47 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +48( 48 mod 256): WRITE 0x14000 thru 0x23fff (0x10000 bytes) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +49( 49 mod 256): READ 0x6c000 thru 0x72fff (0x7000 bytes) 2024-03-26T06:52:13.720 INFO:teuthology.orchestra.run.smithi063.stdout: +50( 50 mod 256): TRUNCATE DOWN from 0x7a000 to 0x16000 ******WWWW 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +51( 51 mod 256): WRITE 0x15000 thru 0x1dfff (0x9000 bytes) EXTEND 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +52( 52 mod 256): PUNCH 0x6d5e thru 0x1d2c0 (0x16563 bytes) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +53( 53 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +54( 54 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +55( 55 mod 256): WRITE 0x34000 thru 0x50fff (0x1d000 bytes) HOLE ***WWWW 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +56( 56 mod 256): WRITE 0x38000 thru 0x41fff (0xa000 bytes) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +57( 57 mod 256): PUNCH 0x44b22 thru 0x479ea (0x2ec9 bytes) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +58( 58 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +59( 59 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +60( 60 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +61( 61 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +62( 62 mod 256): WRITE 0x19000 thru 0x28fff (0x10000 bytes) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +63( 63 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +64( 64 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.721 INFO:teuthology.orchestra.run.smithi063.stdout: +65( 65 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +66( 66 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +67( 67 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +68( 68 mod 256): PUNCH 0x29014 thru 0x326b2 (0x969f bytes) ******PPPP 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +69( 69 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +70( 70 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +71( 71 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +72( 72 mod 256): PUNCH 0x45e0a thru 0x4c97d (0x6b74 bytes) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +73( 73 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +74( 74 mod 256): PUNCH 0x204bd thru 0x26100 (0x5c44 bytes) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +75( 75 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +76( 76 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +77( 77 mod 256): READ 0x38000 thru 0x49fff (0x12000 bytes) 2024-03-26T06:52:13.722 INFO:teuthology.orchestra.run.smithi063.stdout: +78( 78 mod 256): PUNCH 0x4fdcd thru 0x50fff (0x1233 bytes) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +79( 79 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +80( 80 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +81( 81 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +82( 82 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +83( 83 mod 256): PUNCH 0x4bbdc thru 0x50fff (0x5424 bytes) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +84( 84 mod 256): TRUNCATE DOWN from 0x51000 to 0x16000 ******WWWW 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +85( 85 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +86( 86 mod 256): MAPREAD 0xc000 thru 0x1561e (0x961f bytes) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +87( 87 mod 256): COPY 0x14000 thru 0x14fff (0x1000 bytes) to 0x65000 thru 0x65fff 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +88( 88 mod 256): COPY 0x4f000 thru 0x5dfff (0xf000 bytes) to 0x2000 thru 0x10fff 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +89( 89 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +90( 90 mod 256): PUNCH 0x3f925 thru 0x50e34 (0x11510 bytes) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +91( 91 mod 256): MAPREAD 0x21000 thru 0x25654 (0x4655 bytes) 2024-03-26T06:52:13.723 INFO:teuthology.orchestra.run.smithi063.stdout: +92( 92 mod 256): WRITE 0x38000 thru 0x49fff (0x12000 bytes) 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +93( 93 mod 256): WRITE 0x3000 thru 0x4fff (0x2000 bytes) 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +94( 94 mod 256): PUNCH 0x22d29 thru 0x2f9e9 (0xccc1 bytes) 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +95( 95 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +96( 96 mod 256): MAPREAD 0x37000 thru 0x4c378 (0x15379 bytes) 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +97( 97 mod 256): WRITE 0x6f000 thru 0x70fff (0x2000 bytes) HOLE 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +98( 98 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +99( 99 mod 256): TRUNCATE DOWN from 0x71000 to 0x4f000 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +100(100 mod 256): READ 0x3c000 thru 0x4dfff (0x12000 bytes) 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +101(101 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +102(102 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +103(103 mod 256): TRUNCATE UP from 0x4f000 to 0x6f000 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +104(104 mod 256): COPY 0xa000 thru 0xefff (0x5000 bytes) to 0x66000 thru 0x6afff 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +105(105 mod 256): WRITE 0x2b000 thru 0x48fff (0x1e000 bytes) ***WWWW 2024-03-26T06:52:13.724 INFO:teuthology.orchestra.run.smithi063.stdout: +106(106 mod 256): COPY 0x5d000 thru 0x6dfff (0x11000 bytes) to 0x24000 thru 0x34fff ******EEEE 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +107(107 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +108(108 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5b000 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +109(109 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +110(110 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +111(111 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +112(112 mod 256): PUNCH 0x3ad7a thru 0x4344c (0x86d3 bytes) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +113(113 mod 256): WRITE 0xa000 thru 0x14fff (0xb000 bytes) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +114(114 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +115(115 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +116(116 mod 256): COPY 0x4000 thru 0x14fff (0x11000 bytes) to 0x57000 thru 0x67fff 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +117(117 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +118(118 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +119(119 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.725 INFO:teuthology.orchestra.run.smithi063.stdout: +120(120 mod 256): MAPREAD 0x3a000 thru 0x4d08b (0x1308c bytes) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +121(121 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +122(122 mod 256): PUNCH 0xc17e thru 0x13d3c (0x7bbf bytes) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +123(123 mod 256): WRITE 0x3b000 thru 0x40fff (0x6000 bytes) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +124(124 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +125(125 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +126(126 mod 256): WRITE 0x21000 thru 0x23fff (0x3000 bytes) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +127(127 mod 256): PUNCH 0x55e66 thru 0x67fff (0x1219a bytes) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +128(128 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +129(129 mod 256): WRITE 0xf000 thru 0x22fff (0x14000 bytes) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +130(130 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +131(131 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +132(132 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +133(133 mod 256): COPY 0x65000 thru 0x66fff (0x2000 bytes) to 0x1e000 thru 0x1ffff 2024-03-26T06:52:13.726 INFO:teuthology.orchestra.run.smithi063.stdout: +134(134 mod 256): READ 0x30000 thru 0x33fff (0x4000 bytes) ***RRRR*** 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +135(135 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +136(136 mod 256): COPY 0x21000 thru 0x2efff (0xe000 bytes) to 0xe000 thru 0x1bfff 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +137(137 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +138(138 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +139(139 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +140(140 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +141(141 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +142(142 mod 256): WRITE 0x0 thru 0x19fff (0x1a000 bytes) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +143(143 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +144(144 mod 256): TRUNCATE UP from 0x68000 to 0x72000 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +145(145 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +146(146 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +147(147 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +148(148 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.727 INFO:teuthology.orchestra.run.smithi063.stdout: +149(149 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +150(150 mod 256): READ 0x19000 thru 0x29fff (0x11000 bytes) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +151(151 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +152(152 mod 256): MAPREAD 0x4d000 thru 0x4d15d (0x15e bytes) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +153(153 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +154(154 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +155(155 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +156(156 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +157(157 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +158(158 mod 256): PUNCH 0x7c7d thru 0x1aa9c (0x12e20 bytes) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +159(159 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +160(160 mod 256): WRITE 0x76000 thru 0x78fff (0x3000 bytes) HOLE 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +161(161 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +162(162 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.728 INFO:teuthology.orchestra.run.smithi063.stdout: +163(163 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +164(164 mod 256): READ 0x58000 thru 0x61fff (0xa000 bytes) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +165(165 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +166(166 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +167(167 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +168(168 mod 256): COPY 0x70000 thru 0x77fff (0x8000 bytes) to 0x57000 thru 0x5efff 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +169(169 mod 256): MAPREAD 0x65000 thru 0x78331 (0x13332 bytes) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +170(170 mod 256): WRITE 0x6b000 thru 0x6ffff (0x5000 bytes) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +171(171 mod 256): WRITE 0x18000 thru 0x25fff (0xe000 bytes) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +172(172 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +173(173 mod 256): COPY 0x44000 thru 0x47fff (0x4000 bytes) to 0x13000 thru 0x16fff 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +174(174 mod 256): WRITE 0x62000 thru 0x77fff (0x16000 bytes) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +175(175 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +176(176 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +177(177 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: +178(178 mod 256): TRUNCATE DOWN from 0x79000 to 0x1d000 ******WWWW 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +179(179 mod 256): MAPREAD 0x18000 thru 0x1cc90 (0x4c91 bytes) 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +180(180 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +181(181 mod 256): PUNCH 0x33a4 thru 0x1189f (0xe4fc bytes) 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +182(182 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +183(183 mod 256): WRITE 0x3e000 thru 0x4cfff (0xf000 bytes) HOLE ***WWWW 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +184(184 mod 256): TRUNCATE DOWN from 0x4d000 to 0x29000 ******WWWW 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +185(185 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +186(186 mod 256): MAPREAD 0x1d000 thru 0x28e2a (0xbe2b bytes) 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +187(187 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) HOLE ***WWWW 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +188(188 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +189(189 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +190(190 mod 256): COPY 0x44000 thru 0x47fff (0x4000 bytes) to 0x38000 thru 0x3bfff 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +191(191 mod 256): READ 0x23000 thru 0x33fff (0x11000 bytes) ***RRRR*** 2024-03-26T06:52:13.730 INFO:teuthology.orchestra.run.smithi063.stdout: +192(192 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +193(193 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +194(194 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +195(195 mod 256): READ 0xc000 thru 0x10fff (0x5000 bytes) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +196(196 mod 256): COPY 0x4e000 thru 0x64fff (0x17000 bytes) to 0x35000 thru 0x4bfff 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +197(197 mod 256): MAPREAD 0x54000 thru 0x634ce (0xf4cf bytes) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +198(198 mod 256): PUNCH 0x8161 thru 0xcf7c (0x4e1c bytes) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +199(199 mod 256): PUNCH 0x582d1 thru 0x617ef (0x951f bytes) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +200(200 mod 256): MAPREAD 0x38000 thru 0x4da09 (0x15a0a bytes) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +201(201 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +202(202 mod 256): TRUNCATE DOWN from 0x6f000 to 0x15000 ******WWWW 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +203(203 mod 256): TRUNCATE UP from 0x15000 to 0x50000 ******WWWW 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +204(204 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +205(205 mod 256): WRITE 0x6a000 thru 0x76fff (0xd000 bytes) HOLE 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +206(206 mod 256): PUNCH 0x3052f thru 0x335d4 (0x30a6 bytes) 2024-03-26T06:52:13.731 INFO:teuthology.orchestra.run.smithi063.stdout: +207(207 mod 256): WRITE 0x5b000 thru 0x60fff (0x6000 bytes) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +208(208 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +209(209 mod 256): READ 0x26000 thru 0x3efff (0x19000 bytes) ***RRRR*** 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +210(210 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +211(211 mod 256): WRITE 0x5b000 thru 0x64fff (0xa000 bytes) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +212(212 mod 256): MAPREAD 0x3f000 thru 0x4bd78 (0xcd79 bytes) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +213(213 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +214(214 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +215(215 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +216(216 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +217(217 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +218(218 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.732 INFO:teuthology.orchestra.run.smithi063.stdout: +219(219 mod 256): TRUNCATE DOWN from 0x77000 to 0x5e000 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +220(220 mod 256): PUNCH 0x11d69 thru 0x1753f (0x57d7 bytes) 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +221(221 mod 256): PUNCH 0x42bbc thru 0x5a0e7 (0x1752c bytes) 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +222(222 mod 256): PUNCH 0x15837 thru 0x31b0f (0x1c2d9 bytes) ******PPPP 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +223(223 mod 256): READ 0x2d000 thru 0x36fff (0xa000 bytes) ***RRRR*** 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +224(224 mod 256): MAPREAD 0x29000 thru 0x47985 (0x1e986 bytes) ***RRRR*** 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +225(225 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +226(226 mod 256): WRITE 0x15000 thru 0x31fff (0x1d000 bytes) ***WWWW 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +227(227 mod 256): READ 0x12000 thru 0x23fff (0x12000 bytes) 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +228(228 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +229(229 mod 256): MAPREAD 0x28000 thru 0x34970 (0xc971 bytes) ***RRRR*** 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +230(230 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.733 INFO:teuthology.orchestra.run.smithi063.stdout: +231(231 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +232(232 mod 256): PUNCH 0x2bfe7 thru 0x33ed1 (0x7eeb bytes) ******PPPP 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +233(233 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +234(234 mod 256): WRITE 0x72000 thru 0x78fff (0x7000 bytes) HOLE 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +235(235 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +236(236 mod 256): COPY 0x72000 thru 0x77fff (0x6000 bytes) to 0x27000 thru 0x2cfff 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +237(237 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +238(238 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +239(239 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +240(240 mod 256): PUNCH 0x74145 thru 0x78fff (0x4ebb bytes) 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +241(241 mod 256): WRITE 0x4b000 thru 0x64fff (0x1a000 bytes) 2024-03-26T06:52:13.734 INFO:teuthology.orchestra.run.smithi063.stdout: +242(242 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +243(243 mod 256): WRITE 0x37000 thru 0x41fff (0xb000 bytes) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +244(244 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +245(245 mod 256): MAPREAD 0x37000 thru 0x49af1 (0x12af2 bytes) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +246(246 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +247(247 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +248(248 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +249(249 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +250(250 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +251(251 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +252(252 mod 256): MAPREAD 0x2b000 thru 0x3365b (0x865c bytes) ***RRRR*** 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +253(253 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +254(254 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +255(255 mod 256): READ 0x40000 thru 0x42fff (0x3000 bytes) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +256( 0 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.735 INFO:teuthology.orchestra.run.smithi063.stdout: +257( 1 mod 256): COPY 0x3f000 thru 0x46fff (0x8000 bytes) to 0x31000 thru 0x38fff 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +258( 2 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +259( 3 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +260( 4 mod 256): READ 0x23000 thru 0x3bfff (0x19000 bytes) ***RRRR*** 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +261( 5 mod 256): TRUNCATE DOWN from 0x79000 to 0x15000 ******WWWW 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +262( 6 mod 256): MAPREAD 0xa000 thru 0xe6d6 (0x46d7 bytes) 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +263( 7 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +264( 8 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +265( 9 mod 256): COPY 0xa000 thru 0x13fff (0xa000 bytes) to 0x5d000 thru 0x66fff 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +266( 10 mod 256): WRITE 0x51000 thru 0x62fff (0x12000 bytes) 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +267( 11 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +268( 12 mod 256): TRUNCATE DOWN from 0x67000 to 0x53000 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +269( 13 mod 256): PUNCH 0x4ec35 thru 0x52fff (0x43cb bytes) 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +270( 14 mod 256): TRUNCATE DOWN from 0x53000 to 0x11000 ******WWWW 2024-03-26T06:52:13.736 INFO:teuthology.orchestra.run.smithi063.stdout: +271( 15 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +272( 16 mod 256): WRITE 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +273( 17 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +274( 18 mod 256): TRUNCATE DOWN from 0x11000 to 0x10000 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +275( 19 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +276( 20 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +277( 21 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +278( 22 mod 256): MAPREAD 0x3000 thru 0xfecf (0xced0 bytes) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +279( 23 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +280( 24 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +281( 25 mod 256): COPY 0x9000 thru 0xefff (0x6000 bytes) to 0x1000 thru 0x6fff 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +282( 26 mod 256): TRUNCATE UP from 0x10000 to 0x4a000 ******WWWW 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +283( 27 mod 256): READ 0x37000 thru 0x47fff (0x11000 bytes) 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +284( 28 mod 256): TRUNCATE DOWN from 0x4a000 to 0x20000 ******WWWW 2024-03-26T06:52:13.737 INFO:teuthology.orchestra.run.smithi063.stdout: +285( 29 mod 256): COPY 0xd000 thru 0x18fff (0xc000 bytes) to 0x6d000 thru 0x78fff 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +286( 30 mod 256): READ 0x77000 thru 0x77fff (0x1000 bytes) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +287( 31 mod 256): TRUNCATE DOWN from 0x79000 to 0x43000 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +288( 32 mod 256): PUNCH 0x3ea29 thru 0x42fff (0x45d7 bytes) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +289( 33 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +290( 34 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +291( 35 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +292( 36 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +293( 37 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +294( 38 mod 256): PUNCH 0x2b723 thru 0x42fff (0x178dd bytes) ******PPPP 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +295( 39 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +296( 40 mod 256): TRUNCATE DOWN from 0x43000 to 0x12000 ******WWWW 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +297( 41 mod 256): MAPREAD 0x7000 thru 0x11604 (0xa605 bytes) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +298( 42 mod 256): MAPREAD 0x4000 thru 0x116ad (0xd6ae bytes) 2024-03-26T06:52:13.738 INFO:teuthology.orchestra.run.smithi063.stdout: +299( 43 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +300( 44 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +301( 45 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +302( 46 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +303( 47 mod 256): MAPREAD 0x7000 thru 0x11f0b (0xaf0c bytes) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +304( 48 mod 256): COPY 0x6000 thru 0xefff (0x9000 bytes) to 0x58000 thru 0x60fff 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +305( 49 mod 256): PUNCH 0x434c8 thru 0x49c93 (0x67cc bytes) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +306( 50 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +307( 51 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +308( 52 mod 256): COPY 0x30000 thru 0x31fff (0x2000 bytes) to 0x6000 thru 0x7fff EEEE****** 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +309( 53 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +310( 54 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +311( 55 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +312( 56 mod 256): PUNCH 0x4eab3 thru 0x60fff (0x1254d bytes) 2024-03-26T06:52:13.739 INFO:teuthology.orchestra.run.smithi063.stdout: +313( 57 mod 256): MAPREAD 0x16000 thru 0x25c6c (0xfc6d bytes) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +314( 58 mod 256): READ 0x51000 thru 0x52fff (0x2000 bytes) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +315( 59 mod 256): MAPREAD 0x25000 thru 0x2ba17 (0x6a18 bytes) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +316( 60 mod 256): MAPREAD 0x15000 thru 0x29d2a (0x14d2b bytes) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +317( 61 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +318( 62 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +319( 63 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +320( 64 mod 256): WRITE 0x6b000 thru 0x78fff (0xe000 bytes) HOLE 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +321( 65 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +322( 66 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +323( 67 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +324( 68 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.740 INFO:teuthology.orchestra.run.smithi063.stdout: +325( 69 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +326( 70 mod 256): WRITE 0x3f000 thru 0x48fff (0xa000 bytes) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +327( 71 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +328( 72 mod 256): MAPREAD 0x3b000 thru 0x4ce48 (0x11e49 bytes) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +329( 73 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +330( 74 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +331( 75 mod 256): WRITE 0x22000 thru 0x2afff (0x9000 bytes) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +332( 76 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +333( 77 mod 256): MAPREAD 0x3000 thru 0x20fae (0x1dfaf bytes) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +334( 78 mod 256): READ 0x12000 thru 0x17fff (0x6000 bytes) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +335( 79 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +336( 80 mod 256): WRITE 0xb000 thru 0xdfff (0x3000 bytes) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +337( 81 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +338( 82 mod 256): TRUNCATE DOWN from 0x79000 to 0x78000 2024-03-26T06:52:13.741 INFO:teuthology.orchestra.run.smithi063.stdout: +339( 83 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +340( 84 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +341( 85 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +342( 86 mod 256): COPY 0x0 thru 0x19fff (0x1a000 bytes) to 0x4b000 thru 0x64fff 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +343( 87 mod 256): COPY 0x4e000 thru 0x56fff (0x9000 bytes) to 0x60000 thru 0x68fff 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +344( 88 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +345( 89 mod 256): PUNCH 0x2f1ac thru 0x48a46 (0x1989b bytes) ******PPPP 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +346( 90 mod 256): TRUNCATE DOWN from 0x78000 to 0x39000 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +347( 91 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +348( 92 mod 256): PUNCH 0x2b9d5 thru 0x38fff (0xd62b bytes) ******PPPP 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +349( 93 mod 256): COPY 0x36000 thru 0x37fff (0x2000 bytes) to 0x26000 thru 0x27fff 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +350( 94 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +351( 95 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.742 INFO:teuthology.orchestra.run.smithi063.stdout: +352( 96 mod 256): WRITE 0x30000 thru 0x3afff (0xb000 bytes) EXTEND ***WWWW 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +353( 97 mod 256): PUNCH 0x2ff80 thru 0x3afff (0xb080 bytes) ******PPPP 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +354( 98 mod 256): PUNCH 0xe9ad thru 0x14cff (0x6353 bytes) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +355( 99 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +356(100 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +357(101 mod 256): WRITE 0x53000 thru 0x61fff (0xf000 bytes) HOLE 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +358(102 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +359(103 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +360(104 mod 256): COPY 0x5b000 thru 0x60fff (0x6000 bytes) to 0x14000 thru 0x19fff 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +361(105 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +362(106 mod 256): PUNCH 0x46997 thru 0x5048d (0x9af7 bytes) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +363(107 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +364(108 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +365(109 mod 256): READ 0x4f000 thru 0x58fff (0xa000 bytes) 2024-03-26T06:52:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: +366(110 mod 256): TRUNCATE DOWN from 0x62000 to 0x4b000 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +367(111 mod 256): PUNCH 0x16cf9 thru 0x1f09a (0x83a2 bytes) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +368(112 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +369(113 mod 256): WRITE 0x61000 thru 0x63fff (0x3000 bytes) HOLE 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +370(114 mod 256): PUNCH 0x7ece thru 0x15d6b (0xde9e bytes) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +371(115 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +372(116 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +373(117 mod 256): MAPREAD 0x3a000 thru 0x461c0 (0xc1c1 bytes) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +374(118 mod 256): COPY 0x4000 thru 0x7fff (0x4000 bytes) to 0x6e000 thru 0x71fff 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +375(119 mod 256): PUNCH 0xf1b6 thru 0x20325 (0x11170 bytes) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +376(120 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +377(121 mod 256): WRITE 0x72000 thru 0x78fff (0x7000 bytes) EXTEND 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +378(122 mod 256): PUNCH 0x33aa3 thru 0x33aba (0x18 bytes) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +379(123 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: +380(124 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +381(125 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +382(126 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +383(127 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +384(128 mod 256): WRITE 0x50000 thru 0x57fff (0x8000 bytes) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +385(129 mod 256): WRITE 0x5c000 thru 0x78fff (0x1d000 bytes) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +386(130 mod 256): WRITE 0x2c000 thru 0x3bfff (0x10000 bytes) ***WWWW 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +387(131 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +388(132 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +389(133 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +390(134 mod 256): READ 0x14000 thru 0x15fff (0x2000 bytes) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +391(135 mod 256): PUNCH 0x642c5 thru 0x78fff (0x14d3b bytes) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +392(136 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +393(137 mod 256): PUNCH 0x38e5e thru 0x40c2b (0x7dce bytes) 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +394(138 mod 256): WRITE 0x1a000 thru 0x30fff (0x17000 bytes) ***WWWW 2024-03-26T06:52:13.745 INFO:teuthology.orchestra.run.smithi063.stdout: +395(139 mod 256): MAPREAD 0x25000 thru 0x3bcd4 (0x16cd5 bytes) ***RRRR*** 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +396(140 mod 256): WRITE 0x4d000 thru 0x62fff (0x16000 bytes) 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +397(141 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +398(142 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +399(143 mod 256): TRUNCATE DOWN from 0x79000 to 0x54000 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +400(144 mod 256): READ 0x34000 thru 0x47fff (0x14000 bytes) 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +401(145 mod 256): MAPREAD 0x8000 thru 0x17f9b (0xff9c bytes) 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +402(146 mod 256): WRITE 0x76000 thru 0x78fff (0x3000 bytes) HOLE 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +403(147 mod 256): WRITE 0x17000 thru 0x2bfff (0x15000 bytes) 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +404(148 mod 256): WRITE 0x1000 thru 0x15fff (0x15000 bytes) 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +405(149 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +406(150 mod 256): PUNCH 0x2e493 thru 0x47894 (0x19402 bytes) ******PPPP 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +407(151 mod 256): PUNCH 0x1b7ac thru 0x330d7 (0x1792c bytes) ******PPPP 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +408(152 mod 256): TRUNCATE DOWN from 0x79000 to 0x3b000 2024-03-26T06:52:13.746 INFO:teuthology.orchestra.run.smithi063.stdout: +409(153 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +410(154 mod 256): WRITE 0x3f000 thru 0x41fff (0x3000 bytes) HOLE 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +411(155 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +412(156 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +413(157 mod 256): TRUNCATE DOWN from 0x42000 to 0x29000 ******WWWW 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +414(158 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +415(159 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +416(160 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +417(161 mod 256): READ 0x27000 thru 0x27fff (0x1000 bytes) 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +418(162 mod 256): WRITE 0x61000 thru 0x61fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +419(163 mod 256): TRUNCATE DOWN from 0x62000 to 0x2b000 ******WWWW 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +420(164 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +421(165 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +422(166 mod 256): COPY 0x9000 thru 0x15fff (0xd000 bytes) to 0x68000 thru 0x74fff 2024-03-26T06:52:13.747 INFO:teuthology.orchestra.run.smithi063.stdout: +423(167 mod 256): COPY 0x49000 thru 0x4afff (0x2000 bytes) to 0x68000 thru 0x69fff 2024-03-26T06:52:13.748 INFO:teuthology.orchestra.run.smithi063.stdout: +424(168 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.748 INFO:teuthology.orchestra.run.smithi063.stdout: +425(169 mod 256): COPY 0x25000 thru 0x41fff (0x1d000 bytes) to 0x42000 thru 0x5efff EEEE****** 2024-03-26T06:52:13.748 INFO:teuthology.orchestra.run.smithi063.stdout: +426(170 mod 256): WRITE 0x58000 thru 0x61fff (0xa000 bytes) 2024-03-26T06:52:13.748 INFO:teuthology.orchestra.run.smithi063.stdout: +427(171 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.748 INFO:teuthology.orchestra.run.smithi063.stdout: +428(172 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.748 INFO:teuthology.orchestra.run.smithi063.stdout: +429(173 mod 256): TRUNCATE DOWN from 0x75000 to 0x62000 2024-03-26T06:52:13.748 INFO:teuthology.orchestra.run.smithi063.stdout: +430(174 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.748 INFO:teuthology.orchestra.run.smithi063.stdout: +431(175 mod 256): TRUNCATE DOWN from 0x62000 to 0x4e000 2024-03-26T06:52:13.749 INFO:teuthology.orchestra.run.smithi063.stdout: +432(176 mod 256): WRITE 0x4e000 thru 0x6afff (0x1d000 bytes) EXTEND 2024-03-26T06:52:13.749 INFO:teuthology.orchestra.run.smithi063.stdout: +433(177 mod 256): COPY 0x43000 thru 0x5dfff (0x1b000 bytes) to 0x22000 thru 0x3cfff ******EEEE 2024-03-26T06:52:13.749 INFO:teuthology.orchestra.run.smithi063.stdout: +434(178 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.749 INFO:teuthology.orchestra.run.smithi063.stdout: +435(179 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.749 INFO:teuthology.orchestra.run.smithi063.stdout: +436(180 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.749 INFO:teuthology.orchestra.run.smithi063.stdout: +437(181 mod 256): READ 0x30000 thru 0x33fff (0x4000 bytes) ***RRRR*** 2024-03-26T06:52:13.749 INFO:teuthology.orchestra.run.smithi063.stdout: +438(182 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.749 INFO:teuthology.orchestra.run.smithi063.stdout: +439(183 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +440(184 mod 256): READ 0x21000 thru 0x36fff (0x16000 bytes) ***RRRR*** 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +441(185 mod 256): TRUNCATE DOWN from 0x6b000 to 0x60000 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +442(186 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +443(187 mod 256): READ 0xe000 thru 0x1ffff (0x12000 bytes) 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +444(188 mod 256): READ 0x2e000 thru 0x33fff (0x6000 bytes) ***RRRR*** 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +445(189 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +446(190 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +447(191 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +448(192 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +449(193 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +450(194 mod 256): COPY 0x1d000 thru 0x1dfff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +451(195 mod 256): PUNCH 0x4c01a thru 0x5ffff (0x13fe6 bytes) 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +452(196 mod 256): TRUNCATE DOWN from 0x60000 to 0x2d000 ******WWWW 2024-03-26T06:52:13.750 INFO:teuthology.orchestra.run.smithi063.stdout: +453(197 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +454(198 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +455(199 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +456(200 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +457(201 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +458(202 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +459(203 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +460(204 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +461(205 mod 256): TRUNCATE DOWN from 0x69000 to 0x1c000 ******WWWW 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +462(206 mod 256): MAPREAD 0xe000 thru 0x15eaa (0x7eab bytes) 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +463(207 mod 256): WRITE 0x41000 thru 0x57fff (0x17000 bytes) HOLE ***WWWW 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +464(208 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +465(209 mod 256): WRITE 0x4e000 thru 0x5dfff (0x10000 bytes) EXTEND 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +466(210 mod 256): TRUNCATE DOWN from 0x5e000 to 0x2e000 ******WWWW 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +467(211 mod 256): TRUNCATE UP from 0x2e000 to 0x6c000 ******WWWW 2024-03-26T06:52:13.751 INFO:teuthology.orchestra.run.smithi063.stdout: +468(212 mod 256): COPY 0x8000 thru 0x18fff (0x11000 bytes) to 0x28000 thru 0x38fff ******EEEE 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout: +469(213 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout: +470(214 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout: +471(215 mod 256): MAPREAD 0x3a000 thru 0x444af (0xa4b0 bytes) 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout: +472(216 mod 256): SKIPPED (no operation) 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout: +473(217 mod 256): MAPREAD 0x1f000 thru 0x301f4 (0x111f5 bytes) ***RRRR*** 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout: +Log of operations saved to "/tmp/tmp.LsIyRsPUXptest/junk.fsxops"; replay with --replay-ops 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout: +Correct content saved for comparison 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout: +(maybe hexdump "/tmp/tmp.LsIyRsPUXptest/junk" vs "/tmp/tmp.LsIyRsPUXptest/junk.fsxgood") 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/091 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout:Failures: generic/091 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout:Failed 1 of 1 tests 2024-03-26T06:52:13.752 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:13.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T06:52:13.793 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-26T06:52:13.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-26T06:52:13.794 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-03-26T06:52:14.364 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:52:14.378 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:52:14.379 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:52:14.383 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:52:14.383 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:15.043 INFO:teuthology.orchestra.run.smithi063.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:52:15.057 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/092 2024-03-26T06:52:15.057 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/092 2024-03-26T06:52:15.057 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:52:15.067 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:15.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:52:15.111 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-03-26T06:52:15.728 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:52:15.744 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:52:15.747 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:52:15.751 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:52:15.751 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:17.281 INFO:teuthology.orchestra.run.smithi063.stdout:generic/093 2s 2024-03-26T06:52:17.300 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/093 2024-03-26T06:52:17.301 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:52:17.310 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:17.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:52:17.452 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-03-26T06:52:18.140 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:52:18.155 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:52:18.156 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:52:18.160 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:52:18.160 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:18.951 INFO:teuthology.orchestra.run.smithi063.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-26T06:52:18.963 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/094 2024-03-26T06:52:18.964 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/094 2024-03-26T06:52:18.964 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:52:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:19.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:52:19.081 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-03-26T06:52:19.739 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:52:19.755 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:52:19.758 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:52:19.762 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:52:19.762 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:34.910 INFO:teuthology.orchestra.run.smithi063.stdout:generic/095 15s 2024-03-26T06:52:34.923 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/095 2024-03-26T06:52:34.923 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:52:34.929 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:34.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:52:34.951 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-03-26T06:52:35.493 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:52:35.507 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:52:35.509 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:52:35.512 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:52:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:36.389 INFO:teuthology.orchestra.run.smithi063.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-26T06:52:36.401 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/096 2024-03-26T06:52:36.401 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/096 2024-03-26T06:52:36.401 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:52:36.409 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:36.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:52:36.452 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-03-26T06:52:37.064 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:52:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:52:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:52:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:52:37.085 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:37.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:52:37.514 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:52:38.289 INFO:teuthology.orchestra.run.smithi063.stdout:generic/097 1s 2024-03-26T06:52:38.303 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/097 2024-03-26T06:52:38.303 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:52:38.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:38.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:52:38.336 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-03-26T06:52:38.824 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:52:38.838 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:52:38.839 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:52:38.842 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:52:38.842 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:40.703 INFO:teuthology.orchestra.run.smithi063.stdout:generic/098 1s 2024-03-26T06:52:40.721 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/098 2024-03-26T06:52:40.721 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:52:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:40.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:52:40.761 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-03-26T06:52:41.388 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:52:41.402 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:52:41.404 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:52:41.408 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:52:41.409 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:43.702 INFO:teuthology.orchestra.run.smithi063.stdout:generic/099 2s 2024-03-26T06:52:43.719 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/099 2024-03-26T06:52:43.719 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:52:43.729 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:52:43.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:52:43.846 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-03-26T06:52:44.525 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:52:44.538 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:52:44.539 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:52:44.542 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:52:44.542 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:08.631 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:53:08.640 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:53:19.000 INFO:teuthology.orchestra.run.smithi063.stdout:generic/100 34s 2024-03-26T06:53:19.017 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/100 2024-03-26T06:53:19.017 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:21.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:21.113 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-03-26T06:53:21.648 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:21.663 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:21.665 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:21.668 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:21.668 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:22.395 INFO:teuthology.orchestra.run.smithi063.stdout:generic/101 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:53:22.411 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/101 2024-03-26T06:53:22.411 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/101 2024-03-26T06:53:22.411 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:22.423 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:22.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:22.470 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-03-26T06:53:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:23.108 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:23.761 INFO:teuthology.orchestra.run.smithi063.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T06:53:23.779 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/102 2024-03-26T06:53:23.780 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/102 2024-03-26T06:53:23.780 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:23.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:23.836 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-03-26T06:53:24.451 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:24.466 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:24.467 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:24.471 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:25.196 INFO:teuthology.orchestra.run.smithi063.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T06:53:25.212 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/103 2024-03-26T06:53:25.213 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/103 2024-03-26T06:53:25.213 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:25.225 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:25.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:25.348 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-03-26T06:53:26.029 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:26.044 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:26.046 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:26.050 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:26.990 INFO:teuthology.orchestra.run.smithi063.stdout:generic/104 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:53:27.007 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/104 2024-03-26T06:53:27.007 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/104 2024-03-26T06:53:27.007 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:27.019 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:27.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:27.080 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-03-26T06:53:27.705 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:27.719 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:27.720 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:27.724 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:28.954 INFO:teuthology.orchestra.run.smithi063.stdout:generic/105 1s 2024-03-26T06:53:28.989 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/105 2024-03-26T06:53:28.989 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:29.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:29.054 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-03-26T06:53:29.612 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:29.627 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:29.628 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:29.631 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:generic/106 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:53:30.397 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/106 2024-03-26T06:53:30.398 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/106 2024-03-26T06:53:30.398 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:30.407 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:30.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:30.462 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-03-26T06:53:31.086 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:31.099 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:31.100 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:31.103 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:31.854 INFO:teuthology.orchestra.run.smithi063.stdout:generic/107 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:53:31.870 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/107 2024-03-26T06:53:31.870 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/107 2024-03-26T06:53:31.870 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:31.883 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:31.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:31.938 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-03-26T06:53:32.609 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:32.624 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:32.630 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:32.630 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:33.645 INFO:teuthology.orchestra.run.smithi063.stdout:generic/108 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T06:53:33.658 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/108 2024-03-26T06:53:33.658 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/108 2024-03-26T06:53:33.658 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:33.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:33.718 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-03-26T06:53:34.354 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:34.369 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:34.371 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:34.375 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:34.375 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:38.772 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:53:38.780 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:53:46.493 INFO:teuthology.orchestra.run.smithi063.stdout:generic/109 12s 2024-03-26T06:53:48.861 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/109 2024-03-26T06:53:48.861 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:53:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:53:48.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:53:48.913 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-03-26T06:53:49.530 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:53:49.542 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:53:49.544 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:53:49.549 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:53:49.549 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:54:08.903 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:54:08.910 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:54:19.903 INFO:teuthology.orchestra.run.smithi063.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T06:54:19.912 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/110 2024-03-26T06:54:19.912 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/110 2024-03-26T06:54:19.912 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:54:24.247 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:54:24.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:54:24.369 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-03-26T06:54:25.030 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:54:25.045 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:54:25.047 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:54:25.050 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:54:25.050 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:54:25.765 INFO:teuthology.orchestra.run.smithi063.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T06:54:25.780 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/111 2024-03-26T06:54:25.780 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/111 2024-03-26T06:54:25.780 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:54:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:54:25.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:54:25.913 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-03-26T06:54:26.571 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:54:26.582 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:54:26.584 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:54:26.586 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:54:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:54:39.059 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:54:39.069 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:55:09.056 INFO:teuthology.orchestra.run.smithi063.stdout:generic/112 43s 2024-03-26T06:55:09.073 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/112 2024-03-26T06:55:09.073 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:55:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:09.197 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:55:09.214 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:55:09.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:55:09.224 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-03-26T06:55:09.923 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:55:09.939 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:55:09.941 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:55:09.945 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:55:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:28.909 INFO:teuthology.orchestra.run.smithi063.stdout:generic/113 18s 2024-03-26T06:55:28.923 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/113 2024-03-26T06:55:28.923 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:55:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:29.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:55:29.001 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-03-26T06:55:29.688 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:55:29.702 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:55:29.704 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:55:29.707 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:55:29.707 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:30.422 INFO:teuthology.orchestra.run.smithi063.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-03-26T06:55:30.435 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/114 2024-03-26T06:55:30.435 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/114 2024-03-26T06:55:30.435 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:55:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:30.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:55:30.492 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-03-26T06:55:31.109 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:55:31.126 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:55:31.128 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:55:31.133 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:55:31.133 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:31.859 INFO:teuthology.orchestra.run.smithi063.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T06:55:31.874 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/115 2024-03-26T06:55:31.875 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/115 2024-03-26T06:55:31.875 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:55:31.889 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:32.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:55:32.024 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-03-26T06:55:32.697 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:55:32.710 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:55:32.712 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:55:32.715 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:55:32.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:33.465 INFO:teuthology.orchestra.run.smithi063.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T06:55:33.481 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/116 2024-03-26T06:55:33.481 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/116 2024-03-26T06:55:33.481 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:55:33.492 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:33.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:55:33.612 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-03-26T06:55:34.289 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:55:34.300 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:55:34.302 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:55:34.305 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:55:34.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:55:39.465 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:55:39.475 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:56:02.254 INFO:teuthology.orchestra.run.smithi063.stdout:generic/117 28s 2024-03-26T06:56:02.267 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/117 2024-03-26T06:56:02.267 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:56:02.274 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:02.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:56:02.300 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-03-26T06:56:02.849 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:56:02.862 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:56:02.863 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:56:02.867 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:56:02.867 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:04.531 INFO:teuthology.orchestra.run.smithi063.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T06:56:04.542 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/118 2024-03-26T06:56:04.543 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/118 2024-03-26T06:56:04.543 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:56:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:04.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:56:04.643 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-03-26T06:56:05.322 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:56:05.336 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:56:05.338 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:56:05.341 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:56:05.342 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:06.091 INFO:teuthology.orchestra.run.smithi063.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T06:56:06.106 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/119 2024-03-26T06:56:06.106 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/119 2024-03-26T06:56:06.106 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:56:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:06.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:56:06.247 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-03-26T06:56:06.923 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:56:06.938 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:56:06.940 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:56:06.943 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:56:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:07.618 INFO:teuthology.orchestra.run.smithi063.stdout:generic/120 [not run] atime not maintained by ceph 2024-03-26T06:56:07.630 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/120 2024-03-26T06:56:07.631 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/120 2024-03-26T06:56:07.631 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:56:07.639 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:07.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:56:07.677 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-03-26T06:56:08.314 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:56:08.330 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:56:08.331 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:56:08.335 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:56:08.335 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:09.096 INFO:teuthology.orchestra.run.smithi063.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-26T06:56:09.113 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/121 2024-03-26T06:56:09.113 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/121 2024-03-26T06:56:09.113 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:56:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:09.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:56:09.250 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-03-26T06:56:09.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:56:09.684 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:56:09.928 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:56:09.939 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:56:09.940 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:56:09.943 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:56:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:10.683 INFO:teuthology.orchestra.run.smithi063.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-26T06:56:10.696 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/122 2024-03-26T06:56:10.696 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/122 2024-03-26T06:56:10.696 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:56:10.706 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:10.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:56:10.836 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-03-26T06:56:11.499 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:56:11.510 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:56:11.512 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:56:11.515 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:56:11.515 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:12.851 INFO:teuthology.orchestra.run.smithi063.stdout:generic/123 1s 2024-03-26T06:56:12.867 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/123 2024-03-26T06:56:12.867 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:56:12.875 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:12.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:56:12.989 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-03-26T06:56:13.689 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:56:13.703 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:56:13.705 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:56:13.709 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:56:13.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:19.238 INFO:teuthology.orchestra.run.smithi063.stdout:generic/124 6s 2024-03-26T06:56:19.275 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/124 2024-03-26T06:56:19.275 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:56:19.288 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:19.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:56:19.825 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-03-26T06:56:20.480 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:56:20.491 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:56:20.492 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:56:20.494 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:56:20.494 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:56:39.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:56:39.839 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:57:09.981 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:57:09.990 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:57:22.561 INFO:teuthology.orchestra.run.smithi063.stdout:generic/125 62s 2024-03-26T06:57:22.580 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/125 2024-03-26T06:57:22.580 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:57:22.590 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:57:22.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:57:22.710 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-03-26T06:57:23.353 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:57:23.367 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:57:23.369 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:57:23.372 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:57:23.373 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:57:24.477 INFO:teuthology.orchestra.run.smithi063.stdout:generic/126 1s 2024-03-26T06:57:24.495 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/126 2024-03-26T06:57:24.496 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T06:57:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:57:24.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T06:57:24.662 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-03-26T06:57:25.341 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T06:57:25.356 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T06:57:25.358 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T06:57:25.362 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T06:57:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T06:57:40.122 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:57:40.130 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:58:10.260 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:58:10.272 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:58:40.435 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:58:40.443 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:59:10.574 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:59:10.583 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:59:40.714 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T06:59:40.723 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:00:10.878 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:00:10.886 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:00:41.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:00:41.050 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:01:11.185 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:01:11.195 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:01:41.322 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:01:41.332 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:02:11.453 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:02:11.463 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:02:41.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:02:41.603 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:03:11.735 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:03:11.746 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:03:41.874 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:03:41.886 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:04:12.012 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:04:12.023 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:04:42.146 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:04:42.156 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:05:12.287 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:05:12.297 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:05:42.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:05:42.436 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:06:12.562 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:06:12.574 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:06:42.704 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:06:42.714 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:07:12.882 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:07:12.891 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:07:43.018 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:07:43.028 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:08:13.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:08:13.159 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:08:43.298 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:08:43.307 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:09:13.443 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:09:13.453 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:09:43.583 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:09:43.591 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:10:13.775 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:10:13.785 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:10:44.071 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:10:44.080 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:11:14.339 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:11:14.349 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:11:44.496 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:11:44.505 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:12:14.631 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:12:14.640 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:12:44.768 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:12:44.778 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:13:14.935 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:13:14.944 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:13:45.067 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:13:45.077 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:14:15.272 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:14:15.281 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:14:45.421 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:14:45.433 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:15:15.552 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:15:15.575 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:15:45.702 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:15:45.713 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:16:15.854 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:16:15.864 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:16:46.552 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:16:46.561 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:17:16.701 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:17:16.713 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:17:46.829 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:17:46.839 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:18:16.961 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:18:16.969 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:18:47.359 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:18:47.369 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:19:17.501 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:19:17.511 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:19:47.640 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:19:47.648 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:20:17.778 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:20:17.787 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:20:47.925 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:20:47.935 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:21:18.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:21:18.075 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:21:23.587 INFO:teuthology.orchestra.run.smithi063.stdout:generic/127 1438s 2024-03-26T07:21:23.602 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/127 2024-03-26T07:21:23.602 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:21:23.611 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:23.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:21:23.744 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-03-26T07:21:24.467 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:21:24.480 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:21:24.481 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:21:24.485 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:21:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:26.959 INFO:teuthology.orchestra.run.smithi063.stdout:generic/128 2s 2024-03-26T07:21:26.977 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/128 2024-03-26T07:21:26.977 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:21:26.984 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:27.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:21:27.006 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-03-26T07:21:27.516 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:21:27.531 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:21:27.533 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:21:27.537 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:21:27.537 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:28.257 INFO:teuthology.orchestra.run.smithi063.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-03-26T07:21:28.269 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/129 2024-03-26T07:21:28.269 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/129 2024-03-26T07:21:28.269 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:21:28.280 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:28.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:21:28.337 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-03-26T07:21:28.954 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:21:28.969 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:21:28.971 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:21:28.975 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:21:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:29.647 INFO:teuthology.orchestra.run.smithi063.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-03-26T07:21:29.663 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/130 2024-03-26T07:21:29.663 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/130 2024-03-26T07:21:29.663 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:21:29.675 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:29.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:21:29.736 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-03-26T07:21:30.343 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:21:30.356 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:21:30.358 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:21:30.361 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:21:30.361 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:32.422 INFO:teuthology.orchestra.run.smithi063.stdout:generic/131 2s 2024-03-26T07:21:32.438 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/131 2024-03-26T07:21:32.438 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:21:32.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:32.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:21:32.609 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-03-26T07:21:33.265 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:21:33.279 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:21:33.280 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:21:33.284 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:21:33.284 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:46.851 INFO:teuthology.orchestra.run.smithi063.stdout:generic/132 13s 2024-03-26T07:21:46.865 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/132 2024-03-26T07:21:46.865 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:21:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:46.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:21:46.902 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-03-26T07:21:47.511 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:21:47.526 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:21:47.528 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:21:47.532 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:21:47.532 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:21:48.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:21:48.213 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:22:18.339 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:22:18.349 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:22:48.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:22:48.500 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:23:18.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:23:18.651 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:23:48.770 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:23:48.780 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:24:18.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:24:18.981 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:24:49.099 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:24:49.116 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:25:19.352 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:25:19.362 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:25:49.504 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:25:49.520 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:26:19.649 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:26:19.658 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:26:49.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:26:49.794 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:27:19.924 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:27:19.933 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:27:50.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:27:50.072 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:28:20.352 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:28:20.362 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:28:50.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:28:50.524 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:29:20.643 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:29:20.652 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:29:50.782 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:29:50.791 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:30:20.924 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:30:20.934 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:30:51.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:30:51.075 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:31:21.206 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:31:21.215 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:31:51.415 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:31:51.424 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:32:02.749 INFO:teuthology.orchestra.run.smithi063.stdout:generic/133 615s 2024-03-26T07:32:02.767 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/133 2024-03-26T07:32:02.767 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:02.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:02.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:02.889 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-03-26T07:32:03.650 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:03.660 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:03.661 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:03.664 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:03.664 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:04.410 INFO:teuthology.orchestra.run.smithi063.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:04.425 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/134 2024-03-26T07:32:04.425 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/134 2024-03-26T07:32:04.425 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:04.434 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:04.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:04.574 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-03-26T07:32:05.229 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:05.242 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:05.244 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:05.248 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:06.797 INFO:teuthology.orchestra.run.smithi063.stdout:generic/135 1s 2024-03-26T07:32:06.810 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/135 2024-03-26T07:32:06.810 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:06.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:06.837 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-03-26T07:32:07.363 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:07.380 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:07.382 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:07.387 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:07.387 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:08.142 INFO:teuthology.orchestra.run.smithi063.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-26T07:32:08.157 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/136 2024-03-26T07:32:08.157 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/136 2024-03-26T07:32:08.157 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:08.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:08.306 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-03-26T07:32:08.988 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:09.002 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:09.003 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:09.007 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:09.807 INFO:teuthology.orchestra.run.smithi063.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:09.821 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/137 2024-03-26T07:32:09.822 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/137 2024-03-26T07:32:09.822 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:09.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:09.938 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-03-26T07:32:10.630 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:10.643 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:10.645 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:10.649 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:10.649 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:11.417 INFO:teuthology.orchestra.run.smithi063.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:11.433 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/138 2024-03-26T07:32:11.433 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/138 2024-03-26T07:32:11.433 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:11.445 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:11.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:11.570 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-03-26T07:32:12.244 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:12.258 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:12.260 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:12.263 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:12.263 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:12.941 INFO:teuthology.orchestra.run.smithi063.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:12.953 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/139 2024-03-26T07:32:12.953 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/139 2024-03-26T07:32:12.953 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:12.962 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:13.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:13.072 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-03-26T07:32:13.747 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:13.761 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:13.763 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:13.766 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:13.766 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:14.503 INFO:teuthology.orchestra.run.smithi063.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:14.518 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/140 2024-03-26T07:32:14.518 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/140 2024-03-26T07:32:14.519 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:14.531 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:14.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:14.633 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-03-26T07:32:15.303 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:15.316 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:15.317 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:15.320 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:15.320 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:16.270 INFO:teuthology.orchestra.run.smithi063.stdout:generic/141 1s 2024-03-26T07:32:16.288 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/141 2024-03-26T07:32:16.288 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:16.298 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:16.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:16.329 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-03-26T07:32:16.943 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:16.957 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:16.959 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:16.964 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:16.964 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:17.748 INFO:teuthology.orchestra.run.smithi063.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:17.761 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/142 2024-03-26T07:32:17.761 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/142 2024-03-26T07:32:17.761 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:17.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:17.851 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-03-26T07:32:18.571 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:18.586 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:18.587 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:18.590 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:18.591 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:19.319 INFO:teuthology.orchestra.run.smithi063.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:19.332 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/143 2024-03-26T07:32:19.332 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/143 2024-03-26T07:32:19.332 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:19.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:19.464 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-03-26T07:32:20.135 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:20.149 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:20.151 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:20.154 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:20.154 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:20.897 INFO:teuthology.orchestra.run.smithi063.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:20.911 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/144 2024-03-26T07:32:20.911 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/144 2024-03-26T07:32:20.911 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:21.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:21.020 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-03-26T07:32:21.555 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:32:21.560 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:32:21.679 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:21.691 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:21.693 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:21.696 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:21.696 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:22.465 INFO:teuthology.orchestra.run.smithi063.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:22.480 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/145 2024-03-26T07:32:22.481 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/145 2024-03-26T07:32:22.481 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:22.493 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:22.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:22.608 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-03-26T07:32:23.308 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:23.319 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:23.320 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:23.322 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:23.323 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:24.039 INFO:teuthology.orchestra.run.smithi063.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:24.052 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/146 2024-03-26T07:32:24.052 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/146 2024-03-26T07:32:24.052 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:24.062 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:24.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:24.189 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-03-26T07:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:25.575 INFO:teuthology.orchestra.run.smithi063.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:25.590 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/147 2024-03-26T07:32:25.590 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/147 2024-03-26T07:32:25.590 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:25.602 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:25.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:25.718 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-03-26T07:32:26.399 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:26.413 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:26.415 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:26.418 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:27.180 INFO:teuthology.orchestra.run.smithi063.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:27.194 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/148 2024-03-26T07:32:27.194 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/148 2024-03-26T07:32:27.194 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:27.206 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:27.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:27.331 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-03-26T07:32:28.027 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:28.041 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:28.043 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:28.046 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:28.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:28.811 INFO:teuthology.orchestra.run.smithi063.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:28.826 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/149 2024-03-26T07:32:28.827 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/149 2024-03-26T07:32:28.827 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:28.838 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:28.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:28.959 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-03-26T07:32:29.621 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:29.634 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:29.635 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:29.638 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:30.416 INFO:teuthology.orchestra.run.smithi063.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/150 2024-03-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/150 2024-03-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:30.439 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:30.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:30.549 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-03-26T07:32:31.258 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:31.273 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:31.274 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:31.278 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:31.278 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:32.010 INFO:teuthology.orchestra.run.smithi063.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:32.024 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/151 2024-03-26T07:32:32.024 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/151 2024-03-26T07:32:32.024 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:32.038 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:32.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:32.139 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-03-26T07:32:32.836 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:32.850 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:32.851 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:32.854 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:32.855 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:33.539 INFO:teuthology.orchestra.run.smithi063.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:33.555 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/152 2024-03-26T07:32:33.555 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/152 2024-03-26T07:32:33.555 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:33.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:33.687 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-03-26T07:32:34.350 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:34.364 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:34.366 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:34.369 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:34.369 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:35.103 INFO:teuthology.orchestra.run.smithi063.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:35.119 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/153 2024-03-26T07:32:35.120 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/153 2024-03-26T07:32:35.120 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:35.131 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:35.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:35.227 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-03-26T07:32:35.923 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:35.938 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:35.940 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:35.943 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:35.943 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:36.677 INFO:teuthology.orchestra.run.smithi063.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:36.690 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/154 2024-03-26T07:32:36.691 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/154 2024-03-26T07:32:36.691 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:36.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:36.818 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-03-26T07:32:37.504 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:37.518 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:37.520 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:37.523 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:37.524 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:38.220 INFO:teuthology.orchestra.run.smithi063.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:38.235 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/155 2024-03-26T07:32:38.235 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/155 2024-03-26T07:32:38.235 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:38.247 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:38.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:38.359 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-03-26T07:32:39.037 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:39.053 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:39.056 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:39.056 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:39.806 INFO:teuthology.orchestra.run.smithi063.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:39.820 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/156 2024-03-26T07:32:39.820 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/156 2024-03-26T07:32:39.820 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:39.831 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:39.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:39.940 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-03-26T07:32:40.614 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:40.627 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:40.629 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:40.633 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:40.633 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:41.418 INFO:teuthology.orchestra.run.smithi063.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:32:41.433 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/157 2024-03-26T07:32:41.434 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/157 2024-03-26T07:32:41.434 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:41.445 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:41.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:41.570 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-03-26T07:32:42.241 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:42.251 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:42.252 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:42.255 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:42.255 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:42.986 INFO:teuthology.orchestra.run.smithi063.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-26T07:32:43.001 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/158 2024-03-26T07:32:43.001 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/158 2024-03-26T07:32:43.001 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:43.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:43.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:43.137 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-03-26T07:32:43.816 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:43.831 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:43.832 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:43.836 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:43.836 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:44.555 INFO:teuthology.orchestra.run.smithi063.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-03-26T07:32:44.572 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/159 2024-03-26T07:32:44.572 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/159 2024-03-26T07:32:44.572 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:44.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:44.644 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-03-26T07:32:45.289 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:45.304 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:45.306 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:45.309 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:45.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:46.025 INFO:teuthology.orchestra.run.smithi063.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-03-26T07:32:46.040 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/160 2024-03-26T07:32:46.041 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/160 2024-03-26T07:32:46.041 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:46.053 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:46.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:46.115 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-03-26T07:32:46.737 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:46.751 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:46.753 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:46.756 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:46.756 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:47.737 INFO:teuthology.orchestra.run.smithi063.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:32:47.767 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/161 2024-03-26T07:32:47.767 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/161 2024-03-26T07:32:47.767 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:47.783 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:48.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:48.000 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-03-26T07:32:48.527 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:48.542 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:48.543 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:48.547 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:48.547 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:49.456 INFO:teuthology.orchestra.run.smithi063.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-26T07:32:49.546 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/162 2024-03-26T07:32:49.546 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/162 2024-03-26T07:32:49.546 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:49.558 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:49.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:49.789 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-03-26T07:32:50.335 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:50.348 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:50.350 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:50.353 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:50.353 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:51.270 INFO:teuthology.orchestra.run.smithi063.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-26T07:32:51.370 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/163 2024-03-26T07:32:51.370 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/163 2024-03-26T07:32:51.370 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:51.378 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:51.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:51.637 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-03-26T07:32:51.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:32:51.693 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:32:52.167 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:52.180 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:52.181 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:52.184 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:52.184 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:53.233 INFO:teuthology.orchestra.run.smithi063.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:32:53.258 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/164 2024-03-26T07:32:53.258 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/164 2024-03-26T07:32:53.258 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:53.271 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:53.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:53.456 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-03-26T07:32:53.989 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:54.001 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:54.002 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:54.004 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:54.005 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:54.999 INFO:teuthology.orchestra.run.smithi063.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:32:55.015 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/165 2024-03-26T07:32:55.015 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/165 2024-03-26T07:32:55.015 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:55.034 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:55.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:55.175 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-03-26T07:32:55.728 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:55.741 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:55.743 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:55.746 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:56.731 INFO:teuthology.orchestra.run.smithi063.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:32:56.752 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/166 2024-03-26T07:32:56.754 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/166 2024-03-26T07:32:56.754 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:56.768 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:56.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:56.974 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-03-26T07:32:57.503 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:57.516 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:57.518 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:57.521 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:57.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:58.526 INFO:teuthology.orchestra.run.smithi063.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:32:58.541 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/167 2024-03-26T07:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/167 2024-03-26T07:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:32:58.554 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:32:58.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:32:58.750 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-03-26T07:32:59.317 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:32:59.331 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:32:59.332 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:00.416 INFO:teuthology.orchestra.run.smithi063.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:00.438 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/168 2024-03-26T07:33:00.438 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/168 2024-03-26T07:33:00.438 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:00.451 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:00.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:00.637 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-03-26T07:33:01.176 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:01.191 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:01.192 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:01.195 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:02.425 INFO:teuthology.orchestra.run.smithi063.stdout:generic/169 1s 2024-03-26T07:33:02.443 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/169 2024-03-26T07:33:02.443 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:02.452 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:02.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:02.481 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-03-26T07:33:03.095 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:03.109 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:03.111 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:03.114 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:04.154 INFO:teuthology.orchestra.run.smithi063.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:04.181 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/170 2024-03-26T07:33:04.181 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/170 2024-03-26T07:33:04.181 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:04.198 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:04.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:04.439 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-03-26T07:33:04.963 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:04.977 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:04.979 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:04.982 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:04.982 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/171 2024-03-26T07:33:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/171 2024-03-26T07:33:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:06.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:06.232 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-03-26T07:33:06.790 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:06.807 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:06.809 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:06.813 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:07.859 INFO:teuthology.orchestra.run.smithi063.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:07.879 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/172 2024-03-26T07:33:07.880 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/172 2024-03-26T07:33:07.880 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:07.892 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:08.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:08.100 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-03-26T07:33:08.656 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:08.669 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:08.670 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:08.674 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:09.753 INFO:teuthology.orchestra.run.smithi063.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:09.775 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/173 2024-03-26T07:33:09.775 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/173 2024-03-26T07:33:09.776 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:10.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:10.092 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-03-26T07:33:10.555 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:10.568 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:10.569 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:10.573 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:10.573 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:11.645 INFO:teuthology.orchestra.run.smithi063.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:11.661 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/174 2024-03-26T07:33:11.661 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/174 2024-03-26T07:33:11.662 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:11.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:11.793 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-03-26T07:33:12.399 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:12.415 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:12.418 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:12.422 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:12.422 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:13.417 INFO:teuthology.orchestra.run.smithi063.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:13.439 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/175 2024-03-26T07:33:13.439 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/175 2024-03-26T07:33:13.440 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:13.453 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:13.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:13.600 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-03-26T07:33:14.165 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:14.179 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:14.181 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:14.184 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:14.184 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:15.146 INFO:teuthology.orchestra.run.smithi063.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:15.168 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/176 2024-03-26T07:33:15.168 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/176 2024-03-26T07:33:15.168 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:15.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:15.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:15.304 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-03-26T07:33:15.883 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:15.898 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:15.899 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:15.903 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:15.903 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:16.943 INFO:teuthology.orchestra.run.smithi063.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-26T07:33:16.956 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/177 2024-03-26T07:33:16.956 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/177 2024-03-26T07:33:16.956 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:16.966 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:17.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:17.083 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-03-26T07:33:17.742 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:17.755 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:17.757 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:17.759 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:17.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:18.499 INFO:teuthology.orchestra.run.smithi063.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:33:18.511 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/178 2024-03-26T07:33:18.512 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/178 2024-03-26T07:33:18.512 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:18.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:18.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:18.641 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-03-26T07:33:19.324 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:19.338 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:19.339 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:19.342 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:20.076 INFO:teuthology.orchestra.run.smithi063.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:33:20.088 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/179 2024-03-26T07:33:20.089 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/179 2024-03-26T07:33:20.089 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:20.099 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:20.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:20.226 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-03-26T07:33:20.915 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:20.930 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:20.932 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:20.936 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:21.718 INFO:teuthology.orchestra.run.smithi063.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:33:21.732 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/180 2024-03-26T07:33:21.733 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/180 2024-03-26T07:33:21.733 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:21.745 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:21.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:33:21.829 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:33:21.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:21.866 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-03-26T07:33:22.548 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:22.564 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:22.565 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:22.569 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:22.569 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:23.346 INFO:teuthology.orchestra.run.smithi063.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:33:23.361 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/181 2024-03-26T07:33:23.361 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/181 2024-03-26T07:33:23.361 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:23.372 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:23.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:23.468 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-03-26T07:33:24.166 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:24.181 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:24.183 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:24.186 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:24.186 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:24.951 INFO:teuthology.orchestra.run.smithi063.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-26T07:33:24.966 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/182 2024-03-26T07:33:24.966 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/182 2024-03-26T07:33:24.966 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:24.978 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:25.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:25.104 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-03-26T07:33:25.803 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:25.818 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:25.820 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:25.823 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:26.803 INFO:teuthology.orchestra.run.smithi063.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:26.822 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/183 2024-03-26T07:33:26.822 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/183 2024-03-26T07:33:26.822 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:26.835 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:26.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:26.930 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-03-26T07:33:27.530 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:27.545 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:27.547 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:27.551 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:27.551 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:28.320 INFO:teuthology.orchestra.run.smithi063.stdout:generic/184 1s 2024-03-26T07:33:28.343 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/184 2024-03-26T07:33:28.343 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:28.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:28.407 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-03-26T07:33:29.018 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:29.034 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:29.036 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:29.040 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:29.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:30.050 INFO:teuthology.orchestra.run.smithi063.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:30.073 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/185 2024-03-26T07:33:30.073 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/185 2024-03-26T07:33:30.074 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:30.088 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:30.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:30.238 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-03-26T07:33:30.804 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:30.816 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:30.817 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:30.820 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:30.820 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:31.873 INFO:teuthology.orchestra.run.smithi063.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:31.892 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/186 2024-03-26T07:33:31.892 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/186 2024-03-26T07:33:31.892 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:31.904 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:32.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:32.026 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-03-26T07:33:32.608 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:32.624 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:32.629 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:33.639 INFO:teuthology.orchestra.run.smithi063.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:33.653 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/187 2024-03-26T07:33:33.653 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/187 2024-03-26T07:33:33.653 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:33.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:33.943 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-03-26T07:33:34.444 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:35.455 INFO:teuthology.orchestra.run.smithi063.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:35.471 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/188 2024-03-26T07:33:35.471 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/188 2024-03-26T07:33:35.472 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:35.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:35.710 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-03-26T07:33:36.260 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:36.275 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:36.276 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:36.280 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:36.280 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/189 2024-03-26T07:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/189 2024-03-26T07:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:37.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:37.591 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-03-26T07:33:38.127 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:38.142 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:38.144 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:38.147 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:38.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:39.216 INFO:teuthology.orchestra.run.smithi063.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:39.228 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/190 2024-03-26T07:33:39.229 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/190 2024-03-26T07:33:39.229 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:39.245 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:39.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:39.344 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-03-26T07:33:39.933 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:39.948 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:39.950 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:39.953 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:39.954 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:40.938 INFO:teuthology.orchestra.run.smithi063.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:40.958 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/191 2024-03-26T07:33:40.958 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/191 2024-03-26T07:33:40.958 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:40.972 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:41.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:41.089 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-03-26T07:33:41.639 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:41.652 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:41.654 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:41.657 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:42.351 INFO:teuthology.orchestra.run.smithi063.stdout:generic/192 [not run] atime not maintained by ceph 2024-03-26T07:33:42.364 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/192 2024-03-26T07:33:42.364 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/192 2024-03-26T07:33:42.364 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:42.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:42.411 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-03-26T07:33:43.019 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:43.034 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:43.036 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:43.040 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:43.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:45.662 INFO:teuthology.orchestra.run.smithi063.stdout:generic/193 2s 2024-03-26T07:33:45.679 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/193 2024-03-26T07:33:45.679 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:45.688 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:45.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:45.808 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-03-26T07:33:46.493 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:46.504 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:46.505 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:46.508 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:46.508 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:47.547 INFO:teuthology.orchestra.run.smithi063.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:47.568 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/194 2024-03-26T07:33:47.568 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/194 2024-03-26T07:33:47.568 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:47.579 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:47.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:47.776 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-03-26T07:33:48.351 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:48.365 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:48.366 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:48.370 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:48.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:49.357 INFO:teuthology.orchestra.run.smithi063.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:49.374 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/195 2024-03-26T07:33:49.374 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/195 2024-03-26T07:33:49.374 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:49.386 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:49.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:49.569 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-03-26T07:33:50.126 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:50.141 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:50.143 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:50.147 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:50.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:51.204 INFO:teuthology.orchestra.run.smithi063.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:51.232 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/196 2024-03-26T07:33:51.232 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/196 2024-03-26T07:33:51.232 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:51.251 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:51.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:51.438 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-03-26T07:33:52.021 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:52.035 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:52.037 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:52.040 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:52.045 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:33:52.051 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:33:52.966 INFO:teuthology.orchestra.run.smithi063.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:52.986 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/197 2024-03-26T07:33:52.986 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/197 2024-03-26T07:33:52.986 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:53.000 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:53.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:53.113 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-03-26T07:33:53.744 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:53.758 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:53.759 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:53.763 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:53.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:55.356 INFO:teuthology.orchestra.run.smithi063.stdout:generic/198 [failed, exit status 10]- output mismatch (see /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/198.out.bad) 2024-03-26T07:33:55.379 INFO:teuthology.orchestra.run.smithi063.stdout: --- tests/generic/198.out 2024-03-26 06:18:43.824449989 +0000 2024-03-26T07:33:55.379 INFO:teuthology.orchestra.run.smithi063.stdout: +++ /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/198.out.bad 2024-03-26 07:33:55.351806375 +0000 2024-03-26T07:33:55.379 INFO:teuthology.orchestra.run.smithi063.stdout: @@ -1,2 +1,5 @@ 2024-03-26T07:33:55.379 INFO:teuthology.orchestra.run.smithi063.stdout: QA output created by 198 2024-03-26T07:33:55.379 INFO:teuthology.orchestra.run.smithi063.stdout: Silence is golden. 2024-03-26T07:33:55.379 INFO:teuthology.orchestra.run.smithi063.stdout: +non one buffer at buf[0] => 0x00,00,00,00 2024-03-26T07:33:55.379 INFO:teuthology.orchestra.run.smithi063.stdout: +non-one read at offset 0 2024-03-26T07:33:55.379 INFO:teuthology.orchestra.run.smithi063.stdout: +*** WARNING *** /tmp/tmp.LsIyRsPUXptest/aiodio_sparse has not been unlinked; if you don't rm it manually first, it may influence the next run 2024-03-26T07:33:55.392 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/198 2024-03-26T07:33:55.393 INFO:teuthology.orchestra.run.smithi063.stdout:Failures: generic/198 2024-03-26T07:33:55.393 INFO:teuthology.orchestra.run.smithi063.stdout:Failed 1 of 1 tests 2024-03-26T07:33:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:55.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T07:33:55.449 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-26T07:33:55.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-26T07:33:55.449 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-03-26T07:33:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:56.042 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:56.045 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:56.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:57.065 INFO:teuthology.orchestra.run.smithi063.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:57.085 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/199 2024-03-26T07:33:57.085 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/199 2024-03-26T07:33:57.085 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:57.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:57.226 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-03-26T07:33:57.774 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:57.789 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:57.792 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:57.796 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:57.796 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:58.813 INFO:teuthology.orchestra.run.smithi063.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:33:58.840 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/200 2024-03-26T07:33:58.840 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/200 2024-03-26T07:33:58.840 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:33:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:33:59.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:33:59.064 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-03-26T07:33:59.605 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:33:59.618 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:33:59.620 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:33:59.623 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:33:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:00.656 INFO:teuthology.orchestra.run.smithi063.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:34:00.672 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/201 2024-03-26T07:34:00.673 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/201 2024-03-26T07:34:00.673 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:34:00.685 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:00.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:34:00.827 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-03-26T07:34:01.411 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:34:01.425 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:34:01.426 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:34:01.430 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:34:01.430 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:02.438 INFO:teuthology.orchestra.run.smithi063.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:34:02.460 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/202 2024-03-26T07:34:02.460 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/202 2024-03-26T07:34:02.461 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:34:02.483 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:02.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:34:02.687 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-03-26T07:34:03.200 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:34:03.214 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:34:03.216 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:34:03.219 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:34:03.220 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:04.204 INFO:teuthology.orchestra.run.smithi063.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:34:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/203 2024-03-26T07:34:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/203 2024-03-26T07:34:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:34:04.246 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:04.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:34:04.473 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-03-26T07:34:04.999 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:34:05.014 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:34:05.015 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:34:05.019 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:34:05.019 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:06.413 INFO:teuthology.orchestra.run.smithi063.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:34:06.429 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/204 2024-03-26T07:34:06.429 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/204 2024-03-26T07:34:06.429 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:34:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:06.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:34:06.488 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-03-26T07:34:07.147 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:34:07.163 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:34:07.164 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:34:07.168 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:34:07.168 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:08.178 INFO:teuthology.orchestra.run.smithi063.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:34:08.195 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/205 2024-03-26T07:34:08.195 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/205 2024-03-26T07:34:08.196 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:34:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:08.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:34:08.344 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-03-26T07:34:08.919 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:34:08.932 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:34:08.933 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:34:08.936 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:34:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:09.937 INFO:teuthology.orchestra.run.smithi063.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:34:09.953 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/206 2024-03-26T07:34:09.953 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/206 2024-03-26T07:34:09.954 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:34:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:10.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:34:10.174 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-03-26T07:34:10.704 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:34:10.716 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:34:10.717 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:34:10.720 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:34:10.720 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:20.023 INFO:teuthology.orchestra.run.smithi063.stdout:generic/207 10s 2024-03-26T07:34:20.041 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/207 2024-03-26T07:34:20.041 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:34:20.050 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:20.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:34:20.152 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-03-26T07:34:20.841 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:34:20.854 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:34:20.855 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:34:20.858 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:34:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:34:22.183 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:34:22.196 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:34:52.319 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:34:52.327 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:35:22.473 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:35:22.485 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:35:52.623 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:35:52.633 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:36:23.186 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:36:23.196 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:36:24.201 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T07:36:24.202+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48125) UID: 0 2024-03-26T07:36:24.202 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T07:36:24.202+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48125) UID: 0 2024-03-26T07:36:24.202 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T07:36:24.202+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48125) UID: 0 2024-03-26T07:36:24.203 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T07:36:24.202+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48125) UID: 0 2024-03-26T07:37:41.723 INFO:teuthology.orchestra.run.smithi063.stdout:generic/208 200s 2024-03-26T07:37:41.740 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/208 2024-03-26T07:37:41.740 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:37:41.749 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:37:41.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:37:41.861 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-03-26T07:37:42.552 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:37:42.566 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:37:42.568 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:37:42.571 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:37:42.571 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:20.159 INFO:teuthology.orchestra.run.smithi063.stdout:generic/209 38s 2024-03-26T07:38:20.177 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/209 2024-03-26T07:38:20.177 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:20.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:20.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:20.275 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-03-26T07:38:20.968 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:20.983 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:20.985 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:20.988 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:21.839 INFO:teuthology.orchestra.run.smithi063.stdout:generic/210 0s 2024-03-26T07:38:21.859 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/210 2024-03-26T07:38:21.859 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:21.869 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:21.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:21.975 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-03-26T07:38:22.678 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:22.692 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:22.694 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:22.698 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:22.698 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout:generic/211 1s 2024-03-26T07:38:23.889 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/211 2024-03-26T07:38:23.889 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:23.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:23.938 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-03-26T07:38:24.549 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:24.563 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:24.564 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:24.567 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:24.567 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:25.448 INFO:teuthology.orchestra.run.smithi063.stdout:generic/212 1s 2024-03-26T07:38:25.466 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/212 2024-03-26T07:38:25.466 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:25.475 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:25.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:25.513 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-03-26T07:38:26.167 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:26.184 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:26.185 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:26.188 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:26.188 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:26.899 INFO:teuthology.orchestra.run.smithi063.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:38:26.912 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/213 2024-03-26T07:38:26.912 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/213 2024-03-26T07:38:26.912 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:26.921 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:26.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:26.959 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-03-26T07:38:27.604 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:27.620 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:27.622 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:27.625 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:27.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/214 2024-03-26T07:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/214 2024-03-26T07:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:28.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:28.397 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-03-26T07:38:29.041 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:29.054 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:29.056 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:29.060 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:31.873 INFO:teuthology.orchestra.run.smithi063.stdout:generic/215 2s 2024-03-26T07:38:31.891 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/215 2024-03-26T07:38:31.892 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:31.901 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:31.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:31.977 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-03-26T07:38:32.601 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:32.617 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:32.619 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:32.622 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:32.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:38:33.679 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/216 2024-03-26T07:38:33.679 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/216 2024-03-26T07:38:33.680 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:33.694 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:33.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:33.836 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-03-26T07:38:34.435 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:34.450 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:34.452 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:35.481 INFO:teuthology.orchestra.run.smithi063.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:38:35.496 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/217 2024-03-26T07:38:35.497 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/217 2024-03-26T07:38:35.497 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:35.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:35.686 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-03-26T07:38:36.226 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:36.239 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:36.241 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:36.243 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:36.244 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:38:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/218 2024-03-26T07:38:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/218 2024-03-26T07:38:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:37.273 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:37.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:37.418 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-03-26T07:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:37.972 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:37.973 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:38.632 INFO:teuthology.orchestra.run.smithi063.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:38:38.646 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/219 2024-03-26T07:38:38.646 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/219 2024-03-26T07:38:38.646 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:38.655 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:38.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:38.693 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-03-26T07:38:39.310 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:39.324 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:39.325 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:39.328 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:39.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:40.363 INFO:teuthology.orchestra.run.smithi063.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:38:40.396 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/220 2024-03-26T07:38:40.397 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/220 2024-03-26T07:38:40.397 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:40.414 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:40.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:40.604 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-03-26T07:38:41.127 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:41.141 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:41.143 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:41.147 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:41.147 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:42.899 INFO:teuthology.orchestra.run.smithi063.stdout:generic/221 1s 2024-03-26T07:38:42.923 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/221 2024-03-26T07:38:42.924 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:42.936 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:42.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:42.985 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-03-26T07:38:43.624 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:43.638 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:43.640 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:43.644 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:43.644 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:44.638 INFO:teuthology.orchestra.run.smithi063.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:38:44.657 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/222 2024-03-26T07:38:44.659 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/222 2024-03-26T07:38:44.659 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:44.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:44.836 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-03-26T07:38:45.426 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:45.441 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:45.443 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:45.446 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:45.446 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/223 2024-03-26T07:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/223 2024-03-26T07:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:46.189 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:46.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:46.239 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-03-26T07:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:47.621 INFO:teuthology.orchestra.run.smithi063.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:38:47.633 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/224 2024-03-26T07:38:47.633 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/224 2024-03-26T07:38:47.633 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:47.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:47.683 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-03-26T07:38:48.300 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:48.316 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:48.318 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:48.322 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:48.323 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:49.099 INFO:teuthology.orchestra.run.smithi063.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-26T07:38:49.113 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/225 2024-03-26T07:38:49.113 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/225 2024-03-26T07:38:49.113 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:49.122 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:49.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:49.223 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-03-26T07:38:49.875 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:49.887 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:49.888 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:49.891 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:49.891 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:50.632 INFO:teuthology.orchestra.run.smithi063.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:38:50.646 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/226 2024-03-26T07:38:50.646 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/226 2024-03-26T07:38:50.647 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:50.657 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:50.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:50.697 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-03-26T07:38:51.327 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:51.343 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:51.345 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:51.348 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:51.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:52.412 INFO:teuthology.orchestra.run.smithi063.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:38:52.434 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/227 2024-03-26T07:38:52.434 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/227 2024-03-26T07:38:52.434 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:52.450 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:52.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:52.544 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-03-26T07:38:53.147 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:53.164 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:53.166 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:53.170 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:53.917 INFO:teuthology.orchestra.run.smithi063.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:38:53.932 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/228 2024-03-26T07:38:53.932 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/228 2024-03-26T07:38:53.932 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:53.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:53.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:53.985 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-03-26T07:38:54.638 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:54.654 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:54.656 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:54.660 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:54.660 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:55.689 INFO:teuthology.orchestra.run.smithi063.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:38:55.712 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/229 2024-03-26T07:38:55.713 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/229 2024-03-26T07:38:55.713 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:55.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:55.814 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-03-26T07:38:56.436 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:56.451 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:56.453 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:56.457 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:56.457 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:57.145 INFO:teuthology.orchestra.run.smithi063.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:38:57.159 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/230 2024-03-26T07:38:57.159 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/230 2024-03-26T07:38:57.159 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:57.168 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:57.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:57.210 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-03-26T07:38:57.848 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:57.863 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:57.865 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:57.869 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:57.869 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:58.543 INFO:teuthology.orchestra.run.smithi063.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:38:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/231 2024-03-26T07:38:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/231 2024-03-26T07:38:58.555 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:58.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:58.600 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-03-26T07:38:59.213 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:38:59.227 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:38:59.229 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:38:59.233 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:38:59.233 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:59.895 INFO:teuthology.orchestra.run.smithi063.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:38:59.908 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/232 2024-03-26T07:38:59.908 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/232 2024-03-26T07:38:59.908 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:38:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:38:59.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:38:59.957 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-03-26T07:39:00.592 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:39:00.606 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:39:00.607 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:39:00.614 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:39:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:01.267 INFO:teuthology.orchestra.run.smithi063.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:39:01.280 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/233 2024-03-26T07:39:01.280 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/233 2024-03-26T07:39:01.280 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:39:01.289 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:01.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:39:01.329 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-03-26T07:39:01.964 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:39:01.980 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:39:01.982 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:39:01.986 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:39:01.986 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:02.670 INFO:teuthology.orchestra.run.smithi063.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:39:02.684 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/234 2024-03-26T07:39:02.685 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/234 2024-03-26T07:39:02.685 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:39:02.697 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:02.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:39:02.743 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-03-26T07:39:03.361 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:39:03.376 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:39:03.378 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:39:03.381 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:39:03.381 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:04.045 INFO:teuthology.orchestra.run.smithi063.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:39:04.061 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/235 2024-03-26T07:39:04.061 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/235 2024-03-26T07:39:04.062 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:39:04.073 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:04.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:39:04.120 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-03-26T07:39:04.769 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:39:04.783 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:39:04.785 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:39:04.788 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:39:04.788 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:06.659 INFO:teuthology.orchestra.run.smithi063.stdout:generic/236 1s 2024-03-26T07:39:06.676 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/236 2024-03-26T07:39:06.677 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:39:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:06.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:39:06.795 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-03-26T07:39:07.462 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:39:07.476 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:39:07.478 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:39:07.481 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:39:07.481 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:08.382 INFO:teuthology.orchestra.run.smithi063.stdout:generic/237 1s 2024-03-26T07:39:08.400 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/237 2024-03-26T07:39:08.400 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:39:08.409 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:08.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:39:08.502 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-03-26T07:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/238 2024-03-26T07:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/238 2024-03-26T07:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:10.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:39:10.416 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-03-26T07:39:10.964 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:39:10.979 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:39:10.980 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:39:10.983 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:39:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:11.708 INFO:teuthology.orchestra.run.smithi063.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-03-26T07:39:11.721 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/239 2024-03-26T07:39:11.721 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/239 2024-03-26T07:39:11.721 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:39:11.730 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:11.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:39:11.789 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-03-26T07:39:12.390 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:39:12.405 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:39:12.406 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:39:12.410 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:39:12.410 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:13.181 INFO:teuthology.orchestra.run.smithi063.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-03-26T07:39:13.196 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/240 2024-03-26T07:39:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/240 2024-03-26T07:39:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:39:13.207 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:13.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:39:13.260 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-03-26T07:39:13.872 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:39:13.888 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:39:13.889 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:39:13.893 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:39:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:39:32.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:39:32.150 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:40:02.389 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:40:02.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:40:27.698 INFO:teuthology.orchestra.run.smithi063.stdout:generic/241 73s 2024-03-26T07:40:27.715 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/241 2024-03-26T07:40:27.715 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:28.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:28.355 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-03-26T07:40:29.314 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:29.324 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:29.325 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:29.328 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:29.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:30.281 INFO:teuthology.orchestra.run.smithi063.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:40:30.297 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/242 2024-03-26T07:40:30.297 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/242 2024-03-26T07:40:30.297 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:30.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:30.499 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-03-26T07:40:31.041 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:31.056 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:31.058 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:31.061 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:32.085 INFO:teuthology.orchestra.run.smithi063.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:40:32.109 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/243 2024-03-26T07:40:32.110 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/243 2024-03-26T07:40:32.110 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:32.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:32.294 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-03-26T07:40:32.529 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:40:32.537 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:40:32.853 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:32.867 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:32.869 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:32.872 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:32.872 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:33.527 INFO:teuthology.orchestra.run.smithi063.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:40:33.543 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/244 2024-03-26T07:40:33.543 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/244 2024-03-26T07:40:33.543 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:33.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:33.603 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-03-26T07:40:34.245 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:34.265 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:34.266 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:35.142 INFO:teuthology.orchestra.run.smithi063.stdout:generic/245 1s 2024-03-26T07:40:35.159 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/245 2024-03-26T07:40:35.159 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:35.168 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:35.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:35.273 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-03-26T07:40:35.955 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:35.968 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:35.969 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:35.973 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:35.973 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:38.361 INFO:teuthology.orchestra.run.smithi063.stdout:generic/246 2s 2024-03-26T07:40:38.381 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/246 2024-03-26T07:40:38.381 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:38.390 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:38.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:38.481 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-03-26T07:40:39.154 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:39.167 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:39.169 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:39.171 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:50.578 INFO:teuthology.orchestra.run.smithi063.stdout:generic/247 11s 2024-03-26T07:40:50.592 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/247 2024-03-26T07:40:50.592 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:50.598 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:50.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:50.623 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-03-26T07:40:51.221 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:51.234 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:51.236 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:51.240 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:51.240 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:52.005 INFO:teuthology.orchestra.run.smithi063.stdout:generic/248 0s 2024-03-26T07:40:52.024 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/248 2024-03-26T07:40:52.025 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:52.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:52.087 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-03-26T07:40:52.724 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:52.739 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:52.741 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:52.745 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:52.745 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:53.917 INFO:teuthology.orchestra.run.smithi063.stdout:generic/249 1s 2024-03-26T07:40:53.935 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/249 2024-03-26T07:40:53.935 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:53.945 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:54.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:54.076 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-03-26T07:40:54.793 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:54.808 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:54.809 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:54.812 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:54.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:55.528 INFO:teuthology.orchestra.run.smithi063.stdout:generic/250 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:40:55.543 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/250 2024-03-26T07:40:55.544 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/250 2024-03-26T07:40:55.544 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:55.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:55.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:55.601 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-03-26T07:40:56.276 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:56.292 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:56.293 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:56.297 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:56.297 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:57.146 INFO:teuthology.orchestra.run.smithi063.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:57.170 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/251 2024-03-26T07:40:57.170 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/251 2024-03-26T07:40:57.170 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:57.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:57.224 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-03-26T07:40:57.825 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:57.839 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:57.840 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:57.843 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:57.843 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:58.553 INFO:teuthology.orchestra.run.smithi063.stdout:generic/252 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:40:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/252 2024-03-26T07:40:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/252 2024-03-26T07:40:58.568 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:40:58.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:40:58.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:40:58.621 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-03-26T07:40:59.271 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:40:59.285 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:40:59.286 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:40:59.289 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:40:59.290 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:00.282 INFO:teuthology.orchestra.run.smithi063.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:00.298 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/253 2024-03-26T07:41:00.298 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/253 2024-03-26T07:41:00.298 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:00.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:00.627 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-03-26T07:41:01.166 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:01.181 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:01.183 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:01.186 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:01.186 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:02.204 INFO:teuthology.orchestra.run.smithi063.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:02.222 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/254 2024-03-26T07:41:02.223 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/254 2024-03-26T07:41:02.223 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:02.242 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:02.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:02.501 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-03-26T07:41:02.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:41:02.944 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:41:03.001 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:03.013 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:03.015 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:03.017 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:03.985 INFO:teuthology.orchestra.run.smithi063.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:41:04.002 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/255 2024-03-26T07:41:04.002 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/255 2024-03-26T07:41:04.002 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:04.014 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:04.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:04.143 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-03-26T07:41:04.827 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:04.840 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:04.842 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:04.845 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:04.845 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:06.253 INFO:teuthology.orchestra.run.smithi063.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:41:06.265 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/256 2024-03-26T07:41:06.265 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/256 2024-03-26T07:41:06.265 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:06.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:06.315 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-03-26T07:41:06.894 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:06.909 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:06.911 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:06.915 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:08.828 INFO:teuthology.orchestra.run.smithi063.stdout:generic/257 1s 2024-03-26T07:41:08.844 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/257 2024-03-26T07:41:08.844 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:08.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:08.957 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-03-26T07:41:09.654 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:09.664 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:09.666 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:09.668 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:10.327 INFO:teuthology.orchestra.run.smithi063.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-03-26T07:41:10.340 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/258 2024-03-26T07:41:10.340 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/258 2024-03-26T07:41:10.340 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:10.350 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:10.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:10.389 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-03-26T07:41:11.014 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:11.028 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:11.030 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:11.033 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:11.033 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:12.048 INFO:teuthology.orchestra.run.smithi063.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:12.074 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/259 2024-03-26T07:41:12.074 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/259 2024-03-26T07:41:12.074 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:12.086 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:12.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:12.309 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-03-26T07:41:12.850 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:12.866 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:12.869 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:12.873 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:12.873 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:13.768 INFO:teuthology.orchestra.run.smithi063.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:13.789 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/260 2024-03-26T07:41:13.789 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/260 2024-03-26T07:41:13.789 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:13.798 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:13.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:13.841 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-03-26T07:41:14.469 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:14.483 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:14.484 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:14.488 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:15.517 INFO:teuthology.orchestra.run.smithi063.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:15.539 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/261 2024-03-26T07:41:15.540 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/261 2024-03-26T07:41:15.540 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:15.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:15.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:15.796 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-03-26T07:41:16.358 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:16.372 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:16.374 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:16.378 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:16.378 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:17.392 INFO:teuthology.orchestra.run.smithi063.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:17.412 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/262 2024-03-26T07:41:17.412 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/262 2024-03-26T07:41:17.412 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:17.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:17.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:17.565 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-03-26T07:41:18.152 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:18.167 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:18.168 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:18.172 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:18.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:33.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:41:33.073 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:41:44.527 INFO:teuthology.orchestra.run.smithi063.stdout:generic/263 [failed, exit status 1]- output mismatch (see /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/263.out.bad) 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: --- tests/generic/263.out 2024-03-26 06:18:43.835449879 +0000 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: +++ /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/263.out.bad 2024-03-26 07:41:44.518917443 +0000 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: @@ -1,3 +1,6750 @@ 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: QA output created by 263 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: fsx -N 10000 -o 8192 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: -fsx -N 10000 -o 128000 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: +Seed set to 1 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode 0, disabling! 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_ZERO_RANGE, disabling! 2024-03-26T07:41:44.556 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support clone range, disabling! 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support dedupe range, disabling! 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +main: filesystem does not support exchange range, disabling! 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +skipping zero size read 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +truncating to largest ever: 0x1f000 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +truncating to largest ever: 0x3a000 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +truncating to largest ever: 0x40000 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +truncating to largest ever: 0x4f000 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +truncating to largest ever: 0x6f000 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +truncating to largest ever: 0x72000 2024-03-26T07:41:44.557 INFO:teuthology.orchestra.run.smithi063.stdout: +copying to largest ever: 0x7a000 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +skipping zero length punch hole 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +READ BAD DATA: offset = 0x37000, size = 0x12a6, fname = /tmp/tmp.LsIyRsPUXptest/junk 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +OFFSET GOOD BAD RANGE 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37000 0xc65f 0x0000 0x0 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37001 0x5fc6 0x0000 0x1 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37002 0xc65c 0x0000 0x2 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37003 0x5cc6 0x0000 0x3 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37004 0xc67d 0x0000 0x4 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37005 0x7dc6 0x0000 0x5 2024-03-26T07:41:44.558 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37006 0xc6cf 0x0000 0x6 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37007 0xcfc6 0x0000 0x7 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37008 0xc6e5 0x0000 0x8 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +0x37009 0xe5c6 0x0000 0x9 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +0x3700a 0xc658 0x0000 0xa 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +0x3700b 0x58c6 0x0000 0xb 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +0x3700c 0xc67d 0x0000 0xc 2024-03-26T07:41:44.559 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +0x3700d 0x7dc6 0x0000 0xd 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +0x3700e 0xc6d0 0x0000 0xe 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +0x3700f 0xd0c6 0x0000 0xf 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +LOG DUMP (6692 total operations): 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +1( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +2( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +3( 3 mod 256): MAPWRITE 0x69000 thru 0x6948f (0x490 bytes) 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +4( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +5( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +6( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.560 INFO:teuthology.orchestra.run.smithi063.stdout: +7( 7 mod 256): MAPREAD 0x24000 thru 0x252b7 (0x12b8 bytes) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +8( 8 mod 256): PUNCH 0x2f0aa thru 0x30bc8 (0x1b1f bytes) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +9( 9 mod 256): PUNCH 0x6338 thru 0x8078 (0x1d41 bytes) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +10( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +11( 11 mod 256): PUNCH 0x33326 thru 0x33877 (0x552 bytes) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +12( 12 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +13( 13 mod 256): MAPREAD 0x2a000 thru 0x2b84b (0x184c bytes) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +14( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +15( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +16( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +17( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +18( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +19( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +20( 20 mod 256): MAPREAD 0x13000 thru 0x13b3a (0xb3b bytes) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +21( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.561 INFO:teuthology.orchestra.run.smithi063.stdout: +22( 22 mod 256): TRUNCATE DOWN from 0x69490 to 0x1f000 ******WWWW 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +23( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +24( 24 mod 256): PUNCH 0x1c5ff thru 0x1e2e9 (0x1ceb bytes) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +25( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +26( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +27( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +28( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +29( 29 mod 256): TRUNCATE UP from 0x1f000 to 0x3a000 ******WWWW 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +30( 30 mod 256): MAPREAD 0x39000 thru 0x390cd (0xce bytes) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +31( 31 mod 256): TRUNCATE UP from 0x3a000 to 0x40000 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +32( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +33( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +34( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.562 INFO:teuthology.orchestra.run.smithi063.stdout: +35( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +36( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +37( 37 mod 256): MAPREAD 0x23000 thru 0x24420 (0x1421 bytes) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +38( 38 mod 256): READ 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +39( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +40( 40 mod 256): PUNCH 0x1d8f1 thru 0x1f1a2 (0x18b2 bytes) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +41( 41 mod 256): PUNCH 0x1bcf8 thru 0x1c24c (0x555 bytes) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +42( 42 mod 256): MAPREAD 0x1d000 thru 0x1d2ab (0x2ac bytes) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +43( 43 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +44( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +45( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +46( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +47( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +48( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +49( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.563 INFO:teuthology.orchestra.run.smithi063.stdout: +50( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +51( 51 mod 256): MAPWRITE 0x14000 thru 0x14c81 (0xc82 bytes) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +52( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +53( 53 mod 256): TRUNCATE DOWN from 0x40000 to 0x16000 ******WWWW 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +54( 54 mod 256): MAPWRITE 0x15000 thru 0x15628 (0x629 bytes) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +55( 55 mod 256): PUNCH 0xad5e thru 0xae53 (0xf6 bytes) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +56( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +57( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +58( 58 mod 256): MAPWRITE 0x34000 thru 0x34c6f (0xc70 bytes) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +59( 59 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +60( 60 mod 256): PUNCH 0x20b22 thru 0x20f00 (0x3df bytes) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +61( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +62( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.564 INFO:teuthology.orchestra.run.smithi063.stdout: +63( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +64( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +65( 65 mod 256): MAPWRITE 0x19000 thru 0x193b6 (0x3b7 bytes) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +66( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +67( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +68( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +69( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +70( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +71( 71 mod 256): PUNCH 0x11014 thru 0x1282b (0x1818 bytes) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +72( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +73( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +74( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +75( 75 mod 256): PUNCH 0x18e0a thru 0x1a043 (0x123a bytes) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +76( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.565 INFO:teuthology.orchestra.run.smithi063.stdout: +77( 77 mod 256): PUNCH 0x2c4bd thru 0x2c688 (0x1cc bytes) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +78( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +79( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +80( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +81( 81 mod 256): PUNCH 0x1cdcd thru 0x1dce2 (0xf16 bytes) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +82( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +83( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +84( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +85( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +86( 86 mod 256): PUNCH 0xbdc thru 0x27cc (0x1bf1 bytes) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +87( 87 mod 256): TRUNCATE DOWN from 0x39000 to 0x16000 ******WWWW 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +88( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +89( 89 mod 256): MAPREAD 0xc000 thru 0xd35c (0x135d bytes) 2024-03-26T07:41:44.566 INFO:teuthology.orchestra.run.smithi063.stdout: +90( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +91( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +92( 92 mod 256): PUNCH 0x10170 thru 0x12055 (0x1ee6 bytes) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +93( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +94( 94 mod 256): PUNCH 0x1925 thru 0x348f (0x1b6b bytes) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +95( 95 mod 256): MAPREAD 0xb000 thru 0xc8f7 (0x18f8 bytes) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +96( 96 mod 256): MAPWRITE 0x38000 thru 0x3909b (0x109c bytes) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +97( 97 mod 256): MAPWRITE 0x3000 thru 0x48f2 (0x18f3 bytes) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +98( 98 mod 256): PUNCH 0x32b99 thru 0x3442f (0x1897 bytes) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +99( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +100(100 mod 256): MAPREAD 0x37000 thru 0x377ef (0x7f0 bytes) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +101(101 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +102(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.567 INFO:teuthology.orchestra.run.smithi063.stdout: +103(103 mod 256): TRUNCATE DOWN from 0x70000 to 0x4f000 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +104(104 mod 256): READ 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +105(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +106(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +107(107 mod 256): TRUNCATE UP from 0x4f000 to 0x6f000 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +108(108 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x66000 thru 0x66fff 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +109(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +110(110 mod 256): COPY 0x5d000 thru 0x5dfff (0x1000 bytes) to 0x24000 thru 0x24fff 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +111(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +112(112 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5b000 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +113(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +114(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +115(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +116(116 mod 256): PUNCH 0x3ad7a thru 0x3c8ca (0x1b51 bytes) 2024-03-26T07:41:44.568 INFO:teuthology.orchestra.run.smithi063.stdout: +117(117 mod 256): WRITE 0xa000 thru 0xafff (0x1000 bytes) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +118(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +119(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +120(120 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +121(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +122(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +123(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +124(124 mod 256): MAPREAD 0x54000 thru 0x55754 (0x1755 bytes) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +125(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +126(126 mod 256): PUNCH 0x5a17e thru 0x5afff (0xe82 bytes) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +127(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +128(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +129(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.569 INFO:teuthology.orchestra.run.smithi063.stdout: +130(130 mod 256): WRITE 0x21000 thru 0x21fff (0x1000 bytes) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +131(131 mod 256): PUNCH 0x14e66 thru 0x16d92 (0x1f2d bytes) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +132(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +133(133 mod 256): MAPWRITE 0xf000 thru 0x1004e (0x104f bytes) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +134(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +135(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +136(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +137(137 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +138(138 mod 256): READ 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +139(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +140(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +141(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +142(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +143(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: +144(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +145(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +146(146 mod 256): MAPWRITE 0x0 thru 0x1cc3 (0x1cc4 bytes) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +147(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +148(148 mod 256): TRUNCATE UP from 0x5b000 to 0x72000 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +149(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +150(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +151(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +152(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +153(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +154(154 mod 256): READ 0x19000 thru 0x19fff (0x1000 bytes) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +155(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +156(156 mod 256): MAPREAD 0x4d000 thru 0x4ecd8 (0x1cd9 bytes) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +157(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.571 INFO:teuthology.orchestra.run.smithi063.stdout: +158(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +159(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +160(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +161(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +162(162 mod 256): PUNCH 0x7c7d thru 0x8bfe (0xf82 bytes) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +163(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +164(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +165(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +166(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +167(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +168(168 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +169(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +170(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +171(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: +172(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +173(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +174(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +175(175 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +176(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +177(177 mod 256): COPY 0x10000 thru 0x10fff (0x1000 bytes) to 0x13000 thru 0x13fff 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +178(178 mod 256): WRITE 0x62000 thru 0x62fff (0x1000 bytes) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +179(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +180(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +181(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +182(182 mod 256): TRUNCATE DOWN from 0x72000 to 0x1d000 ******WWWW 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +183(183 mod 256): MAPREAD 0x18000 thru 0x18c69 (0xc6a bytes) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +184(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +185(185 mod 256): PUNCH 0x33a4 thru 0x414a (0xda7 bytes) 2024-03-26T07:41:44.573 INFO:teuthology.orchestra.run.smithi063.stdout: +186(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +187(187 mod 256): WRITE 0x3e000 thru 0x3efff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +188(188 mod 256): TRUNCATE DOWN from 0x3f000 to 0x29000 ******WWWW 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +189(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +190(190 mod 256): MAPREAD 0x1d000 thru 0x1ec41 (0x1c42 bytes) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +191(191 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +192(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +193(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +194(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +195(195 mod 256): READ 0x23000 thru 0x23fff (0x1000 bytes) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +196(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +197(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +198(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +199(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.574 INFO:teuthology.orchestra.run.smithi063.stdout: +200(200 mod 256): COPY 0x4e000 thru 0x4efff (0x1000 bytes) to 0x51000 thru 0x51fff 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +201(201 mod 256): PUNCH 0xee00 thru 0xef5c (0x15d bytes) 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +202(202 mod 256): TRUNCATE UP from 0x6f000 to 0x72000 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +203(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +204(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +205(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +206(206 mod 256): TRUNCATE DOWN from 0x72000 to 0x15000 ******WWWW 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +207(207 mod 256): TRUNCATE UP from 0x15000 to 0x50000 ******WWWW 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +208(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +209(209 mod 256): WRITE 0x6a000 thru 0x6afff (0x1000 bytes) HOLE 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +210(210 mod 256): PUNCH 0x3052f thru 0x31b9d (0x166f bytes) 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +211(211 mod 256): MAPWRITE 0x5b000 thru 0x5c311 (0x1312 bytes) 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +212(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +213(213 mod 256): READ 0x50000 thru 0x50fff (0x1000 bytes) 2024-03-26T07:41:44.575 INFO:teuthology.orchestra.run.smithi063.stdout: +214(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +215(215 mod 256): MAPWRITE 0x5b000 thru 0x5b56d (0x56e bytes) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +216(216 mod 256): MAPREAD 0x5e000 thru 0x5f351 (0x1352 bytes) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +217(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +218(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +219(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +220(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +221(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +222(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +223(223 mod 256): TRUNCATE DOWN from 0x6b000 to 0x5e000 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +224(224 mod 256): PUNCH 0x11d69 thru 0x12ac6 (0xd5e bytes) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +225(225 mod 256): PUNCH 0x42bbc thru 0x43275 (0x6ba bytes) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +226(226 mod 256): PUNCH 0x15837 thru 0x15f7b (0x745 bytes) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +227(227 mod 256): READ 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +228(228 mod 256): MAPREAD 0x29000 thru 0x2a04b (0x104c bytes) 2024-03-26T07:41:44.576 INFO:teuthology.orchestra.run.smithi063.stdout: +229(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +230(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +231(231 mod 256): READ 0x12000 thru 0x12fff (0x1000 bytes) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +232(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +233(233 mod 256): MAPREAD 0x28000 thru 0x29df8 (0x1df9 bytes) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +234(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +235(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +236(236 mod 256): PUNCH 0x2bfe7 thru 0x2c8a2 (0x8bc bytes) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +237(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +238(238 mod 256): MAPWRITE 0x72000 thru 0x72b58 (0xb59 bytes) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +239(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +240(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.577 INFO:teuthology.orchestra.run.smithi063.stdout: +241(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +242(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +243(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +244(244 mod 256): PUNCH 0x991d thru 0x9cf2 (0x3d6 bytes) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +245(245 mod 256): WRITE 0x4b000 thru 0x4bfff (0x1000 bytes) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +246(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +247(247 mod 256): MAPWRITE 0x37000 thru 0x372a4 (0x2a5 bytes) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +248(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +249(249 mod 256): MAPREAD 0x0 thru 0x131f (0x1320 bytes) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +250(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +251(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +252(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +253(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +254(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.578 INFO:teuthology.orchestra.run.smithi063.stdout: +255(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +256( 0 mod 256): MAPREAD 0x38000 thru 0x39e9c (0x1e9d bytes) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +257( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +258( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +259( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +260( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +261( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +262( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +263( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +264( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +265( 9 mod 256): TRUNCATE DOWN from 0x72b59 to 0x15000 ******WWWW 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +266( 10 mod 256): MAPREAD 0xa000 thru 0xaad3 (0xad4 bytes) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +267( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +268( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.579 INFO:teuthology.orchestra.run.smithi063.stdout: +269( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +270( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +271( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +272( 16 mod 256): TRUNCATE UP from 0x15000 to 0x53000 ******WWWW 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +273( 17 mod 256): PUNCH 0x4ec35 thru 0x507f9 (0x1bc5 bytes) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +274( 18 mod 256): TRUNCATE DOWN from 0x53000 to 0x11000 ******WWWW 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +275( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +276( 20 mod 256): WRITE 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +277( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +278( 22 mod 256): TRUNCATE DOWN from 0x11000 to 0x10000 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +279( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +280( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +281( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +282( 26 mod 256): MAPREAD 0x3000 thru 0x4d4b (0x1d4c bytes) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +283( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: +284( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +285( 29 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x79000 thru 0x79fff 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +286( 30 mod 256): PUNCH 0x33fda thru 0x34cca (0xcf1 bytes) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +287( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +288( 32 mod 256): MAPWRITE 0x1d000 thru 0x1e4e5 (0x14e6 bytes) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +289( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +290( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +291( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +292( 36 mod 256): TRUNCATE DOWN from 0x7a000 to 0x43000 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +293( 37 mod 256): PUNCH 0x3ea29 thru 0x3f56f (0xb47 bytes) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +294( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +295( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +296( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +297( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.581 INFO:teuthology.orchestra.run.smithi063.stdout: +298( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +299( 43 mod 256): PUNCH 0x2b723 thru 0x2c70c (0xfea bytes) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +300( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +301( 45 mod 256): TRUNCATE DOWN from 0x43000 to 0x12000 ******WWWW 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +302( 46 mod 256): MAPREAD 0x7000 thru 0x8a30 (0x1a31 bytes) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +303( 47 mod 256): MAPREAD 0x4000 thru 0x4b51 (0xb52 bytes) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +304( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +305( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +306( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +307( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +308( 52 mod 256): MAPREAD 0x7000 thru 0x7b04 (0xb05 bytes) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +309( 53 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x58000 thru 0x58fff 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +310( 54 mod 256): PUNCH 0x4e4c8 thru 0x4f398 (0xed1 bytes) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +311( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.582 INFO:teuthology.orchestra.run.smithi063.stdout: +312( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +313( 57 mod 256): COPY 0x3e000 thru 0x3efff (0x1000 bytes) to 0x6000 thru 0x6fff 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +314( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +315( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +316( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +317( 61 mod 256): PUNCH 0x57ab3 thru 0x57e5c (0x3aa bytes) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +318( 62 mod 256): MAPREAD 0x2a000 thru 0x2adda (0xddb bytes) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +319( 63 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +320( 64 mod 256): MAPREAD 0x2a000 thru 0x2ab0a (0xb0b bytes) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +321( 65 mod 256): MAPREAD 0x3c000 thru 0x3c0de (0xdf bytes) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +322( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +323( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +324( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +325( 69 mod 256): MAPWRITE 0x6b000 thru 0x6cbc4 (0x1bc5 bytes) 2024-03-26T07:41:44.583 INFO:teuthology.orchestra.run.smithi063.stdout: +326( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +327( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +328( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +329( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +330( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +331( 75 mod 256): MAPWRITE 0x3f000 thru 0x40d69 (0x1d6a bytes) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +332( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +333( 77 mod 256): MAPREAD 0x55000 thru 0x56f7b (0x1f7c bytes) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +334( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +335( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +336( 80 mod 256): MAPWRITE 0x22000 thru 0x23633 (0x1634 bytes) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +337( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +338( 82 mod 256): MAPREAD 0xa000 thru 0xa4e8 (0x4e9 bytes) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +339( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.584 INFO:teuthology.orchestra.run.smithi063.stdout: +340( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +341( 85 mod 256): MAPWRITE 0xb000 thru 0xbbae (0xbaf bytes) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +342( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +343( 87 mod 256): TRUNCATE UP from 0x6cbc5 to 0x78000 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +344( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +345( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +346( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +347( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +348( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +349( 93 mod 256): PUNCH 0x2a2c8 thru 0x2ac33 (0x96c bytes) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +350( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +351( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +352( 96 mod 256): TRUNCATE DOWN from 0x78000 to 0x39000 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +353( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.585 INFO:teuthology.orchestra.run.smithi063.stdout: +354( 98 mod 256): PUNCH 0x2b9d5 thru 0x2c864 (0xe90 bytes) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +355( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +356(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +357(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +358(102 mod 256): MAPWRITE 0x30000 thru 0x31d6a (0x1d6b bytes) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +359(103 mod 256): PUNCH 0x24f80 thru 0x25fd2 (0x1053 bytes) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +360(104 mod 256): PUNCH 0xf9ad thru 0x110b8 (0x170c bytes) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +361(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +362(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +363(107 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +364(108 mod 256): READ 0x35000 thru 0x35fff (0x1000 bytes) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +365(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +366(110 mod 256): COPY 0x15000 thru 0x15fff (0x1000 bytes) to 0x14000 thru 0x14fff 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +367(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.586 INFO:teuthology.orchestra.run.smithi063.stdout: +368(112 mod 256): PUNCH 0x1c997 thru 0x1e0db (0x1745 bytes) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +369(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +370(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +371(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +372(116 mod 256): TRUNCATE DOWN from 0x54000 to 0x4b000 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +373(117 mod 256): PUNCH 0x16cf9 thru 0x16df6 (0xfe bytes) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +374(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +375(119 mod 256): MAPWRITE 0x61000 thru 0x61618 (0x619 bytes) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +376(120 mod 256): PUNCH 0x5ac25 thru 0x5bc97 (0x1073 bytes) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +377(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +378(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +379(123 mod 256): MAPREAD 0x5000 thru 0x61d1 (0x11d2 bytes) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +380(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +381(125 mod 256): PUNCH 0x1e67a thru 0x1f967 (0x12ee bytes) 2024-03-26T07:41:44.587 INFO:teuthology.orchestra.run.smithi063.stdout: +382(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +383(127 mod 256): MAPWRITE 0x72000 thru 0x72abb (0xabc bytes) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +384(128 mod 256): PUNCH 0x2909b thru 0x2a306 (0x126c bytes) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +385(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +386(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +387(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +388(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +389(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +390(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +391(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +392(136 mod 256): MAPWRITE 0x2c000 thru 0x2da76 (0x1a77 bytes) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +393(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.588 INFO:teuthology.orchestra.run.smithi063.stdout: +394(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +395(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +396(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +397(141 mod 256): PUNCH 0x1bd99 thru 0x1bf4b (0x1b3 bytes) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +398(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +399(143 mod 256): PUNCH 0x1f74a thru 0x20abb (0x1372 bytes) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +400(144 mod 256): MAPWRITE 0x1a000 thru 0x1b696 (0x1697 bytes) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +401(145 mod 256): MAPREAD 0x8000 thru 0x94d9 (0x14da bytes) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +402(146 mod 256): MAPWRITE 0x4d000 thru 0x4da38 (0xa39 bytes) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +403(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +404(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +405(149 mod 256): TRUNCATE DOWN from 0x72abc to 0x54000 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +406(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +407(151 mod 256): MAPREAD 0x8000 thru 0x9817 (0x1818 bytes) 2024-03-26T07:41:44.589 INFO:teuthology.orchestra.run.smithi063.stdout: +408(152 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +409(153 mod 256): MAPWRITE 0x17000 thru 0x18827 (0x1828 bytes) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +410(154 mod 256): MAPWRITE 0x1000 thru 0x1024 (0x25 bytes) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +411(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +412(156 mod 256): PUNCH 0x3a493 thru 0x3af64 (0xad2 bytes) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +413(157 mod 256): PUNCH 0x37ac thru 0x38ab (0x100 bytes) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +414(158 mod 256): TRUNCATE DOWN from 0x77000 to 0x3b000 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +415(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +416(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +417(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +418(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +419(163 mod 256): TRUNCATE DOWN from 0x3b000 to 0x29000 ******WWWW 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +420(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.590 INFO:teuthology.orchestra.run.smithi063.stdout: +421(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +422(166 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x67000 thru 0x67fff 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +423(167 mod 256): READ 0x58000 thru 0x58fff (0x1000 bytes) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +424(168 mod 256): MAPWRITE 0x61000 thru 0x62b12 (0x1b13 bytes) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +425(169 mod 256): TRUNCATE DOWN from 0x68000 to 0x2b000 ******WWWW 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +426(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +427(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +428(172 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x68000 thru 0x68fff 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +429(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +430(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +431(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +432(176 mod 256): MAPWRITE 0x58000 thru 0x597f8 (0x17f9 bytes) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +433(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +434(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.591 INFO:teuthology.orchestra.run.smithi063.stdout: +435(179 mod 256): TRUNCATE DOWN from 0x69000 to 0x62000 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +436(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +437(181 mod 256): TRUNCATE DOWN from 0x62000 to 0x4e000 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +438(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +439(183 mod 256): COPY 0x20000 thru 0x20fff (0x1000 bytes) to 0x72000 thru 0x72fff 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +440(184 mod 256): PUNCH 0x60bba thru 0x62953 (0x1d9a bytes) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +441(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +442(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +443(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +444(188 mod 256): READ 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +445(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +446(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +447(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +448(192 mod 256): TRUNCATE DOWN from 0x73000 to 0x60000 2024-03-26T07:41:44.592 INFO:teuthology.orchestra.run.smithi063.stdout: +449(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +450(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +451(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +452(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +453(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +454(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +455(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +456(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +457(201 mod 256): COPY 0x1d000 thru 0x1dfff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +458(202 mod 256): PUNCH 0x4c01a thru 0x4d716 (0x16fd bytes) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +459(203 mod 256): TRUNCATE DOWN from 0x60000 to 0x2d000 ******WWWW 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +460(204 mod 256): MAPWRITE 0x68000 thru 0x68bd9 (0xbda bytes) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +461(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +462(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +463(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.593 INFO:teuthology.orchestra.run.smithi063.stdout: +464(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +465(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +466(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +467(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +468(212 mod 256): TRUNCATE DOWN from 0x68bda to 0x1c000 ******WWWW 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +469(213 mod 256): MAPREAD 0xe000 thru 0xecef (0xcf0 bytes) 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +470(214 mod 256): MAPWRITE 0x41000 thru 0x41342 (0x343 bytes) 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +471(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +472(216 mod 256): MAPWRITE 0x4e000 thru 0x4e7c6 (0x7c7 bytes) 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +473(217 mod 256): TRUNCATE DOWN from 0x4e7c7 to 0x2e000 ******WWWW 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +474(218 mod 256): TRUNCATE UP from 0x2e000 to 0x6c000 ******WWWW 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +475(219 mod 256): COPY 0x8000 thru 0x8fff (0x1000 bytes) to 0x6b000 thru 0x6bfff 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +476(220 mod 256): WRITE 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-26T07:41:44.594 INFO:teuthology.orchestra.run.smithi063.stdout: +477(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +478(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +479(223 mod 256): READ 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +480(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +481(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +482(226 mod 256): PUNCH 0xa403 thru 0xb8ae (0x14ac bytes) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +483(227 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +484(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +485(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +486(230 mod 256): MAPWRITE 0x13000 thru 0x13fc4 (0xfc5 bytes) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +487(231 mod 256): PUNCH 0x5630 thru 0x5ec6 (0x897 bytes) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +488(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +489(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.595 INFO:teuthology.orchestra.run.smithi063.stdout: +490(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +491(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +492(236 mod 256): WRITE 0x24000 thru 0x24fff (0x1000 bytes) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +493(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +494(238 mod 256): WRITE 0x73000 thru 0x73fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +495(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +496(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +497(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +498(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +499(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +500(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +501(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +502(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +503(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +504(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.596 INFO:teuthology.orchestra.run.smithi063.stdout: +505(249 mod 256): TRUNCATE DOWN from 0x74000 to 0x1b000 ******WWWW 2024-03-26T07:41:44.597 INFO:teuthology.orchestra.run.smithi063.stdout: +506(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.597 INFO:teuthology.orchestra.run.smithi063.stdout: +507(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.597 INFO:teuthology.orchestra.run.smithi063.stdout: +508(252 mod 256): MAPREAD 0x5000 thru 0x6c2e (0x1c2f bytes) 2024-03-26T07:41:44.597 INFO:teuthology.orchestra.run.smithi063.stdout: +509(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.597 INFO:teuthology.orchestra.run.smithi063.stdout: +510(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.597 INFO:teuthology.orchestra.run.smithi063.stdout: +511(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.597 INFO:teuthology.orchestra.run.smithi063.stdout: +512( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.597 INFO:teuthology.orchestra.run.smithi063.stdout: +513( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +514( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +515( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +516( 4 mod 256): COPY 0x15000 thru 0x15fff (0x1000 bytes) to 0x50000 thru 0x50fff 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +517( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +518( 6 mod 256): MAPWRITE 0xa000 thru 0xa6c8 (0x6c9 bytes) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +519( 7 mod 256): MAPREAD 0x4e000 thru 0x4eede (0xedf bytes) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +520( 8 mod 256): PUNCH 0x4a7a thru 0x5da7 (0x132e bytes) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +521( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +522( 10 mod 256): WRITE 0x13000 thru 0x13fff (0x1000 bytes) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +523( 11 mod 256): MAPWRITE 0x6000 thru 0x7f4b (0x1f4c bytes) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +524( 12 mod 256): MAPWRITE 0x62000 thru 0x63a1f (0x1a20 bytes) 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +525( 13 mod 256): TRUNCATE DOWN from 0x63a20 to 0x5a000 2024-03-26T07:41:44.598 INFO:teuthology.orchestra.run.smithi063.stdout: +526( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +527( 15 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +528( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +529( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +530( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +531( 19 mod 256): TRUNCATE DOWN from 0x75000 to 0x5000 ******WWWW 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +532( 20 mod 256): PUNCH 0xde4 thru 0x1f88 (0x11a5 bytes) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +533( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +534( 22 mod 256): READ 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +535( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +536( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +537( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.599 INFO:teuthology.orchestra.run.smithi063.stdout: +538( 26 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +539( 27 mod 256): PUNCH 0x18fd7 thru 0x192f7 (0x321 bytes) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +540( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +541( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +542( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +543( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +544( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +545( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +546( 34 mod 256): MAPWRITE 0x27000 thru 0x28867 (0x1868 bytes) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +547( 35 mod 256): COPY 0x51000 thru 0x51fff (0x1000 bytes) to 0x47000 thru 0x47fff 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +548( 36 mod 256): MAPREAD 0xb000 thru 0xb942 (0x943 bytes) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +549( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +550( 38 mod 256): MAPWRITE 0x5b000 thru 0x5b671 (0x672 bytes) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +551( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.600 INFO:teuthology.orchestra.run.smithi063.stdout: +552( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +553( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +554( 42 mod 256): MAPWRITE 0x19000 thru 0x19548 (0x549 bytes) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +555( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +556( 44 mod 256): READ 0x1a000 thru 0x1afff (0x1000 bytes) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +557( 45 mod 256): WRITE 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +558( 46 mod 256): WRITE 0x64000 thru 0x64fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +559( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +560( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +561( 49 mod 256): COPY 0x13000 thru 0x13fff (0x1000 bytes) to 0x57000 thru 0x57fff 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +562( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +563( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +564( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +565( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.601 INFO:teuthology.orchestra.run.smithi063.stdout: +566( 54 mod 256): MAPREAD 0x58000 thru 0x59f77 (0x1f78 bytes) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +567( 55 mod 256): WRITE 0x14000 thru 0x14fff (0x1000 bytes) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +568( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +569( 57 mod 256): MAPWRITE 0x53000 thru 0x53ff3 (0xff4 bytes) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +570( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +571( 59 mod 256): MAPREAD 0x4b000 thru 0x4b4c3 (0x4c4 bytes) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +572( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +573( 61 mod 256): COPY 0x5a000 thru 0x5afff (0x1000 bytes) to 0x5b000 thru 0x5bfff 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +574( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +575( 63 mod 256): MAPWRITE 0x3e000 thru 0x3f7cc (0x17cd bytes) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +576( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +577( 65 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0xf000 thru 0xffff 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +578( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +579( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.602 INFO:teuthology.orchestra.run.smithi063.stdout: +580( 68 mod 256): PUNCH 0x152eb thru 0x15f1c (0xc32 bytes) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +581( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +582( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +583( 71 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x55000 thru 0x55fff 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +584( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +585( 73 mod 256): PUNCH 0x29fbd thru 0x2b131 (0x1175 bytes) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +586( 74 mod 256): PUNCH 0x1b0be thru 0x1c195 (0x10d8 bytes) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +587( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +588( 76 mod 256): PUNCH 0x29e10 thru 0x29f3c (0x12d bytes) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +589( 77 mod 256): TRUNCATE DOWN from 0x65000 to 0x35000 ******WWWW 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +590( 78 mod 256): TRUNCATE UP from 0x35000 to 0x4d000 ******WWWW 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +591( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +592( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +593( 81 mod 256): READ 0x4b000 thru 0x4bfff (0x1000 bytes) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +594( 82 mod 256): PUNCH 0x34594 thru 0x3548d (0xefa bytes) 2024-03-26T07:41:44.603 INFO:teuthology.orchestra.run.smithi063.stdout: +595( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +596( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +597( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +598( 86 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +599( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +600( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +601( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +602( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +603( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +604( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +605( 93 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +606( 94 mod 256): MAPWRITE 0x45000 thru 0x468e2 (0x18e3 bytes) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +607( 95 mod 256): MAPWRITE 0x23000 thru 0x239c4 (0x9c5 bytes) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +608( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +609( 97 mod 256): MAPWRITE 0x2c000 thru 0x2c865 (0x866 bytes) 2024-03-26T07:41:44.604 INFO:teuthology.orchestra.run.smithi063.stdout: +610( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +611( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +612(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +613(101 mod 256): MAPREAD 0x5c000 thru 0x5ce4d (0xe4e bytes) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +614(102 mod 256): MAPREAD 0x6f000 thru 0x6fd24 (0xd25 bytes) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +615(103 mod 256): MAPREAD 0x33000 thru 0x34ca2 (0x1ca3 bytes) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +616(104 mod 256): WRITE 0x23000 thru 0x23fff (0x1000 bytes) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +617(105 mod 256): PUNCH 0x1070f thru 0x11117 (0xa09 bytes) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +618(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +619(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +620(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +621(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +622(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +623(111 mod 256): PUNCH 0x3c3cf thru 0x3cfa7 (0xbd9 bytes) 2024-03-26T07:41:44.605 INFO:teuthology.orchestra.run.smithi063.stdout: +624(112 mod 256): TRUNCATE DOWN from 0x75000 to 0xc000 ******WWWW 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +625(113 mod 256): MAPWRITE 0x6a000 thru 0x6b75f (0x1760 bytes) 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +626(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +627(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +628(116 mod 256): TRUNCATE DOWN from 0x6b760 to 0x40000 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +629(117 mod 256): MAPREAD 0x12000 thru 0x13703 (0x1704 bytes) 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +630(118 mod 256): TRUNCATE UP from 0x40000 to 0x47000 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +631(119 mod 256): PUNCH 0x37190 thru 0x386c8 (0x1539 bytes) ******PPPP 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +632(120 mod 256): MAPREAD 0x30000 thru 0x3108e (0x108f bytes) 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +633(121 mod 256): WRITE 0x72000 thru 0x72fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +634(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +635(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +636(124 mod 256): PUNCH 0x6abe0 thru 0x6c3f2 (0x1813 bytes) 2024-03-26T07:41:44.606 INFO:teuthology.orchestra.run.smithi063.stdout: +637(125 mod 256): READ 0x68000 thru 0x68fff (0x1000 bytes) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +638(126 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +639(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +640(128 mod 256): MAPREAD 0x32000 thru 0x33f39 (0x1f3a bytes) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +641(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +642(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +643(131 mod 256): MAPWRITE 0x61000 thru 0x614b9 (0x4ba bytes) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +644(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +645(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +646(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +647(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +648(136 mod 256): MAPWRITE 0x4e000 thru 0x4f002 (0x1003 bytes) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +649(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +650(138 mod 256): READ 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-26T07:41:44.607 INFO:teuthology.orchestra.run.smithi063.stdout: +651(139 mod 256): PUNCH 0x3ebeb thru 0x3fdf4 (0x120a bytes) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +652(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +653(141 mod 256): MAPREAD 0x2000 thru 0x2a1a (0xa1b bytes) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +654(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +655(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +656(144 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x42000 thru 0x42fff 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +657(145 mod 256): PUNCH 0x3abcf thru 0x3b7f1 (0xc23 bytes) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +658(146 mod 256): MAPREAD 0x13000 thru 0x14d2a (0x1d2b bytes) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +659(147 mod 256): COPY 0x23000 thru 0x23fff (0x1000 bytes) to 0x4d000 thru 0x4dfff 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +660(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +661(149 mod 256): MAPREAD 0x21000 thru 0x216f4 (0x6f5 bytes) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +662(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +663(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +664(152 mod 256): READ 0x2a000 thru 0x2afff (0x1000 bytes) 2024-03-26T07:41:44.608 INFO:teuthology.orchestra.run.smithi063.stdout: +665(153 mod 256): MAPREAD 0x56000 thru 0x56f92 (0xf93 bytes) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +666(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +667(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +668(156 mod 256): MAPWRITE 0x50000 thru 0x516ca (0x16cb bytes) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +669(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +670(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +671(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +672(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +673(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +674(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +675(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +676(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +677(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.609 INFO:teuthology.orchestra.run.smithi063.stdout: +678(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +679(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +680(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +681(169 mod 256): PUNCH 0x492a4 thru 0x4a6cd (0x142a bytes) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +682(170 mod 256): READ 0x59000 thru 0x59fff (0x1000 bytes) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +683(171 mod 256): MAPREAD 0x65000 thru 0x66022 (0x1023 bytes) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +684(172 mod 256): READ 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +685(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +686(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +687(175 mod 256): PUNCH 0xc4a0 thru 0xd099 (0xbfa bytes) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +688(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +689(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +690(178 mod 256): WRITE 0x13000 thru 0x13fff (0x1000 bytes) 2024-03-26T07:41:44.610 INFO:teuthology.orchestra.run.smithi063.stdout: +691(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +692(180 mod 256): PUNCH 0x49dff thru 0x4b7bb (0x19bd bytes) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +693(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +694(182 mod 256): MAPREAD 0x28000 thru 0x29ea1 (0x1ea2 bytes) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +695(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +696(184 mod 256): TRUNCATE DOWN from 0x73000 to 0x1c000 ******WWWW 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +697(185 mod 256): TRUNCATE UP from 0x1c000 to 0x2e000 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +698(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +699(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +700(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +701(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +702(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +703(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +704(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.611 INFO:teuthology.orchestra.run.smithi063.stdout: +705(193 mod 256): TRUNCATE UP from 0x2e000 to 0x3d000 ******WWWW 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +706(194 mod 256): PUNCH 0x10003 thru 0x11c1c (0x1c1a bytes) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +707(195 mod 256): COPY 0x1d000 thru 0x1dfff (0x1000 bytes) to 0x31000 thru 0x31fff 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +708(196 mod 256): WRITE 0x60000 thru 0x60fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +709(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +710(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +711(199 mod 256): WRITE 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +712(200 mod 256): MAPREAD 0x19000 thru 0x1a043 (0x1044 bytes) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +713(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +714(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +715(203 mod 256): WRITE 0x35000 thru 0x35fff (0x1000 bytes) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +716(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +717(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +718(206 mod 256): MAPREAD 0x5d000 thru 0x5d0e1 (0xe2 bytes) 2024-03-26T07:41:44.612 INFO:teuthology.orchestra.run.smithi063.stdout: +719(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +720(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +721(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +722(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +723(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +724(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +725(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +726(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +727(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +728(216 mod 256): MAPREAD 0x36000 thru 0x36280 (0x281 bytes) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +729(217 mod 256): READ 0x4b000 thru 0x4bfff (0x1000 bytes) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +730(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +731(219 mod 256): MAPREAD 0xe000 thru 0xf96b (0x196c bytes) 2024-03-26T07:41:44.613 INFO:teuthology.orchestra.run.smithi063.stdout: +732(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +733(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +734(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +735(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +736(224 mod 256): PUNCH 0xb9e4 thru 0xd140 (0x175d bytes) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +737(225 mod 256): PUNCH 0x2681c thru 0x286fe (0x1ee3 bytes) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +738(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +739(227 mod 256): TRUNCATE DOWN from 0x61000 to 0x34000 ******WWWW 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +740(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +741(229 mod 256): MAPREAD 0x16000 thru 0x17c4d (0x1c4e bytes) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +742(230 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0x5a000 thru 0x5afff 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +743(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +744(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +745(233 mod 256): TRUNCATE DOWN from 0x5b000 to 0x1d000 ******WWWW 2024-03-26T07:41:44.614 INFO:teuthology.orchestra.run.smithi063.stdout: +746(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +747(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +748(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +749(237 mod 256): PUNCH 0x19f9a thru 0x1b698 (0x16ff bytes) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +750(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +751(239 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x55000 thru 0x55fff 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +752(240 mod 256): TRUNCATE DOWN from 0x56000 to 0x3d000 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +753(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +754(242 mod 256): MAPWRITE 0x19000 thru 0x1a0d2 (0x10d3 bytes) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +755(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +756(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +757(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +758(246 mod 256): WRITE 0x3e000 thru 0x3efff (0x1000 bytes) HOLE 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +759(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.615 INFO:teuthology.orchestra.run.smithi063.stdout: +760(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +761(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +762(250 mod 256): MAPREAD 0xd000 thru 0xde7b (0xe7c bytes) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +763(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +764(252 mod 256): TRUNCATE UP from 0x3f000 to 0x73000 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +765(253 mod 256): TRUNCATE DOWN from 0x73000 to 0x42000 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +766(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +767(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +768( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +769( 1 mod 256): MAPREAD 0x2d000 thru 0x2dd51 (0xd52 bytes) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +770( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +771( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +772( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +773( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.616 INFO:teuthology.orchestra.run.smithi063.stdout: +774( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +775( 7 mod 256): TRUNCATE DOWN from 0x42000 to 0x41000 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +776( 8 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +777( 9 mod 256): PUNCH 0x2d84a thru 0x2f830 (0x1fe7 bytes) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +778( 10 mod 256): MAPWRITE 0x68000 thru 0x694cf (0x14d0 bytes) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +779( 11 mod 256): PUNCH 0x1c91 thru 0x2085 (0x3f5 bytes) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +780( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +781( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +782( 14 mod 256): MAPWRITE 0x62000 thru 0x63353 (0x1354 bytes) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +783( 15 mod 256): TRUNCATE UP from 0x694d0 to 0x73000 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +784( 16 mod 256): COPY 0x1c000 thru 0x1cfff (0x1000 bytes) to 0x4a000 thru 0x4afff 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +785( 17 mod 256): TRUNCATE DOWN from 0x73000 to 0x55000 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +786( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +787( 19 mod 256): MAPWRITE 0x5a000 thru 0x5bf85 (0x1f86 bytes) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +788( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.617 INFO:teuthology.orchestra.run.smithi063.stdout: +789( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +790( 22 mod 256): COPY 0x54000 thru 0x54fff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +791( 23 mod 256): PUNCH 0x50fb7 thru 0x526d6 (0x1720 bytes) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +792( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +793( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +794( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +795( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +796( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +797( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +798( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +799( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +800( 32 mod 256): READ 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-26T07:41:44.618 INFO:teuthology.orchestra.run.smithi063.stdout: +801( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +802( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +803( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +804( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +805( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +806( 38 mod 256): TRUNCATE UP from 0x5d000 to 0x6c000 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +807( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +808( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +809( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +810( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +811( 43 mod 256): TRUNCATE DOWN from 0x6c000 to 0x2a000 ******WWWW 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +812( 44 mod 256): MAPWRITE 0x40000 thru 0x40cdf (0xce0 bytes) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +813( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +814( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.619 INFO:teuthology.orchestra.run.smithi063.stdout: +815( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +816( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +817( 49 mod 256): READ 0x2f000 thru 0x2ffff (0x1000 bytes) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +818( 50 mod 256): MAPREAD 0x4000 thru 0x41d4 (0x1d5 bytes) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +819( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +820( 52 mod 256): MAPWRITE 0x13000 thru 0x14f54 (0x1f55 bytes) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +821( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +822( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +823( 55 mod 256): MAPWRITE 0x79000 thru 0x7a09c (0x109d bytes) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +824( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +825( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +826( 58 mod 256): MAPREAD 0x37000 thru 0x37bf9 (0xbfa bytes) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +827( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +828( 60 mod 256): MAPREAD 0x67000 thru 0x67951 (0x952 bytes) 2024-03-26T07:41:44.620 INFO:teuthology.orchestra.run.smithi063.stdout: +829( 61 mod 256): TRUNCATE DOWN from 0x7a09d to 0x26000 ******WWWW 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +830( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +831( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +832( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +833( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +834( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +835( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +836( 68 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x37000 thru 0x37fff ******EEEE 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +837( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +838( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +839( 71 mod 256): PUNCH 0x1c46c thru 0x1d125 (0xcba bytes) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +840( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +841( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.621 INFO:teuthology.orchestra.run.smithi063.stdout: +842( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +843( 75 mod 256): TRUNCATE UP from 0x38000 to 0x55000 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +844( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +845( 77 mod 256): READ 0x3b000 thru 0x3bfff (0x1000 bytes) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +846( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +847( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +848( 80 mod 256): READ 0x49000 thru 0x49fff (0x1000 bytes) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +849( 81 mod 256): TRUNCATE UP from 0x55000 to 0x6c000 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +850( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +851( 83 mod 256): PUNCH 0x3c0aa thru 0x3d62b (0x1582 bytes) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +852( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +853( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +854( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.622 INFO:teuthology.orchestra.run.smithi063.stdout: +855( 87 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x66000 thru 0x66fff 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +856( 88 mod 256): TRUNCATE DOWN from 0x6c000 to 0x48000 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +857( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +858( 90 mod 256): MAPREAD 0x7000 thru 0x8761 (0x1762 bytes) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +859( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +860( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +861( 93 mod 256): COPY 0xb000 thru 0xbfff (0x1000 bytes) to 0x1a000 thru 0x1afff 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +862( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +863( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +864( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +865( 97 mod 256): MAPWRITE 0x72000 thru 0x726de (0x6df bytes) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +866( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +867( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +868(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.623 INFO:teuthology.orchestra.run.smithi063.stdout: +869(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +870(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +871(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +872(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +873(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +874(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +875(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +876(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +877(109 mod 256): READ 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +878(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +879(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +880(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +881(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +882(114 mod 256): WRITE 0x5f000 thru 0x5ffff (0x1000 bytes) 2024-03-26T07:41:44.624 INFO:teuthology.orchestra.run.smithi063.stdout: +883(115 mod 256): WRITE 0xf000 thru 0xffff (0x1000 bytes) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +884(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +885(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +886(118 mod 256): TRUNCATE DOWN from 0x726df to 0x48000 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +887(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +888(120 mod 256): TRUNCATE DOWN from 0x48000 to 0x34000 ******WWWW 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +889(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +890(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +891(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +892(124 mod 256): MAPREAD 0x31000 thru 0x31614 (0x615 bytes) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +893(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +894(126 mod 256): MAPREAD 0x6000 thru 0x62c1 (0x2c2 bytes) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +895(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.625 INFO:teuthology.orchestra.run.smithi063.stdout: +896(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +897(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +898(130 mod 256): MAPREAD 0x5000 thru 0x54ca (0x4cb bytes) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +899(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +900(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +901(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +902(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +903(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +904(136 mod 256): TRUNCATE UP from 0x34000 to 0x70000 ******WWWW 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +905(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +906(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +907(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +908(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.626 INFO:teuthology.orchestra.run.smithi063.stdout: +909(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +910(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +911(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +912(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +913(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +914(146 mod 256): COPY 0x35000 thru 0x35fff (0x1000 bytes) to 0x5d000 thru 0x5dfff 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +915(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +916(148 mod 256): PUNCH 0x55393 thru 0x5716c (0x1dda bytes) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +917(149 mod 256): WRITE 0x78000 thru 0x78fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +918(150 mod 256): MAPREAD 0x53000 thru 0x5310c (0x10d bytes) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +919(151 mod 256): TRUNCATE DOWN from 0x79000 to 0x1f000 ******WWWW 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +920(152 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +921(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +922(154 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x79000 thru 0x79fff 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +923(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.627 INFO:teuthology.orchestra.run.smithi063.stdout: +924(156 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x33000 thru 0x33fff 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +925(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +926(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +927(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +928(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +929(161 mod 256): PUNCH 0x2b7fe thru 0x2c31e (0xb21 bytes) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +930(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +931(163 mod 256): WRITE 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +932(164 mod 256): COPY 0x5b000 thru 0x5bfff (0x1000 bytes) to 0xc000 thru 0xcfff 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +933(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +934(166 mod 256): PUNCH 0x6fef0 thru 0x7021e (0x32f bytes) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +935(167 mod 256): MAPREAD 0x55000 thru 0x55d20 (0xd21 bytes) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +936(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +937(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.628 INFO:teuthology.orchestra.run.smithi063.stdout: +938(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +939(171 mod 256): PUNCH 0x8c56 thru 0xa327 (0x16d2 bytes) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +940(172 mod 256): MAPREAD 0x29000 thru 0x2ac8b (0x1c8c bytes) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +941(173 mod 256): TRUNCATE DOWN from 0x7a000 to 0x73000 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +942(174 mod 256): PUNCH 0x49cee thru 0x4a2b0 (0x5c3 bytes) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +943(175 mod 256): COPY 0x3a000 thru 0x3afff (0x1000 bytes) to 0x2d000 thru 0x2dfff 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +944(176 mod 256): TRUNCATE DOWN from 0x73000 to 0x45000 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +945(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +946(178 mod 256): COPY 0x43000 thru 0x43fff (0x1000 bytes) to 0x3b000 thru 0x3bfff 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +947(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +948(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +949(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +950(182 mod 256): WRITE 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +951(183 mod 256): MAPWRITE 0x49000 thru 0x49900 (0x901 bytes) 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +952(184 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x3b000 thru 0x3bfff 2024-03-26T07:41:44.629 INFO:teuthology.orchestra.run.smithi063.stdout: +953(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +954(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +955(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +956(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +957(189 mod 256): MAPWRITE 0x72000 thru 0x7266f (0x670 bytes) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +958(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +959(191 mod 256): TRUNCATE DOWN from 0x72670 to 0x6a000 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +960(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +961(193 mod 256): MAPREAD 0x4e000 thru 0x4e4b7 (0x4b8 bytes) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +962(194 mod 256): PUNCH 0x5552d thru 0x5574a (0x21e bytes) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +963(195 mod 256): MAPREAD 0x48000 thru 0x4966f (0x1670 bytes) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +964(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +965(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +966(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.630 INFO:teuthology.orchestra.run.smithi063.stdout: +967(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +968(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +969(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +970(202 mod 256): PUNCH 0x3fe93 thru 0x41567 (0x16d5 bytes) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +971(203 mod 256): MAPWRITE 0x1e000 thru 0x1fcf7 (0x1cf8 bytes) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +972(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +973(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +974(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +975(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +976(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +977(209 mod 256): MAPWRITE 0x57000 thru 0x58af2 (0x1af3 bytes) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +978(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +979(211 mod 256): MAPREAD 0x0 thru 0xc7b (0xc7c bytes) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +980(212 mod 256): PUNCH 0x554bf thru 0x572f7 (0x1e39 bytes) 2024-03-26T07:41:44.631 INFO:teuthology.orchestra.run.smithi063.stdout: +981(213 mod 256): PUNCH 0x3f0ac thru 0x3f49a (0x3ef bytes) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +982(214 mod 256): COPY 0x68000 thru 0x68fff (0x1000 bytes) to 0x9000 thru 0x9fff 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +983(215 mod 256): MAPWRITE 0x4c000 thru 0x4d591 (0x1592 bytes) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +984(216 mod 256): MAPWRITE 0x3b000 thru 0x3cbd9 (0x1bda bytes) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +985(217 mod 256): MAPWRITE 0x62000 thru 0x63190 (0x1191 bytes) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +986(218 mod 256): MAPREAD 0x0 thru 0x1505 (0x1506 bytes) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +987(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +988(220 mod 256): MAPREAD 0x22000 thru 0x22113 (0x114 bytes) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +989(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +990(222 mod 256): COPY 0x66000 thru 0x66fff (0x1000 bytes) to 0x1d000 thru 0x1dfff 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +991(223 mod 256): PUNCH 0x466c0 thru 0x47bc3 (0x1504 bytes) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +992(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +993(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.632 INFO:teuthology.orchestra.run.smithi063.stdout: +994(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +995(227 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +996(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +997(229 mod 256): PUNCH 0x34fbe thru 0x36ecf (0x1f12 bytes) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +998(230 mod 256): TRUNCATE DOWN from 0x6a000 to 0x7000 ******WWWW 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +999(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1000(232 mod 256): MAPWRITE 0x7000 thru 0x76d8 (0x6d9 bytes) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1001(233 mod 256): MAPREAD 0x6000 thru 0x6795 (0x796 bytes) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1002(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1003(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1004(236 mod 256): MAPWRITE 0x24000 thru 0x25359 (0x135a bytes) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1005(237 mod 256): COPY 0x22000 thru 0x22fff (0x1000 bytes) to 0x18000 thru 0x18fff 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1006(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1007(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1008(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.633 INFO:teuthology.orchestra.run.smithi063.stdout: +1009(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1010(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1011(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1012(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1013(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1014(246 mod 256): MAPWRITE 0x2d000 thru 0x2ec55 (0x1c56 bytes) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1015(247 mod 256): TRUNCATE DOWN from 0x2ec56 to 0x2a000 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1016(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1017(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1018(250 mod 256): PUNCH 0xf84b thru 0x11486 (0x1c3c bytes) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1019(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1020(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: +1021(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1022(254 mod 256): WRITE 0x37000 thru 0x37fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1023(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1024( 0 mod 256): COPY 0x34000 thru 0x34fff (0x1000 bytes) to 0x21000 thru 0x21fff 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1025( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1026( 2 mod 256): MAPREAD 0x5000 thru 0x55f6 (0x5f7 bytes) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1027( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1028( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1029( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1030( 6 mod 256): MAPWRITE 0x49000 thru 0x4a0a8 (0x10a9 bytes) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1031( 7 mod 256): MAPWRITE 0x64000 thru 0x64195 (0x196 bytes) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1032( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1033( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1034( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: +1035( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1036( 12 mod 256): TRUNCATE DOWN from 0x64196 to 0x62000 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1037( 13 mod 256): MAPWRITE 0x57000 thru 0x587ce (0x17cf bytes) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1038( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1039( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1040( 16 mod 256): COPY 0x17000 thru 0x17fff (0x1000 bytes) to 0x3a000 thru 0x3afff 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1041( 17 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x4d000 thru 0x4dfff 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1042( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1043( 19 mod 256): COPY 0x2000 thru 0x2fff (0x1000 bytes) to 0x4a000 thru 0x4afff 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1044( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1045( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1046( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1047( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1048( 24 mod 256): PUNCH 0xdb9d thru 0xecbd (0x1121 bytes) 2024-03-26T07:41:44.636 INFO:teuthology.orchestra.run.smithi063.stdout: +1049( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1050( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1051( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1052( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1053( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1054( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1055( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1056( 32 mod 256): READ 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1057( 33 mod 256): MAPWRITE 0x6c000 thru 0x6da94 (0x1a95 bytes) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1058( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1059( 35 mod 256): MAPWRITE 0x28000 thru 0x2963d (0x163e bytes) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1060( 36 mod 256): MAPWRITE 0x27000 thru 0x27a6c (0xa6d bytes) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1061( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.637 INFO:teuthology.orchestra.run.smithi063.stdout: +1062( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1063( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1064( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1065( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1066( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1067( 43 mod 256): MAPWRITE 0x13000 thru 0x138af (0x8b0 bytes) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1068( 44 mod 256): MAPWRITE 0x44000 thru 0x45265 (0x1266 bytes) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1069( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1070( 46 mod 256): TRUNCATE DOWN from 0x6da95 to 0x66000 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1071( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1072( 48 mod 256): MAPWRITE 0x2b000 thru 0x2bda1 (0xda2 bytes) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1073( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1074( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1075( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.638 INFO:teuthology.orchestra.run.smithi063.stdout: +1076( 52 mod 256): MAPWRITE 0x2f000 thru 0x30cb6 (0x1cb7 bytes) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1077( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1078( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1079( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1080( 56 mod 256): COPY 0x54000 thru 0x54fff (0x1000 bytes) to 0x18000 thru 0x18fff 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1081( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1082( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1083( 59 mod 256): WRITE 0x5d000 thru 0x5dfff (0x1000 bytes) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1084( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1085( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1086( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1087( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1088( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1089( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.639 INFO:teuthology.orchestra.run.smithi063.stdout: +1090( 66 mod 256): READ 0x3000 thru 0x3fff (0x1000 bytes) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1091( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1092( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1093( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1094( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1095( 71 mod 256): PUNCH 0x12764 thru 0x13795 (0x1032 bytes) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1096( 72 mod 256): PUNCH 0x53883 thru 0x5492e (0x10ac bytes) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1097( 73 mod 256): COPY 0x2f000 thru 0x2ffff (0x1000 bytes) to 0x2e000 thru 0x2efff 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1098( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1099( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1100( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1101( 77 mod 256): MAPWRITE 0x74000 thru 0x75a17 (0x1a18 bytes) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1102( 78 mod 256): PUNCH 0x1f39f thru 0x20cf3 (0x1955 bytes) 2024-03-26T07:41:44.640 INFO:teuthology.orchestra.run.smithi063.stdout: +1103( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1104( 80 mod 256): MAPREAD 0x74000 thru 0x74188 (0x189 bytes) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1105( 81 mod 256): TRUNCATE DOWN from 0x75a18 to 0x64000 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1106( 82 mod 256): MAPREAD 0x5000 thru 0x6821 (0x1822 bytes) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1107( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1108( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1109( 85 mod 256): MAPREAD 0x28000 thru 0x28226 (0x227 bytes) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1110( 86 mod 256): PUNCH 0x3609a thru 0x37889 (0x17f0 bytes) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1111( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1112( 88 mod 256): TRUNCATE UP from 0x64000 to 0x76000 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1113( 89 mod 256): READ 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1114( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1115( 91 mod 256): MAPREAD 0x52000 thru 0x53ec3 (0x1ec4 bytes) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1116( 92 mod 256): MAPREAD 0x72000 thru 0x73240 (0x1241 bytes) 2024-03-26T07:41:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: +1117( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1118( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1119( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1120( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1121( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1122( 98 mod 256): MAPREAD 0x26000 thru 0x27e3b (0x1e3c bytes) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1123( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1124(100 mod 256): PUNCH 0x5e9a9 thru 0x5fa4e (0x10a6 bytes) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1125(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1126(102 mod 256): MAPREAD 0x6c000 thru 0x6c0ef (0xf0 bytes) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1127(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1128(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.642 INFO:teuthology.orchestra.run.smithi063.stdout: +1129(105 mod 256): MAPWRITE 0x1e000 thru 0x1f044 (0x1045 bytes) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1130(106 mod 256): PUNCH 0x4e25c thru 0x4ebde (0x983 bytes) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1131(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1132(108 mod 256): PUNCH 0x5f962 thru 0x61134 (0x17d3 bytes) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1133(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1134(110 mod 256): MAPWRITE 0x2a000 thru 0x2ae1f (0xe20 bytes) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1135(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1136(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1137(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1138(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1139(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1140(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1141(117 mod 256): TRUNCATE DOWN from 0x76000 to 0x37000 ******WWWW 2024-03-26T07:41:44.643 INFO:teuthology.orchestra.run.smithi063.stdout: +1142(118 mod 256): READ 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1143(119 mod 256): PUNCH 0x2a45d thru 0x2b4be (0x1062 bytes) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1144(120 mod 256): READ 0x15000 thru 0x15fff (0x1000 bytes) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1145(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1146(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1147(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1148(124 mod 256): TRUNCATE DOWN from 0x37000 to 0xe000 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1149(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1150(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1151(127 mod 256): COPY 0x8000 thru 0x8fff (0x1000 bytes) to 0x1a000 thru 0x1afff 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1152(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1153(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1154(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1155(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1156(132 mod 256): TRUNCATE UP from 0x1b000 to 0x3b000 ******WWWW 2024-03-26T07:41:44.644 INFO:teuthology.orchestra.run.smithi063.stdout: +1157(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1158(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1159(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1160(136 mod 256): TRUNCATE DOWN from 0x3b000 to 0x2d000 ******WWWW 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1161(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1162(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1163(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1164(140 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x4b000 thru 0x4bfff 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1165(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1166(142 mod 256): TRUNCATE UP from 0x4c000 to 0x51000 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1167(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1168(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1169(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1170(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.645 INFO:teuthology.orchestra.run.smithi063.stdout: +1171(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1172(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1173(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1174(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1175(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1176(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1177(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1178(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1179(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1180(156 mod 256): MAPWRITE 0x35000 thru 0x36a55 (0x1a56 bytes) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1181(157 mod 256): READ 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1182(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1183(159 mod 256): MAPWRITE 0x62000 thru 0x631e0 (0x11e1 bytes) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1184(160 mod 256): MAPWRITE 0x1b000 thru 0x1b7a5 (0x7a6 bytes) 2024-03-26T07:41:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: +1185(161 mod 256): MAPREAD 0x5b000 thru 0x5b114 (0x115 bytes) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1186(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1187(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1188(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1189(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1190(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1191(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1192(168 mod 256): PUNCH 0x34b62 thru 0x361e8 (0x1687 bytes) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1193(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1194(170 mod 256): MAPREAD 0x62000 thru 0x623d4 (0x3d5 bytes) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1195(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1196(172 mod 256): MAPWRITE 0x4d000 thru 0x4e90e (0x190f bytes) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1197(173 mod 256): MAPWRITE 0xd000 thru 0xd288 (0x289 bytes) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1198(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1199(175 mod 256): READ 0x1c000 thru 0x1cfff (0x1000 bytes) 2024-03-26T07:41:44.647 INFO:teuthology.orchestra.run.smithi063.stdout: +1200(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1201(177 mod 256): TRUNCATE DOWN from 0x631e1 to 0x16000 ******WWWW 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1202(178 mod 256): MAPWRITE 0x77000 thru 0x770f3 (0xf4 bytes) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1203(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1204(180 mod 256): MAPWRITE 0x50000 thru 0x50e6f (0xe70 bytes) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1205(181 mod 256): PUNCH 0x23c3 thru 0x2aac (0x6ea bytes) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1206(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1207(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1208(184 mod 256): COPY 0x5d000 thru 0x5dfff (0x1000 bytes) to 0x32000 thru 0x32fff 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1209(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1210(186 mod 256): WRITE 0x7000 thru 0x7fff (0x1000 bytes) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1211(187 mod 256): PUNCH 0x2f4c2 thru 0x2f99b (0x4da bytes) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1212(188 mod 256): TRUNCATE DOWN from 0x770f4 to 0x3f000 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1213(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.648 INFO:teuthology.orchestra.run.smithi063.stdout: +1214(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1215(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1216(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1217(193 mod 256): MAPWRITE 0x76000 thru 0x77088 (0x1089 bytes) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1218(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1219(195 mod 256): MAPREAD 0x6f000 thru 0x6f91b (0x91c bytes) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1220(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1221(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1222(198 mod 256): TRUNCATE DOWN from 0x77089 to 0x72000 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1223(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1224(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1225(201 mod 256): READ 0x1d000 thru 0x1dfff (0x1000 bytes) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1226(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1227(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: +1228(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1229(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1230(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1231(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1232(208 mod 256): READ 0x5e000 thru 0x5efff (0x1000 bytes) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1233(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1234(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1235(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1236(212 mod 256): MAPREAD 0x1b000 thru 0x1c8d5 (0x18d6 bytes) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1237(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1238(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1239(215 mod 256): COPY 0x31000 thru 0x31fff (0x1000 bytes) to 0x10000 thru 0x10fff 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1240(216 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1241(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: +1242(218 mod 256): MAPWRITE 0x40000 thru 0x41bab (0x1bac bytes) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1243(219 mod 256): WRITE 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1244(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1245(221 mod 256): PUNCH 0x1e59 thru 0x318f (0x1337 bytes) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1246(222 mod 256): MAPWRITE 0x53000 thru 0x546b1 (0x16b2 bytes) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1247(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1248(224 mod 256): WRITE 0x6b000 thru 0x6bfff (0x1000 bytes) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1249(225 mod 256): PUNCH 0x4f187 thru 0x50260 (0x10da bytes) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1250(226 mod 256): MAPWRITE 0x62000 thru 0x6348a (0x148b bytes) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1251(227 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1252(228 mod 256): TRUNCATE DOWN from 0x72000 to 0x27000 ******WWWW 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1253(229 mod 256): MAPREAD 0x3000 thru 0x3374 (0x375 bytes) 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1254(230 mod 256): COPY 0xc000 thru 0xcfff (0x1000 bytes) to 0x36000 thru 0x36fff 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1255(231 mod 256): TRUNCATE UP from 0x37000 to 0x38000 ******WWWW 2024-03-26T07:41:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: +1256(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1257(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1258(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1259(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1260(236 mod 256): MAPWRITE 0x3e000 thru 0x3f8e0 (0x18e1 bytes) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1261(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1262(238 mod 256): TRUNCATE UP from 0x3f8e1 to 0x44000 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1263(239 mod 256): MAPREAD 0x32000 thru 0x33756 (0x1757 bytes) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1264(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1265(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1266(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1267(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1268(244 mod 256): MAPWRITE 0x1f000 thru 0x20002 (0x1003 bytes) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1269(245 mod 256): MAPWRITE 0x45000 thru 0x46dcf (0x1dd0 bytes) 2024-03-26T07:41:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: +1270(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1271(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1272(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1273(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1274(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1275(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1276(252 mod 256): READ 0x45000 thru 0x45fff (0x1000 bytes) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1277(253 mod 256): MAPWRITE 0x38000 thru 0x39954 (0x1955 bytes) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1278(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1279(255 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1280( 0 mod 256): MAPWRITE 0x32000 thru 0x3202d (0x2e bytes) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1281( 1 mod 256): MAPREAD 0x21000 thru 0x22645 (0x1646 bytes) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1282( 2 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1283( 3 mod 256): MAPREAD 0x13000 thru 0x13268 (0x269 bytes) 2024-03-26T07:41:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: +1284( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1285( 5 mod 256): COPY 0x2f000 thru 0x2ffff (0x1000 bytes) to 0x4000 thru 0x4fff 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1286( 6 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x5a000 thru 0x5afff 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1287( 7 mod 256): COPY 0x44000 thru 0x44fff (0x1000 bytes) to 0x5d000 thru 0x5dfff 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1288( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1289( 9 mod 256): TRUNCATE DOWN from 0x5e000 to 0xa000 ******WWWW 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1290( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1291( 11 mod 256): MAPWRITE 0x4a000 thru 0x4b036 (0x1037 bytes) 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1292( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1293( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1294( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1295( 15 mod 256): PUNCH 0xa91e thru 0xb165 (0x848 bytes) 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1296( 16 mod 256): MAPWRITE 0x5e000 thru 0x5eb14 (0xb15 bytes) 2024-03-26T07:41:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: +1297( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1298( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1299( 19 mod 256): MAPREAD 0x20000 thru 0x2181b (0x181c bytes) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1300( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1301( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1302( 22 mod 256): WRITE 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1303( 23 mod 256): TRUNCATE DOWN from 0x5eb15 to 0x1b000 ******WWWW 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1304( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1305( 25 mod 256): MAPREAD 0xc000 thru 0xd18f (0x1190 bytes) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1306( 26 mod 256): TRUNCATE UP from 0x1b000 to 0x67000 ******WWWW 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1307( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1308( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1309( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1310( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1311( 31 mod 256): MAPREAD 0x2e000 thru 0x2eb84 (0xb85 bytes) 2024-03-26T07:41:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: +1312( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1313( 33 mod 256): PUNCH 0x17463 thru 0x17e50 (0x9ee bytes) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1314( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1315( 35 mod 256): MAPREAD 0xf000 thru 0x1020b (0x120c bytes) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1316( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1317( 37 mod 256): MAPREAD 0x5b000 thru 0x5ca97 (0x1a98 bytes) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1318( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1319( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1320( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1321( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1322( 42 mod 256): MAPREAD 0x28000 thru 0x28b60 (0xb61 bytes) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1323( 43 mod 256): MAPREAD 0x3a000 thru 0x3b294 (0x1295 bytes) 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1324( 44 mod 256): COPY 0x2b000 thru 0x2bfff (0x1000 bytes) to 0x4000 thru 0x4fff 2024-03-26T07:41:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: +1325( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1326( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1327( 47 mod 256): PUNCH 0x8f4a thru 0x9399 (0x450 bytes) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1328( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1329( 49 mod 256): MAPREAD 0x35000 thru 0x3634d (0x134e bytes) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1330( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1331( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1332( 52 mod 256): WRITE 0x1b000 thru 0x1bfff (0x1000 bytes) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1333( 53 mod 256): MAPWRITE 0x34000 thru 0x3459c (0x59d bytes) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1334( 54 mod 256): MAPREAD 0x42000 thru 0x431ea (0x11eb bytes) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1335( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1336( 56 mod 256): COPY 0x3e000 thru 0x3efff (0x1000 bytes) to 0x49000 thru 0x49fff 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1337( 57 mod 256): MAPWRITE 0x41000 thru 0x42cf5 (0x1cf6 bytes) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1338( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: +1339( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1340( 60 mod 256): TRUNCATE DOWN from 0x67000 to 0xb000 ******WWWW 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1341( 61 mod 256): TRUNCATE UP from 0xb000 to 0x36000 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1342( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1343( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1344( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1345( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1346( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1347( 67 mod 256): WRITE 0x41000 thru 0x41fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1348( 68 mod 256): READ 0x3b000 thru 0x3bfff (0x1000 bytes) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1349( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1350( 70 mod 256): TRUNCATE DOWN from 0x42000 to 0x11000 ******WWWW 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1351( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1352( 72 mod 256): MAPWRITE 0x35000 thru 0x36058 (0x1059 bytes) 2024-03-26T07:41:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: +1353( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1354( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1355( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1356( 76 mod 256): WRITE 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1357( 77 mod 256): MAPWRITE 0x59000 thru 0x5ae87 (0x1e88 bytes) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1358( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1359( 79 mod 256): PUNCH 0x2a9bd thru 0x2c6ab (0x1cef bytes) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1360( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1361( 81 mod 256): MAPWRITE 0x16000 thru 0x160cc (0xcd bytes) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1362( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1363( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1364( 84 mod 256): PUNCH 0x81a7 thru 0x9ce1 (0x1b3b bytes) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1365( 85 mod 256): PUNCH 0x5a0dd thru 0x5ae1a (0xd3e bytes) 2024-03-26T07:41:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: +1366( 86 mod 256): TRUNCATE DOWN from 0x5ae88 to 0x2000 ******WWWW 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1367( 87 mod 256): MAPREAD 0x1000 thru 0x1def (0xdf0 bytes) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1368( 88 mod 256): PUNCH 0x2e9 thru 0x1220 (0xf38 bytes) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1369( 89 mod 256): TRUNCATE UP from 0x2000 to 0x46000 ******WWWW 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1370( 90 mod 256): MAPWRITE 0x53000 thru 0x54e01 (0x1e02 bytes) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1371( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1372( 92 mod 256): WRITE 0x4d000 thru 0x4dfff (0x1000 bytes) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1373( 93 mod 256): WRITE 0x5d000 thru 0x5dfff (0x1000 bytes) HOLE 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1374( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1375( 95 mod 256): PUNCH 0x34920 thru 0x35aed (0x11ce bytes) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1376( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1377( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1378( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1379( 99 mod 256): PUNCH 0x1d4e5 thru 0x1e58b (0x10a7 bytes) 2024-03-26T07:41:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: +1380(100 mod 256): COPY 0x37000 thru 0x37fff (0x1000 bytes) to 0x2f000 thru 0x2ffff EEEE****** 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1381(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1382(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1383(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1384(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1385(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1386(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1387(107 mod 256): MAPREAD 0x40000 thru 0x41281 (0x1282 bytes) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1388(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1389(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1390(110 mod 256): WRITE 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1391(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1392(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1393(113 mod 256): WRITE 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-26T07:41:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: +1394(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1395(115 mod 256): PUNCH 0x419b thru 0x4e51 (0xcb7 bytes) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1396(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1397(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1398(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1399(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1400(120 mod 256): TRUNCATE DOWN from 0x5e000 to 0x4f000 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1401(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1402(122 mod 256): READ 0x1c000 thru 0x1cfff (0x1000 bytes) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1403(123 mod 256): MAPWRITE 0x67000 thru 0x6774b (0x74c bytes) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1404(124 mod 256): TRUNCATE DOWN from 0x6774c to 0x4b000 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1405(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1406(126 mod 256): WRITE 0x2a000 thru 0x2afff (0x1000 bytes) 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1407(127 mod 256): TRUNCATE UP from 0x4b000 to 0x68000 2024-03-26T07:41:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: +1408(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1409(129 mod 256): PUNCH 0x1ab4b thru 0x1ca47 (0x1efd bytes) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1410(130 mod 256): MAPWRITE 0x25000 thru 0x258ab (0x8ac bytes) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1411(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1412(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1413(133 mod 256): TRUNCATE DOWN from 0x68000 to 0xa000 ******WWWW 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1414(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1415(135 mod 256): MAPWRITE 0x35000 thru 0x35221 (0x222 bytes) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1416(136 mod 256): TRUNCATE DOWN from 0x35222 to 0x6000 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1417(137 mod 256): TRUNCATE UP from 0x6000 to 0x6b000 ******WWWW 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1418(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1419(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1420(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: +1421(141 mod 256): WRITE 0x1b000 thru 0x1bfff (0x1000 bytes) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1422(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1423(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1424(144 mod 256): PUNCH 0x5499c thru 0x54c2e (0x293 bytes) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1425(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1426(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1427(147 mod 256): WRITE 0x0 thru 0xfff (0x1000 bytes) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1428(148 mod 256): PUNCH 0x2f503 thru 0x30685 (0x1183 bytes) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1429(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1430(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1431(151 mod 256): PUNCH 0x44db9 thru 0x4685a (0x1aa2 bytes) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1432(152 mod 256): TRUNCATE UP from 0x6b000 to 0x73000 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1433(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1434(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: +1435(155 mod 256): TRUNCATE DOWN from 0x73000 to 0x42000 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1436(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1437(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1438(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1439(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1440(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1441(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1442(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1443(163 mod 256): WRITE 0x21000 thru 0x21fff (0x1000 bytes) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1444(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1445(165 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x1d000 thru 0x1dfff 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1446(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1447(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1448(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: +1449(169 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1450(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1451(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1452(172 mod 256): TRUNCATE UP from 0x5d000 to 0x61000 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1453(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1454(174 mod 256): MAPREAD 0x6000 thru 0x6166 (0x167 bytes) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1455(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1456(176 mod 256): READ 0x2a000 thru 0x2afff (0x1000 bytes) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1457(177 mod 256): PUNCH 0x34c6 thru 0x379d (0x2d8 bytes) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1458(178 mod 256): MAPWRITE 0x6f000 thru 0x6f418 (0x419 bytes) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1459(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1460(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1461(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: +1462(182 mod 256): WRITE 0x2c000 thru 0x2cfff (0x1000 bytes) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1463(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1464(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1465(185 mod 256): WRITE 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1466(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1467(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1468(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1469(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1470(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1471(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1472(192 mod 256): MAPWRITE 0x4d000 thru 0x4dde4 (0xde5 bytes) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1473(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1474(194 mod 256): READ 0x33000 thru 0x33fff (0x1000 bytes) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1475(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1476(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: +1477(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1478(198 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1479(199 mod 256): PUNCH 0xa88f thru 0xb334 (0xaa6 bytes) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1480(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1481(201 mod 256): MAPREAD 0x3a000 thru 0x3a389 (0x38a bytes) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1482(202 mod 256): COPY 0x17000 thru 0x17fff (0x1000 bytes) to 0x69000 thru 0x69fff 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1483(203 mod 256): TRUNCATE DOWN from 0x6f419 to 0x4f000 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1484(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1485(205 mod 256): COPY 0x37000 thru 0x37fff (0x1000 bytes) to 0x79000 thru 0x79fff EEEE****** 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1486(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1487(207 mod 256): MAPREAD 0x17000 thru 0x18b55 (0x1b56 bytes) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1488(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1489(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1490(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: +1491(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1492(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1493(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1494(214 mod 256): MAPREAD 0x7000 thru 0x8800 (0x1801 bytes) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1495(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1496(216 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1497(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1498(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1499(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1500(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1501(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1502(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1503(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1504(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: +1505(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1506(226 mod 256): MAPWRITE 0x59000 thru 0x5a572 (0x1573 bytes) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1507(227 mod 256): MAPREAD 0xb000 thru 0xc455 (0x1456 bytes) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1508(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1509(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1510(230 mod 256): TRUNCATE DOWN from 0x7a000 to 0x1a000 ******WWWW 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1511(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1512(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1513(233 mod 256): MAPREAD 0x9000 thru 0x9e43 (0xe44 bytes) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1514(234 mod 256): WRITE 0x4c000 thru 0x4cfff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1515(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1516(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1517(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1518(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: +1519(239 mod 256): MAPWRITE 0x6000 thru 0x61c8 (0x1c9 bytes) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1520(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1521(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1522(242 mod 256): MAPREAD 0x45000 thru 0x451a0 (0x1a1 bytes) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1523(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1524(244 mod 256): READ 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1525(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1526(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1527(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1528(248 mod 256): MAPREAD 0x41000 thru 0x42e89 (0x1e8a bytes) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1529(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1530(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1531(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1532(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: +1533(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1534(254 mod 256): MAPWRITE 0xc000 thru 0xcd6b (0xd6c bytes) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1535(255 mod 256): COPY 0x45000 thru 0x45fff (0x1000 bytes) to 0x76000 thru 0x76fff 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1536( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1537( 1 mod 256): COPY 0x2b000 thru 0x2bfff (0x1000 bytes) to 0x21000 thru 0x21fff 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1538( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1539( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1540( 4 mod 256): MAPWRITE 0x35000 thru 0x3510e (0x10f bytes) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1541( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1542( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1543( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1544( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1545( 9 mod 256): MAPREAD 0x51000 thru 0x524cd (0x14ce bytes) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1546( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: +1547( 11 mod 256): MAPREAD 0x71000 thru 0x71426 (0x427 bytes) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1548( 12 mod 256): PUNCH 0x31db3 thru 0x329ae (0xbfc bytes) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1549( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1550( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1551( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1552( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1553( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1554( 18 mod 256): MAPWRITE 0x73000 thru 0x74203 (0x1204 bytes) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1555( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1556( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1557( 21 mod 256): MAPWRITE 0x61000 thru 0x61481 (0x482 bytes) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1558( 22 mod 256): PUNCH 0x656f0 thru 0x66d34 (0x1645 bytes) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1559( 23 mod 256): TRUNCATE DOWN from 0x77000 to 0x24000 ******WWWW 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1560( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: +1561( 25 mod 256): PUNCH 0xee9c thru 0xf9b9 (0xb1e bytes) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1562( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1563( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1564( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1565( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1566( 30 mod 256): MAPWRITE 0x30000 thru 0x30cb9 (0xcba bytes) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1567( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1568( 32 mod 256): PUNCH 0x2bd34 thru 0x2c6b4 (0x981 bytes) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1569( 33 mod 256): TRUNCATE UP from 0x30cba to 0x4e000 ******WWWW 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1570( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1571( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1572( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: +1573( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1574( 38 mod 256): PUNCH 0x2942a thru 0x29baf (0x786 bytes) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1575( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1576( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1577( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1578( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1579( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1580( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1581( 45 mod 256): PUNCH 0x2f21d thru 0x3011d (0xf01 bytes) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1582( 46 mod 256): TRUNCATE DOWN from 0x4e000 to 0x7000 ******WWWW 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1583( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1584( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1585( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1586( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: +1587( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1588( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1589( 53 mod 256): PUNCH 0x3429 thru 0x436f (0xf47 bytes) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1590( 54 mod 256): MAPWRITE 0x3e000 thru 0x3e036 (0x37 bytes) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1591( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1592( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1593( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1594( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1595( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1596( 60 mod 256): TRUNCATE DOWN from 0x3e037 to 0x10000 ******WWWW 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1597( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1598( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1599( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1600( 64 mod 256): MAPWRITE 0x26000 thru 0x276d3 (0x16d4 bytes) 2024-03-26T07:41:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: +1601( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1602( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1603( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1604( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1605( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1606( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1607( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1608( 72 mod 256): MAPREAD 0xc000 thru 0xce00 (0xe01 bytes) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1609( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1610( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1611( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1612( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1613( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1614( 78 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: +1615( 79 mod 256): COPY 0xb000 thru 0xbfff (0x1000 bytes) to 0x79000 thru 0x79fff 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1616( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1617( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1618( 82 mod 256): MAPWRITE 0x76000 thru 0x77cbf (0x1cc0 bytes) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1619( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1620( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1621( 85 mod 256): MAPWRITE 0x5c000 thru 0x5c23d (0x23e bytes) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1622( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1623( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1624( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1625( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1626( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1627( 91 mod 256): TRUNCATE DOWN from 0x7a000 to 0x4c000 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1628( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: +1629( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1630( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1631( 95 mod 256): WRITE 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1632( 96 mod 256): READ 0x43000 thru 0x43fff (0x1000 bytes) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1633( 97 mod 256): PUNCH 0x47ae1 thru 0x48530 (0xa50 bytes) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1634( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1635( 99 mod 256): TRUNCATE DOWN from 0x4c000 to 0x25000 ******WWWW 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1636(100 mod 256): PUNCH 0x154d8 thru 0x16fb0 (0x1ad9 bytes) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1637(101 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1638(102 mod 256): MAPWRITE 0x63000 thru 0x6472b (0x172c bytes) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1639(103 mod 256): MAPWRITE 0x24000 thru 0x2419b (0x19c bytes) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1640(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1641(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1642(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: +1643(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1644(108 mod 256): MAPREAD 0x3000 thru 0x36d6 (0x6d7 bytes) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1645(109 mod 256): COPY 0x5f000 thru 0x5ffff (0x1000 bytes) to 0x77000 thru 0x77fff 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1646(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1647(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1648(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1649(113 mod 256): TRUNCATE DOWN from 0x78000 to 0x71000 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1650(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1651(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1652(116 mod 256): WRITE 0x3f000 thru 0x3ffff (0x1000 bytes) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1653(117 mod 256): PUNCH 0x4804e thru 0x484cb (0x47e bytes) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1654(118 mod 256): MAPWRITE 0x4c000 thru 0x4d7bd (0x17be bytes) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1655(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1656(120 mod 256): MAPREAD 0x2d000 thru 0x2d9e4 (0x9e5 bytes) 2024-03-26T07:41:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: +1657(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1658(122 mod 256): TRUNCATE DOWN from 0x71000 to 0x41000 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1659(123 mod 256): MAPWRITE 0x29000 thru 0x294d1 (0x4d2 bytes) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1660(124 mod 256): COPY 0xb000 thru 0xbfff (0x1000 bytes) to 0x4f000 thru 0x4ffff 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1661(125 mod 256): MAPWRITE 0x25000 thru 0x25511 (0x512 bytes) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1662(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1663(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1664(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1665(129 mod 256): MAPREAD 0x45000 thru 0x45c50 (0xc51 bytes) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1666(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1667(131 mod 256): MAPWRITE 0x37000 thru 0x37bfe (0xbff bytes) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1668(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1669(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1670(134 mod 256): MAPWRITE 0x5000 thru 0x5624 (0x625 bytes) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1671(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: +1672(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1673(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1674(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1675(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1676(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1677(141 mod 256): MAPWRITE 0x74000 thru 0x74200 (0x201 bytes) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1678(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1679(143 mod 256): WRITE 0x55000 thru 0x55fff (0x1000 bytes) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1680(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1681(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1682(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1683(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1684(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: +1685(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1686(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1687(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1688(152 mod 256): MAPWRITE 0x35000 thru 0x36b24 (0x1b25 bytes) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1689(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1690(154 mod 256): MAPWRITE 0x1a000 thru 0x1a440 (0x441 bytes) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1691(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1692(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1693(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1694(158 mod 256): MAPWRITE 0x2f000 thru 0x30284 (0x1285 bytes) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1695(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1696(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1697(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1698(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: +1699(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1700(164 mod 256): TRUNCATE DOWN from 0x74201 to 0x2c000 ******WWWW 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1701(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1702(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1703(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1704(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1705(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1706(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1707(171 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1708(172 mod 256): MAPWRITE 0x1a000 thru 0x1a29b (0x29c bytes) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1709(173 mod 256): PUNCH 0x15c5d thru 0x16756 (0xafa bytes) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1710(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1711(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1712(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1713(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: +1714(178 mod 256): MAPREAD 0x1d000 thru 0x1d60a (0x60b bytes) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1715(179 mod 256): MAPREAD 0x11000 thru 0x1177b (0x77c bytes) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1716(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1717(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1718(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1719(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1720(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1721(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1722(186 mod 256): MAPREAD 0x1c000 thru 0x1c821 (0x822 bytes) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1723(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1724(188 mod 256): PUNCH 0x2bb59 thru 0x2bfff (0x4a7 bytes) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1725(189 mod 256): TRUNCATE UP from 0x2c000 to 0x67000 ******WWWW 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1726(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: +1727(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1728(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1729(193 mod 256): TRUNCATE DOWN from 0x67000 to 0xc000 ******WWWW 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1730(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1731(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1732(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1733(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1734(198 mod 256): MAPREAD 0xb000 thru 0xb477 (0x478 bytes) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1735(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1736(200 mod 256): MAPWRITE 0x27000 thru 0x28005 (0x1006 bytes) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1737(201 mod 256): MAPWRITE 0x6f000 thru 0x6f3cb (0x3cc bytes) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1738(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1739(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: +1740(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1741(205 mod 256): COPY 0x34000 thru 0x34fff (0x1000 bytes) to 0x49000 thru 0x49fff 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1742(206 mod 256): READ 0x58000 thru 0x58fff (0x1000 bytes) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1743(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1744(208 mod 256): READ 0x17000 thru 0x17fff (0x1000 bytes) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1745(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1746(210 mod 256): TRUNCATE DOWN from 0x6f3cc to 0x42000 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1747(211 mod 256): TRUNCATE DOWN from 0x42000 to 0x3000 ******WWWW 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1748(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1749(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1750(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1751(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1752(216 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1753(217 mod 256): PUNCH 0x264d thru 0x2fff (0x9b3 bytes) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1754(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: +1755(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1756(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1757(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1758(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1759(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1760(224 mod 256): MAPWRITE 0x4c000 thru 0x4c79a (0x79b bytes) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1761(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1762(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1763(227 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1764(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1765(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1766(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1767(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1768(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: +1769(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1770(234 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1771(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1772(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1773(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1774(238 mod 256): PUNCH 0xeb0f thru 0xf289 (0x77b bytes) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1775(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1776(240 mod 256): MAPWRITE 0x55000 thru 0x56522 (0x1523 bytes) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1777(241 mod 256): MAPWRITE 0x35000 thru 0x353b3 (0x3b4 bytes) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1778(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1779(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1780(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1781(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1782(246 mod 256): MAPREAD 0x3d000 thru 0x3e931 (0x1932 bytes) 2024-03-26T07:41:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: +1783(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1784(248 mod 256): PUNCH 0x17f89 thru 0x19b53 (0x1bcb bytes) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1785(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1786(250 mod 256): READ 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1787(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1788(252 mod 256): MAPREAD 0xc000 thru 0xd222 (0x1223 bytes) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1789(253 mod 256): MAPWRITE 0x73000 thru 0x74b92 (0x1b93 bytes) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1790(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1791(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1792( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1793( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1794( 2 mod 256): TRUNCATE DOWN from 0x74b93 to 0x6f000 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1795( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1796( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: +1797( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1798( 6 mod 256): PUNCH 0x23b48 thru 0x23ccc (0x185 bytes) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1799( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1800( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1801( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1802( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1803( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1804( 12 mod 256): MAPWRITE 0x19000 thru 0x19177 (0x178 bytes) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1805( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1806( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1807( 15 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1808( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1809( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: +1810( 18 mod 256): PUNCH 0x43902 thru 0x4532c (0x1a2b bytes) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1811( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1812( 20 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5e000 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1813( 21 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1814( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1815( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1816( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1817( 25 mod 256): TRUNCATE DOWN from 0x77000 to 0x76000 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1818( 26 mod 256): PUNCH 0x240f6 thru 0x25661 (0x156c bytes) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1819( 27 mod 256): TRUNCATE DOWN from 0x76000 to 0x5e000 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1820( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1821( 29 mod 256): WRITE 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1822( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1823( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: +1824( 32 mod 256): TRUNCATE DOWN from 0x5e000 to 0x2c000 ******WWWW 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1825( 33 mod 256): COPY 0x11000 thru 0x11fff (0x1000 bytes) to 0x7000 thru 0x7fff 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1826( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1827( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1828( 36 mod 256): MAPWRITE 0x58000 thru 0x59f13 (0x1f14 bytes) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1829( 37 mod 256): WRITE 0x1b000 thru 0x1bfff (0x1000 bytes) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1830( 38 mod 256): TRUNCATE UP from 0x59f14 to 0x77000 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1831( 39 mod 256): MAPWRITE 0x75000 thru 0x75761 (0x762 bytes) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1832( 40 mod 256): PUNCH 0x341ff thru 0x35b98 (0x199a bytes) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1833( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1834( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1835( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1836( 44 mod 256): MAPREAD 0x46000 thru 0x473e2 (0x13e3 bytes) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1837( 45 mod 256): PUNCH 0x3d073 thru 0x3dfac (0xf3a bytes) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1838( 46 mod 256): PUNCH 0x44935 thru 0x4590f (0xfdb bytes) 2024-03-26T07:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: +1839( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1840( 48 mod 256): MAPWRITE 0x5c000 thru 0x5c887 (0x888 bytes) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1841( 49 mod 256): TRUNCATE DOWN from 0x77000 to 0x14000 ******WWWW 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1842( 50 mod 256): MAPREAD 0x12000 thru 0x1216b (0x16c bytes) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1843( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1844( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1845( 53 mod 256): READ 0xa000 thru 0xafff (0x1000 bytes) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1846( 54 mod 256): MAPREAD 0xc000 thru 0xd2d0 (0x12d1 bytes) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1847( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1848( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1849( 57 mod 256): MAPWRITE 0x3d000 thru 0x3d9e2 (0x9e3 bytes) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1850( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1851( 59 mod 256): PUNCH 0x39d78 thru 0x3a6c6 (0x94f bytes) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1852( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: +1853( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1854( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1855( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1856( 64 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x40000 thru 0x40fff 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1857( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1858( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1859( 67 mod 256): WRITE 0x50000 thru 0x50fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1860( 68 mod 256): MAPWRITE 0x3d000 thru 0x3e9b7 (0x19b8 bytes) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1861( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1862( 70 mod 256): MAPWRITE 0x5000 thru 0x5ff8 (0xff9 bytes) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1863( 71 mod 256): MAPWRITE 0x69000 thru 0x6a08f (0x1090 bytes) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1864( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1865( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: +1866( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1867( 75 mod 256): PUNCH 0x1cbb thru 0x2898 (0xbde bytes) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1868( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1869( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1870( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1871( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1872( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1873( 81 mod 256): COPY 0x68000 thru 0x68fff (0x1000 bytes) to 0x1b000 thru 0x1bfff 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1874( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1875( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1876( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1877( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1878( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: +1879( 87 mod 256): PUNCH 0x2f7b8 thru 0x2fe87 (0x6d0 bytes) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1880( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1881( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1882( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1883( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1884( 92 mod 256): MAPREAD 0x3c000 thru 0x3c27a (0x27b bytes) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1885( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1886( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1887( 95 mod 256): MAPREAD 0x51000 thru 0x52178 (0x1179 bytes) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1888( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1889( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1890( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1891( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1892(100 mod 256): MAPWRITE 0x2b000 thru 0x2b608 (0x609 bytes) 2024-03-26T07:41:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: +1893(101 mod 256): TRUNCATE DOWN from 0x6a090 to 0x2a000 ******WWWW 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1894(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1895(103 mod 256): READ 0x12000 thru 0x12fff (0x1000 bytes) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1896(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1897(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1898(106 mod 256): WRITE 0x26000 thru 0x26fff (0x1000 bytes) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1899(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1900(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1901(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1902(110 mod 256): PUNCH 0x1a628 thru 0x1a9d3 (0x3ac bytes) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1903(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1904(112 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1905(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1906(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: +1907(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1908(116 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) HOLE 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1909(117 mod 256): PUNCH 0x9ac7 thru 0xb368 (0x18a2 bytes) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1910(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1911(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1912(120 mod 256): MAPREAD 0x11000 thru 0x11a85 (0xa86 bytes) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1913(121 mod 256): TRUNCATE DOWN from 0x2e000 to 0x1f000 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1914(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1915(123 mod 256): TRUNCATE DOWN from 0x1f000 to 0xc000 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1916(124 mod 256): MAPWRITE 0x5000 thru 0x66ec (0x16ed bytes) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1917(125 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x3f000 thru 0x3ffff 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1918(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1919(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1920(128 mod 256): TRUNCATE DOWN from 0x40000 to 0x1c000 ******WWWW 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1921(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: +1922(130 mod 256): MAPREAD 0x10000 thru 0x10462 (0x463 bytes) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1923(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1924(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1925(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1926(134 mod 256): MAPREAD 0x0 thru 0xa72 (0xa73 bytes) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1927(135 mod 256): MAPWRITE 0x70000 thru 0x71ac9 (0x1aca bytes) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1928(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1929(137 mod 256): READ 0x46000 thru 0x46fff (0x1000 bytes) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1930(138 mod 256): MAPREAD 0x69000 thru 0x6aade (0x1adf bytes) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1931(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1932(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1933(141 mod 256): READ 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1934(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1935(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: +1936(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1937(145 mod 256): MAPREAD 0x66000 thru 0x677a5 (0x17a6 bytes) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1938(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1939(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1940(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1941(149 mod 256): WRITE 0x3b000 thru 0x3bfff (0x1000 bytes) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1942(150 mod 256): WRITE 0x78000 thru 0x78fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1943(151 mod 256): TRUNCATE DOWN from 0x79000 to 0x3c000 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1944(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1945(153 mod 256): MAPREAD 0x9000 thru 0x9c56 (0xc57 bytes) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1946(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1947(155 mod 256): TRUNCATE UP from 0x3c000 to 0x5c000 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1948(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1949(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: +1950(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1951(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1952(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1953(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1954(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1955(163 mod 256): PUNCH 0x20a5f thru 0x22084 (0x1626 bytes) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1956(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1957(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1958(166 mod 256): PUNCH 0x3a06e thru 0x3ba11 (0x19a4 bytes) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1959(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1960(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1961(169 mod 256): TRUNCATE DOWN from 0x5c000 to 0x8000 ******WWWW 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1962(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: +1963(171 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x65000 thru 0x65fff 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1964(172 mod 256): TRUNCATE DOWN from 0x66000 to 0x4000 ******WWWW 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1965(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1966(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1967(175 mod 256): MAPREAD 0x3000 thru 0x3b87 (0xb88 bytes) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1968(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1969(177 mod 256): TRUNCATE UP from 0x4000 to 0x63000 ******WWWW 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1970(178 mod 256): MAPREAD 0x53000 thru 0x53193 (0x194 bytes) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1971(179 mod 256): COPY 0x4e000 thru 0x4efff (0x1000 bytes) to 0x3a000 thru 0x3afff 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1972(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1973(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1974(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1975(183 mod 256): MAPREAD 0x44000 thru 0x449ac (0x9ad bytes) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1976(184 mod 256): MAPWRITE 0x28000 thru 0x28540 (0x541 bytes) 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1977(185 mod 256): TRUNCATE UP from 0x63000 to 0x76000 2024-03-26T07:41:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: +1978(186 mod 256): TRUNCATE DOWN from 0x76000 to 0x3000 ******WWWW 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1979(187 mod 256): PUNCH 0xcd8 thru 0x179b (0xac4 bytes) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1980(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1981(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1982(190 mod 256): MAPREAD 0x0 thru 0x6d2 (0x6d3 bytes) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1983(191 mod 256): TRUNCATE UP from 0x3000 to 0x5d000 ******WWWW 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1984(192 mod 256): MAPWRITE 0x1d000 thru 0x1e06c (0x106d bytes) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1985(193 mod 256): MAPREAD 0xc000 thru 0xd669 (0x166a bytes) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1986(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1987(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1988(196 mod 256): MAPWRITE 0x1f000 thru 0x20284 (0x1285 bytes) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1989(197 mod 256): WRITE 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1990(198 mod 256): MAPWRITE 0x1d000 thru 0x1e64f (0x1650 bytes) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1991(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: +1992(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +1993(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +1994(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +1995(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +1996(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +1997(205 mod 256): MAPREAD 0x3000 thru 0x38a7 (0x8a8 bytes) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +1998(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +1999(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +2000(208 mod 256): TRUNCATE UP from 0x5d000 to 0x78000 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +2001(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +2002(210 mod 256): PUNCH 0x1663d thru 0x16caf (0x673 bytes) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +2003(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +2004(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +2005(213 mod 256): READ 0x5b000 thru 0x5bfff (0x1000 bytes) 2024-03-26T07:41:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: +2006(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2007(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2008(216 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2009(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2010(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2011(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2012(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2013(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2014(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2015(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2016(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2017(225 mod 256): MAPWRITE 0x29000 thru 0x2a9a4 (0x19a5 bytes) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2018(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2019(227 mod 256): MAPREAD 0x51000 thru 0x518a7 (0x8a8 bytes) 2024-03-26T07:41:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: +2020(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2021(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2022(230 mod 256): MAPWRITE 0x1d000 thru 0x1d773 (0x774 bytes) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2023(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2024(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2025(233 mod 256): MAPWRITE 0x2a000 thru 0x2b7c9 (0x17ca bytes) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2026(234 mod 256): TRUNCATE DOWN from 0x78000 to 0x5b000 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2027(235 mod 256): MAPWRITE 0x5e000 thru 0x5efc9 (0xfca bytes) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2028(236 mod 256): READ 0x19000 thru 0x19fff (0x1000 bytes) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2029(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2030(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2031(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2032(240 mod 256): COPY 0x28000 thru 0x28fff (0x1000 bytes) to 0x34000 thru 0x34fff 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2033(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: +2034(242 mod 256): MAPREAD 0x10000 thru 0x104af (0x4b0 bytes) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2035(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2036(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2037(245 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x18000 thru 0x18fff 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2038(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2039(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2040(248 mod 256): PUNCH 0x4c9db thru 0x4dda3 (0x13c9 bytes) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2041(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2042(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2043(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2044(252 mod 256): READ 0x44000 thru 0x44fff (0x1000 bytes) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2045(253 mod 256): PUNCH 0x447d3 thru 0x4557a (0xda8 bytes) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2046(254 mod 256): TRUNCATE DOWN from 0x5efca to 0x1e000 ******WWWW 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2047(255 mod 256): MAPREAD 0x0 thru 0x694 (0x695 bytes) 2024-03-26T07:41:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: +2048( 0 mod 256): TRUNCATE DOWN from 0x1e000 to 0x8000 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2049( 1 mod 256): MAPREAD 0x4000 thru 0x4031 (0x32 bytes) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2050( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2051( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2052( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2053( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2054( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2055( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2056( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2057( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2058( 10 mod 256): MAPREAD 0x2000 thru 0x264e (0x64f bytes) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2059( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2060( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2061( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: +2062( 14 mod 256): MAPWRITE 0x56000 thru 0x561e6 (0x1e7 bytes) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2063( 15 mod 256): TRUNCATE DOWN from 0x561e7 to 0x1c000 ******WWWW 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2064( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2065( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2066( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2067( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2068( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2069( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2070( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2071( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2072( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2073( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2074( 26 mod 256): MAPREAD 0xd000 thru 0xd610 (0x611 bytes) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2075( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: +2076( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2077( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2078( 30 mod 256): MAPWRITE 0x36000 thru 0x37238 (0x1239 bytes) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2079( 31 mod 256): READ 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2080( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2081( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2082( 34 mod 256): MAPWRITE 0xd000 thru 0xde90 (0xe91 bytes) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2083( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2084( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2085( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2086( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2087( 39 mod 256): MAPWRITE 0x5f000 thru 0x606d5 (0x16d6 bytes) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2088( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2089( 41 mod 256): MAPREAD 0x1c000 thru 0x1d4c5 (0x14c6 bytes) 2024-03-26T07:41:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: +2090( 42 mod 256): MAPREAD 0xc000 thru 0xca92 (0xa93 bytes) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2091( 43 mod 256): PUNCH 0x8687 thru 0x8dfb (0x775 bytes) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2092( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2093( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2094( 46 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2095( 47 mod 256): READ 0x4a000 thru 0x4afff (0x1000 bytes) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2096( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2097( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2098( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2099( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2100( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2101( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2102( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2103( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: +2104( 56 mod 256): PUNCH 0x2a2d6 thru 0x2acef (0xa1a bytes) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2105( 57 mod 256): WRITE 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2106( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2107( 59 mod 256): TRUNCATE DOWN from 0x606d6 to 0x1e000 ******WWWW 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2108( 60 mod 256): WRITE 0x52000 thru 0x52fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2109( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2110( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2111( 63 mod 256): MAPREAD 0x50000 thru 0x51b82 (0x1b83 bytes) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2112( 64 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x78000 thru 0x78fff 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2113( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2114( 66 mod 256): MAPREAD 0x23000 thru 0x232fb (0x2fc bytes) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2115( 67 mod 256): MAPREAD 0x78000 thru 0x7816f (0x170 bytes) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2116( 68 mod 256): WRITE 0x5a000 thru 0x5afff (0x1000 bytes) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2117( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: +2118( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2119( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2120( 72 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2121( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2122( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2123( 75 mod 256): PUNCH 0x5dd81 thru 0x5e8b3 (0xb33 bytes) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2124( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2125( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2126( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2127( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2128( 80 mod 256): MAPREAD 0x2b000 thru 0x2b572 (0x573 bytes) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2129( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2130( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2131( 83 mod 256): WRITE 0x51000 thru 0x51fff (0x1000 bytes) 2024-03-26T07:41:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: +2132( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2133( 85 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2134( 86 mod 256): COPY 0x77000 thru 0x77fff (0x1000 bytes) to 0x64000 thru 0x64fff 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2135( 87 mod 256): MAPREAD 0x72000 thru 0x72afd (0xafe bytes) 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2136( 88 mod 256): MAPREAD 0x1b000 thru 0x1b66a (0x66b bytes) 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2137( 89 mod 256): TRUNCATE DOWN from 0x79000 to 0x5000 ******WWWW 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2138( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2139( 91 mod 256): PUNCH 0x4318 thru 0x4fff (0xce8 bytes) 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2140( 92 mod 256): WRITE 0x2a000 thru 0x2afff (0x1000 bytes) HOLE 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2141( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2142( 94 mod 256): MAPWRITE 0x16000 thru 0x16b95 (0xb96 bytes) 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2143( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2144( 96 mod 256): WRITE 0x4a000 thru 0x4afff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: +2145( 97 mod 256): MAPREAD 0x4000 thru 0x422f (0x230 bytes) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2146( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2147( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2148(100 mod 256): TRUNCATE UP from 0x4b000 to 0x53000 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2149(101 mod 256): MAPWRITE 0x35000 thru 0x352a5 (0x2a6 bytes) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2150(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2151(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2152(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2153(105 mod 256): PUNCH 0x23e44 thru 0x25246 (0x1403 bytes) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2154(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2155(107 mod 256): PUNCH 0x11e64 thru 0x13346 (0x14e3 bytes) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2156(108 mod 256): MAPREAD 0x24000 thru 0x25341 (0x1342 bytes) 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2157(109 mod 256): TRUNCATE DOWN from 0x53000 to 0x34000 ******WWWW 2024-03-26T07:41:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: +2158(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2159(111 mod 256): PUNCH 0x67db thru 0x7e6f (0x1695 bytes) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2160(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2161(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2162(114 mod 256): MAPWRITE 0x54000 thru 0x5538e (0x138f bytes) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2163(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2164(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2165(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2166(118 mod 256): PUNCH 0x14ba2 thru 0x153b6 (0x815 bytes) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2167(119 mod 256): WRITE 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2168(120 mod 256): READ 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2169(121 mod 256): MAPREAD 0xc000 thru 0xd2cf (0x12d0 bytes) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2170(122 mod 256): PUNCH 0x40696 thru 0x4090a (0x275 bytes) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2171(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: +2172(124 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2173(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2174(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2175(127 mod 256): READ 0xa000 thru 0xafff (0x1000 bytes) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2176(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2177(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2178(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2179(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2180(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2181(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2182(134 mod 256): MAPWRITE 0x22000 thru 0x234f5 (0x14f6 bytes) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2183(135 mod 256): PUNCH 0xda08 thru 0xf96d (0x1f66 bytes) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2184(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: +2185(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2186(138 mod 256): MAPWRITE 0x39000 thru 0x3ad04 (0x1d05 bytes) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2187(139 mod 256): TRUNCATE DOWN from 0x5538f to 0x3c000 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2188(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2189(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2190(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2191(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2192(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2193(145 mod 256): WRITE 0x50000 thru 0x50fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2194(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2195(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2196(148 mod 256): TRUNCATE DOWN from 0x51000 to 0x7000 ******WWWW 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2197(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2198(150 mod 256): TRUNCATE UP from 0x7000 to 0x12000 2024-03-26T07:41:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: +2199(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2200(152 mod 256): TRUNCATE UP from 0x12000 to 0x13000 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2201(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2202(154 mod 256): PUNCH 0xb7fb thru 0xb864 (0x6a bytes) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2203(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2204(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2205(157 mod 256): TRUNCATE DOWN from 0x13000 to 0x5000 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2206(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2207(159 mod 256): MAPREAD 0x1000 thru 0x2492 (0x1493 bytes) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2208(160 mod 256): READ 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2209(161 mod 256): MAPWRITE 0x5000 thru 0x501e (0x1f bytes) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2210(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2211(163 mod 256): MAPWRITE 0x27000 thru 0x279f1 (0x9f2 bytes) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2212(164 mod 256): READ 0x1e000 thru 0x1efff (0x1000 bytes) 2024-03-26T07:41:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: +2213(165 mod 256): WRITE 0x62000 thru 0x62fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2214(166 mod 256): WRITE 0xf000 thru 0xffff (0x1000 bytes) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2215(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2216(168 mod 256): TRUNCATE DOWN from 0x63000 to 0xa000 ******WWWW 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2217(169 mod 256): MAPREAD 0x4000 thru 0x4c1e (0xc1f bytes) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2218(170 mod 256): READ 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2219(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2220(172 mod 256): TRUNCATE UP from 0xa000 to 0x1e000 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2221(173 mod 256): MAPREAD 0x1c000 thru 0x1c59d (0x59e bytes) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2222(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2223(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2224(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2225(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: +2226(178 mod 256): MAPWRITE 0x6b000 thru 0x6c20d (0x120e bytes) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2227(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2228(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2229(181 mod 256): TRUNCATE UP from 0x6c20e to 0x73000 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2230(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2231(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2232(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2233(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2234(186 mod 256): COPY 0x1c000 thru 0x1cfff (0x1000 bytes) to 0x42000 thru 0x42fff 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2235(187 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2236(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2237(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2238(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2239(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: +2240(192 mod 256): PUNCH 0x138e4 thru 0x149ba (0x10d7 bytes) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2241(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2242(194 mod 256): WRITE 0x4f000 thru 0x4ffff (0x1000 bytes) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2243(195 mod 256): MAPWRITE 0x13000 thru 0x14874 (0x1875 bytes) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2244(196 mod 256): READ 0x1a000 thru 0x1afff (0x1000 bytes) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2245(197 mod 256): MAPREAD 0x31000 thru 0x32320 (0x1321 bytes) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2246(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2247(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2248(200 mod 256): READ 0x6d000 thru 0x6dfff (0x1000 bytes) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2249(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2250(202 mod 256): WRITE 0x14000 thru 0x14fff (0x1000 bytes) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2251(203 mod 256): TRUNCATE DOWN from 0x73000 to 0x22000 ******WWWW 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2252(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2253(205 mod 256): TRUNCATE UP from 0x22000 to 0x64000 ******WWWW 2024-03-26T07:41:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: +2254(206 mod 256): READ 0x4c000 thru 0x4cfff (0x1000 bytes) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2255(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2256(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2257(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2258(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2259(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2260(212 mod 256): MAPWRITE 0x6c000 thru 0x6ced4 (0xed5 bytes) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2261(213 mod 256): MAPWRITE 0x29000 thru 0x290e1 (0xe2 bytes) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2262(214 mod 256): MAPREAD 0x6000 thru 0x61ec (0x1ed bytes) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2263(215 mod 256): PUNCH 0x5d6a0 thru 0x5f1e6 (0x1b47 bytes) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2264(216 mod 256): MAPREAD 0xd000 thru 0xea95 (0x1a96 bytes) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2265(217 mod 256): TRUNCATE DOWN from 0x6ced5 to 0x6000 ******WWWW 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2266(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: +2267(219 mod 256): MAPWRITE 0x21000 thru 0x2246a (0x146b bytes) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2268(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2269(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2270(222 mod 256): MAPWRITE 0x58000 thru 0x58fab (0xfac bytes) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2271(223 mod 256): COPY 0x29000 thru 0x29fff (0x1000 bytes) to 0xa000 thru 0xafff 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2272(224 mod 256): MAPREAD 0x4b000 thru 0x4c178 (0x1179 bytes) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2273(225 mod 256): READ 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2274(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2275(227 mod 256): READ 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2276(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2277(229 mod 256): MAPREAD 0x1b000 thru 0x1c17a (0x117b bytes) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2278(230 mod 256): WRITE 0xc000 thru 0xcfff (0x1000 bytes) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2279(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2280(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: +2281(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2282(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2283(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2284(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2285(237 mod 256): MAPREAD 0x20000 thru 0x2004a (0x4b bytes) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2286(238 mod 256): TRUNCATE UP from 0x58fac to 0x78000 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2287(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2288(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2289(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2290(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2291(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2292(244 mod 256): PUNCH 0x3ac27 thru 0x3c310 (0x16ea bytes) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2293(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: +2294(246 mod 256): TRUNCATE DOWN from 0x78000 to 0x43000 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2295(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2296(248 mod 256): TRUNCATE DOWN from 0x43000 to 0x21000 ******WWWW 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2297(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2298(250 mod 256): MAPREAD 0xb000 thru 0xbc10 (0xc11 bytes) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2299(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2300(252 mod 256): MAPREAD 0x1000 thru 0x25ae (0x15af bytes) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2301(253 mod 256): TRUNCATE UP from 0x21000 to 0x63000 ******WWWW 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2302(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2303(255 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2304( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2305( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2306( 2 mod 256): MAPREAD 0x1d000 thru 0x1e558 (0x1559 bytes) 2024-03-26T07:41:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: +2307( 3 mod 256): WRITE 0x6b000 thru 0x6bfff (0x1000 bytes) HOLE 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2308( 4 mod 256): MAPWRITE 0x3000 thru 0x4876 (0x1877 bytes) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2309( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2310( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2311( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2312( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2313( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2314( 10 mod 256): MAPWRITE 0x48000 thru 0x49b81 (0x1b82 bytes) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2315( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2316( 12 mod 256): PUNCH 0x50c71 thru 0x50db7 (0x147 bytes) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2317( 13 mod 256): PUNCH 0x3e759 thru 0x3f117 (0x9bf bytes) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2318( 14 mod 256): WRITE 0x41000 thru 0x41fff (0x1000 bytes) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2319( 15 mod 256): MAPWRITE 0x38000 thru 0x39a5f (0x1a60 bytes) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2320( 16 mod 256): MAPREAD 0x35000 thru 0x36a24 (0x1a25 bytes) 2024-03-26T07:41:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: +2321( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2322( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2323( 19 mod 256): MAPWRITE 0x45000 thru 0x45c1a (0xc1b bytes) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2324( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2325( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2326( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2327( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2328( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2329( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2330( 26 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2331( 27 mod 256): TRUNCATE DOWN from 0x6c000 to 0x21000 ******WWWW 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2332( 28 mod 256): TRUNCATE UP from 0x21000 to 0x66000 ******WWWW 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2333( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2334( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: +2335( 31 mod 256): MAPREAD 0x13000 thru 0x141d4 (0x11d5 bytes) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2336( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2337( 33 mod 256): COPY 0xb000 thru 0xbfff (0x1000 bytes) to 0x1000 thru 0x1fff 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2338( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2339( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2340( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2341( 37 mod 256): COPY 0x56000 thru 0x56fff (0x1000 bytes) to 0x4e000 thru 0x4efff 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2342( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2343( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2344( 40 mod 256): READ 0x62000 thru 0x62fff (0x1000 bytes) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2345( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2346( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2347( 43 mod 256): MAPREAD 0x29000 thru 0x29a55 (0xa56 bytes) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2348( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: +2349( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2350( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2351( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2352( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2353( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2354( 50 mod 256): MAPWRITE 0x4c000 thru 0x4d052 (0x1053 bytes) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2355( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2356( 52 mod 256): MAPWRITE 0x2c000 thru 0x2c2dd (0x2de bytes) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2357( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2358( 54 mod 256): READ 0x4f000 thru 0x4ffff (0x1000 bytes) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2359( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2360( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2361( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2362( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: +2363( 59 mod 256): PUNCH 0x353ba thru 0x3594d (0x594 bytes) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2364( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2365( 61 mod 256): MAPREAD 0x41000 thru 0x41f4a (0xf4b bytes) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2366( 62 mod 256): MAPREAD 0x50000 thru 0x51d1b (0x1d1c bytes) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2367( 63 mod 256): PUNCH 0x1e36c thru 0x1ea48 (0x6dd bytes) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2368( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2369( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2370( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2371( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2372( 68 mod 256): TRUNCATE DOWN from 0x66000 to 0x13000 ******WWWW 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2373( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2374( 70 mod 256): MAPREAD 0xd000 thru 0xdaa7 (0xaa8 bytes) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2375( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2376( 72 mod 256): MAPWRITE 0x69000 thru 0x69cba (0xcbb bytes) 2024-03-26T07:41:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: +2377( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2378( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2379( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2380( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2381( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2382( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2383( 79 mod 256): MAPWRITE 0x37000 thru 0x37ef8 (0xef9 bytes) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2384( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2385( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2386( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2387( 83 mod 256): MAPREAD 0x6000 thru 0x7dff (0x1e00 bytes) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2388( 84 mod 256): MAPREAD 0x15000 thru 0x15bef (0xbf0 bytes) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2389( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2390( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: +2391( 87 mod 256): PUNCH 0x36719 thru 0x37cd7 (0x15bf bytes) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2392( 88 mod 256): READ 0xd000 thru 0xdfff (0x1000 bytes) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2393( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2394( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2395( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2396( 92 mod 256): COPY 0x16000 thru 0x16fff (0x1000 bytes) to 0x50000 thru 0x50fff 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2397( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2398( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2399( 95 mod 256): MAPWRITE 0xc000 thru 0xcce2 (0xce3 bytes) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2400( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2401( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2402( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2403( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: +2404(100 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2405(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2406(102 mod 256): MAPREAD 0x11000 thru 0x1288b (0x188c bytes) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2407(103 mod 256): TRUNCATE DOWN from 0x69cbb to 0x63000 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2408(104 mod 256): TRUNCATE UP from 0x63000 to 0x70000 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2409(105 mod 256): MAPWRITE 0x5d000 thru 0x5d1f0 (0x1f1 bytes) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2410(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2411(107 mod 256): TRUNCATE UP from 0x70000 to 0x74000 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2412(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2413(109 mod 256): READ 0x48000 thru 0x48fff (0x1000 bytes) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2414(110 mod 256): WRITE 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2415(111 mod 256): WRITE 0x59000 thru 0x59fff (0x1000 bytes) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2416(112 mod 256): MAPWRITE 0x51000 thru 0x52c6d (0x1c6e bytes) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2417(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: +2418(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2419(115 mod 256): MAPWRITE 0x66000 thru 0x67801 (0x1802 bytes) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2420(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2421(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2422(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2423(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2424(120 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2425(121 mod 256): MAPWRITE 0x3b000 thru 0x3c2db (0x12dc bytes) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2426(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2427(123 mod 256): MAPWRITE 0x72000 thru 0x73637 (0x1638 bytes) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2428(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2429(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2430(126 mod 256): COPY 0x64000 thru 0x64fff (0x1000 bytes) to 0x73000 thru 0x73fff 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2431(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: +2432(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2433(129 mod 256): MAPREAD 0x4f000 thru 0x50d7a (0x1d7b bytes) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2434(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2435(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2436(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2437(133 mod 256): PUNCH 0x571bd thru 0x588d8 (0x171c bytes) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2438(134 mod 256): WRITE 0x2f000 thru 0x2ffff (0x1000 bytes) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2439(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2440(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2441(137 mod 256): TRUNCATE DOWN from 0x74000 to 0x6a000 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2442(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2443(139 mod 256): COPY 0x28000 thru 0x28fff (0x1000 bytes) to 0x3d000 thru 0x3dfff 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2444(140 mod 256): MAPREAD 0x50000 thru 0x51f56 (0x1f57 bytes) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2445(141 mod 256): MAPREAD 0x24000 thru 0x24898 (0x899 bytes) 2024-03-26T07:41:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: +2446(142 mod 256): PUNCH 0x358e0 thru 0x36d36 (0x1457 bytes) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2447(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2448(144 mod 256): COPY 0x37000 thru 0x37fff (0x1000 bytes) to 0x23000 thru 0x23fff EEEE****** 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2449(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2450(146 mod 256): TRUNCATE UP from 0x6a000 to 0x6b000 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2451(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2452(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2453(149 mod 256): PUNCH 0x3e14e thru 0x3eb46 (0x9f9 bytes) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2454(150 mod 256): PUNCH 0x490c0 thru 0x4af59 (0x1e9a bytes) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2455(151 mod 256): MAPWRITE 0x6a000 thru 0x6b1d7 (0x11d8 bytes) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2456(152 mod 256): MAPREAD 0x68000 thru 0x69024 (0x1025 bytes) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2457(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2458(154 mod 256): COPY 0x5c000 thru 0x5cfff (0x1000 bytes) to 0x41000 thru 0x41fff 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2459(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: +2460(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2461(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2462(158 mod 256): READ 0x2f000 thru 0x2ffff (0x1000 bytes) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2463(159 mod 256): PUNCH 0x40348 thru 0x4182b (0x14e4 bytes) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2464(160 mod 256): TRUNCATE DOWN from 0x6b1d8 to 0x5f000 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2465(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2466(162 mod 256): MAPREAD 0x1d000 thru 0x1ec9d (0x1c9e bytes) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2467(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2468(164 mod 256): MAPREAD 0x26000 thru 0x278a4 (0x18a5 bytes) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2469(165 mod 256): MAPREAD 0x53000 thru 0x53850 (0x851 bytes) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2470(166 mod 256): TRUNCATE DOWN from 0x5f000 to 0x17000 ******WWWW 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2471(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2472(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2473(169 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: +2474(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2475(171 mod 256): COPY 0x2e000 thru 0x2efff (0x1000 bytes) to 0x2000 thru 0x2fff 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2476(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2477(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2478(174 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x6f000 thru 0x6ffff 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2479(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2480(176 mod 256): MAPREAD 0x11000 thru 0x12a61 (0x1a62 bytes) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2481(177 mod 256): READ 0x6c000 thru 0x6cfff (0x1000 bytes) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2482(178 mod 256): COPY 0x26000 thru 0x26fff (0x1000 bytes) to 0x48000 thru 0x48fff 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2483(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2484(180 mod 256): PUNCH 0x5c600 thru 0x5e1fc (0x1bfd bytes) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2485(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2486(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: +2487(183 mod 256): READ 0x34000 thru 0x34fff (0x1000 bytes) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2488(184 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x67000 thru 0x67fff 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2489(185 mod 256): MAPWRITE 0x71000 thru 0x723a2 (0x13a3 bytes) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2490(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2491(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2492(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2493(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2494(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2495(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2496(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2497(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2498(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2499(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2500(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2501(197 mod 256): TRUNCATE DOWN from 0x75000 to 0x10000 ******WWWW 2024-03-26T07:41:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: +2502(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2503(199 mod 256): MAPWRITE 0x2b000 thru 0x2cdca (0x1dcb bytes) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2504(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2505(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2506(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2507(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2508(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2509(205 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x1c000 thru 0x1cfff 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2510(206 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2511(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2512(208 mod 256): TRUNCATE UP from 0x2cdcb to 0x62000 ******WWWW 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2513(209 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2514(210 mod 256): TRUNCATE UP from 0x62000 to 0x71000 2024-03-26T07:41:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: +2515(211 mod 256): MAPWRITE 0x25000 thru 0x25c97 (0xc98 bytes) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2516(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2517(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2518(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2519(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2520(216 mod 256): COPY 0x44000 thru 0x44fff (0x1000 bytes) to 0x59000 thru 0x59fff 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2521(217 mod 256): WRITE 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2522(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2523(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2524(220 mod 256): PUNCH 0x1a69d thru 0x1b3e7 (0xd4b bytes) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2525(221 mod 256): TRUNCATE DOWN from 0x71000 to 0x4a000 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2526(222 mod 256): WRITE 0x4c000 thru 0x4cfff (0x1000 bytes) HOLE 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2527(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2528(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2529(225 mod 256): PUNCH 0x14ee7 thru 0x15f86 (0x10a0 bytes) 2024-03-26T07:41:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: +2530(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2531(227 mod 256): MAPREAD 0x16000 thru 0x160d4 (0xd5 bytes) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2532(228 mod 256): TRUNCATE UP from 0x4d000 to 0x5e000 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2533(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2534(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2535(231 mod 256): MAPWRITE 0x56000 thru 0x57845 (0x1846 bytes) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2536(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2537(233 mod 256): MAPWRITE 0x33000 thru 0x34b82 (0x1b83 bytes) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2538(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2539(235 mod 256): PUNCH 0x156cd thru 0x15f5b (0x88f bytes) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2540(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2541(237 mod 256): PUNCH 0x1aed1 thru 0x1b63f (0x76f bytes) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2542(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2543(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: +2544(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2545(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2546(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2547(243 mod 256): MAPWRITE 0x59000 thru 0x5929e (0x29f bytes) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2548(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2549(245 mod 256): TRUNCATE DOWN from 0x5e000 to 0x0 ******WWWW 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2550(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2551(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2552(248 mod 256): TRUNCATE UP from 0x0 to 0x66000 ******WWWW 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2553(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2554(250 mod 256): MAPREAD 0x20000 thru 0x20a17 (0xa18 bytes) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2555(251 mod 256): READ 0x39000 thru 0x39fff (0x1000 bytes) 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2556(252 mod 256): TRUNCATE DOWN from 0x66000 to 0x40000 2024-03-26T07:41:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: +2557(253 mod 256): TRUNCATE DOWN from 0x40000 to 0x7000 ******WWWW 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2558(254 mod 256): MAPREAD 0x6000 thru 0x66a0 (0x6a1 bytes) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2559(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2560( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2561( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2562( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2563( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2564( 4 mod 256): PUNCH 0x21c thru 0x1204 (0xfe9 bytes) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2565( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2566( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2567( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2568( 8 mod 256): PUNCH 0xa37 thru 0x184e (0xe18 bytes) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2569( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2570( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: +2571( 11 mod 256): MAPREAD 0x4000 thru 0x4d4b (0xd4c bytes) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2572( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2573( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2574( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2575( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2576( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2577( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2578( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2579( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2580( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2581( 21 mod 256): PUNCH 0x1954 thru 0x1d26 (0x3d3 bytes) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2582( 22 mod 256): TRUNCATE UP from 0x7000 to 0x6d000 ******WWWW 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2583( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: +2584( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2585( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2586( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2587( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2588( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2589( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2590( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2591( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2592( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2593( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2594( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2595( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2596( 36 mod 256): MAPREAD 0xc000 thru 0xdaaf (0x1ab0 bytes) 2024-03-26T07:41:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: +2597( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2598( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2599( 39 mod 256): PUNCH 0x4de7e thru 0x4fc7c (0x1dff bytes) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2600( 40 mod 256): TRUNCATE DOWN from 0x6d000 to 0x2f000 ******WWWW 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2601( 41 mod 256): PUNCH 0x288f7 thru 0x2908d (0x797 bytes) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2602( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2603( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2604( 44 mod 256): PUNCH 0x28a25 thru 0x2a38d (0x1969 bytes) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2605( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2606( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2607( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2608( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2609( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2610( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2611( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: +2612( 52 mod 256): MAPWRITE 0x63000 thru 0x63cae (0xcaf bytes) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2613( 53 mod 256): PUNCH 0x3be44 thru 0x3d1ee (0x13ab bytes) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2614( 54 mod 256): TRUNCATE DOWN from 0x63caf to 0x22000 ******WWWW 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2615( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2616( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2617( 57 mod 256): MAPREAD 0xb000 thru 0xce06 (0x1e07 bytes) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2618( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2619( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2620( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2621( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2622( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2623( 63 mod 256): PUNCH 0x1e36b thru 0x1e89e (0x534 bytes) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2624( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: +2625( 65 mod 256): TRUNCATE UP from 0x22000 to 0x77000 ******WWWW 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2626( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2627( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2628( 68 mod 256): COPY 0x23000 thru 0x23fff (0x1000 bytes) to 0x4b000 thru 0x4bfff 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2629( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2630( 70 mod 256): MAPWRITE 0x2000 thru 0x3c8e (0x1c8f bytes) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2631( 71 mod 256): WRITE 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2632( 72 mod 256): MAPWRITE 0x4c000 thru 0x4c874 (0x875 bytes) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2633( 73 mod 256): READ 0x67000 thru 0x67fff (0x1000 bytes) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2634( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2635( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2636( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2637( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2638( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: +2639( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2640( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2641( 81 mod 256): TRUNCATE DOWN from 0x77000 to 0x1e000 ******WWWW 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2642( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2643( 83 mod 256): TRUNCATE DOWN from 0x1e000 to 0x15000 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2644( 84 mod 256): TRUNCATE UP from 0x15000 to 0x44000 ******WWWW 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2645( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2646( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2647( 87 mod 256): MAPREAD 0x3a000 thru 0x3b322 (0x1323 bytes) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2648( 88 mod 256): PUNCH 0x391a1 thru 0x3982b (0x68b bytes) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2649( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2650( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2651( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2652( 92 mod 256): MAPWRITE 0x1000 thru 0x2d6b (0x1d6c bytes) 2024-03-26T07:41:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: +2653( 93 mod 256): MAPWRITE 0x17000 thru 0x18e46 (0x1e47 bytes) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2654( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2655( 95 mod 256): MAPWRITE 0x17000 thru 0x18727 (0x1728 bytes) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2656( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2657( 97 mod 256): MAPREAD 0x14000 thru 0x14357 (0x358 bytes) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2658( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2659( 99 mod 256): COPY 0x10000 thru 0x10fff (0x1000 bytes) to 0x1b000 thru 0x1bfff 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2660(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2661(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2662(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2663(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2664(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2665(105 mod 256): MAPWRITE 0x54000 thru 0x55953 (0x1954 bytes) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2666(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: +2667(107 mod 256): PUNCH 0x52a thru 0x2369 (0x1e40 bytes) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2668(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2669(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2670(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2671(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2672(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2673(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2674(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2675(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2676(116 mod 256): COPY 0x32000 thru 0x32fff (0x1000 bytes) to 0xb000 thru 0xbfff 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2677(117 mod 256): MAPREAD 0x48000 thru 0x49614 (0x1615 bytes) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2678(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: +2679(119 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2680(120 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2681(121 mod 256): COPY 0x3a000 thru 0x3afff (0x1000 bytes) to 0x50000 thru 0x50fff 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2682(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2683(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2684(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2685(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2686(126 mod 256): TRUNCATE DOWN from 0x55954 to 0x29000 ******WWWW 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2687(127 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2688(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2689(129 mod 256): TRUNCATE UP from 0x29000 to 0x55000 ******WWWW 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2690(130 mod 256): MAPREAD 0x5000 thru 0x6306 (0x1307 bytes) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2691(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: +2692(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2693(133 mod 256): MAPWRITE 0x1e000 thru 0x1f3c6 (0x13c7 bytes) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2694(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2695(135 mod 256): MAPWRITE 0x3000 thru 0x30b6 (0xb7 bytes) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2696(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2697(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2698(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2699(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2700(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2701(141 mod 256): PUNCH 0x10a32 thru 0x128bb (0x1e8a bytes) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2702(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2703(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2704(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2705(145 mod 256): MAPWRITE 0x6e000 thru 0x6f3fc (0x13fd bytes) 2024-03-26T07:41:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: +2706(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2707(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2708(148 mod 256): WRITE 0x69000 thru 0x69fff (0x1000 bytes) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2709(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2710(150 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2711(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2712(152 mod 256): MAPWRITE 0x50000 thru 0x5197a (0x197b bytes) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2713(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2714(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2715(155 mod 256): MAPREAD 0x4000 thru 0x4e84 (0xe85 bytes) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2716(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2717(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2718(158 mod 256): MAPWRITE 0x6000 thru 0x65c3 (0x5c4 bytes) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2719(159 mod 256): PUNCH 0x158f thru 0x2bb8 (0x162a bytes) 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2720(160 mod 256): TRUNCATE DOWN from 0x6f3fd to 0x22000 ******WWWW 2024-03-26T07:41:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: +2721(161 mod 256): PUNCH 0x1f259 thru 0x1f949 (0x6f1 bytes) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2722(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2723(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2724(164 mod 256): TRUNCATE DOWN from 0x22000 to 0x21000 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2725(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2726(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2727(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2728(168 mod 256): MAPWRITE 0x67000 thru 0x688b9 (0x18ba bytes) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2729(169 mod 256): MAPWRITE 0x20000 thru 0x20355 (0x356 bytes) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2730(170 mod 256): MAPWRITE 0xb000 thru 0xc917 (0x1918 bytes) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2731(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2732(172 mod 256): PUNCH 0x45849 thru 0x46e95 (0x164d bytes) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2733(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2734(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: +2735(175 mod 256): COPY 0x29000 thru 0x29fff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2736(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2737(177 mod 256): PUNCH 0x3ecad thru 0x403ea (0x173e bytes) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2738(178 mod 256): MAPREAD 0x15000 thru 0x15318 (0x319 bytes) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2739(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2740(180 mod 256): MAPREAD 0x3f000 thru 0x3fa6d (0xa6e bytes) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2741(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2742(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2743(183 mod 256): PUNCH 0x18333 thru 0x19134 (0xe02 bytes) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2744(184 mod 256): MAPREAD 0x12000 thru 0x123dd (0x3de bytes) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2745(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2746(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2747(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2748(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: +2749(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2750(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2751(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2752(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2753(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2754(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2755(195 mod 256): PUNCH 0x2b80 thru 0x42b5 (0x1736 bytes) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2756(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2757(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2758(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2759(199 mod 256): PUNCH 0x372b8 thru 0x37cd5 (0xa1e bytes) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2760(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2761(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2762(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2763(203 mod 256): COPY 0x26000 thru 0x26fff (0x1000 bytes) to 0x10000 thru 0x10fff 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2764(204 mod 256): READ 0x4d000 thru 0x4dfff (0x1000 bytes) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2765(205 mod 256): MAPREAD 0x27000 thru 0x273e3 (0x3e4 bytes) 2024-03-26T07:41:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: +2766(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2767(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2768(208 mod 256): MAPWRITE 0x4e000 thru 0x4e7be (0x7bf bytes) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2769(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2770(210 mod 256): PUNCH 0x5614c thru 0x5624e (0x103 bytes) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2771(211 mod 256): COPY 0x1c000 thru 0x1cfff (0x1000 bytes) to 0x58000 thru 0x58fff 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2772(212 mod 256): TRUNCATE DOWN from 0x688ba to 0x13000 ******WWWW 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2773(213 mod 256): READ 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2774(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2775(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2776(216 mod 256): MAPWRITE 0x32000 thru 0x323aa (0x3ab bytes) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2777(217 mod 256): MAPWRITE 0x6a000 thru 0x6a80b (0x80c bytes) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2778(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2779(219 mod 256): TRUNCATE DOWN from 0x6a80c to 0x9000 ******WWWW 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2780(220 mod 256): MAPWRITE 0x2c000 thru 0x2dfae (0x1faf bytes) 2024-03-26T07:41:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: +2781(221 mod 256): TRUNCATE UP from 0x2dfaf to 0x76000 ******WWWW 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2782(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2783(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2784(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2785(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2786(226 mod 256): TRUNCATE DOWN from 0x76000 to 0x2b000 ******WWWW 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2787(227 mod 256): PUNCH 0x2f96 thru 0x4c98 (0x1d03 bytes) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2788(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2789(229 mod 256): TRUNCATE UP from 0x2b000 to 0x79000 ******WWWW 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2790(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2791(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2792(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2793(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: +2794(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2795(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2796(236 mod 256): READ 0xe000 thru 0xefff (0x1000 bytes) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2797(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2798(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2799(239 mod 256): PUNCH 0x2b4e thru 0x47f3 (0x1ca6 bytes) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2800(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2801(241 mod 256): TRUNCATE DOWN from 0x79000 to 0x3a000 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2802(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2803(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2804(244 mod 256): PUNCH 0x1f9e5 thru 0x1fc12 (0x22e bytes) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2805(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2806(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: +2807(247 mod 256): MAPREAD 0x35000 thru 0x361db (0x11dc bytes) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2808(248 mod 256): MAPWRITE 0x10000 thru 0x105a9 (0x5aa bytes) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2809(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2810(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2811(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2812(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2813(253 mod 256): MAPREAD 0x31000 thru 0x32c42 (0x1c43 bytes) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2814(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2815(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2816( 0 mod 256): MAPWRITE 0x16000 thru 0x1623d (0x23e bytes) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2817( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2818( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2819( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2820( 4 mod 256): PUNCH 0x1a7a3 thru 0x1bf1d (0x177b bytes) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2821( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: +2822( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2823( 7 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2824( 8 mod 256): COPY 0x35000 thru 0x35fff (0x1000 bytes) to 0x69000 thru 0x69fff 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2825( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2826( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2827( 11 mod 256): MAPREAD 0x69000 thru 0x69811 (0x812 bytes) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2828( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2829( 13 mod 256): MAPWRITE 0x78000 thru 0x78557 (0x558 bytes) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2830( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2831( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2832( 16 mod 256): MAPWRITE 0x71000 thru 0x7249b (0x149c bytes) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2833( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2834( 18 mod 256): TRUNCATE DOWN from 0x78558 to 0x66000 2024-03-26T07:41:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: +2835( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2836( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2837( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2838( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2839( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2840( 24 mod 256): PUNCH 0x109f3 thru 0x115c1 (0xbcf bytes) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2841( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2842( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2843( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2844( 28 mod 256): MAPREAD 0x4a000 thru 0x4a245 (0x246 bytes) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2845( 29 mod 256): MAPREAD 0x3000 thru 0x340a (0x40b bytes) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2846( 30 mod 256): WRITE 0x36000 thru 0x36fff (0x1000 bytes) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2847( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2848( 32 mod 256): TRUNCATE DOWN from 0x66000 to 0x8000 ******WWWW 2024-03-26T07:41:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: +2849( 33 mod 256): TRUNCATE UP from 0x8000 to 0x5a000 ******WWWW 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2850( 34 mod 256): MAPWRITE 0x63000 thru 0x64403 (0x1404 bytes) 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2851( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2852( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2853( 37 mod 256): TRUNCATE DOWN from 0x64404 to 0x2c000 ******WWWW 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2854( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2855( 39 mod 256): COPY 0x29000 thru 0x29fff (0x1000 bytes) to 0x27000 thru 0x27fff 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2856( 40 mod 256): MAPWRITE 0x59000 thru 0x5a24f (0x1250 bytes) 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2857( 41 mod 256): MAPREAD 0x14000 thru 0x15fd8 (0x1fd9 bytes) 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2858( 42 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2859( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2860( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2861( 45 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x54000 thru 0x54fff 2024-03-26T07:41:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: +2862( 46 mod 256): MAPWRITE 0x26000 thru 0x273aa (0x13ab bytes) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2863( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2864( 48 mod 256): MAPREAD 0x47000 thru 0x47dc7 (0xdc8 bytes) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2865( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2866( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2867( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2868( 52 mod 256): PUNCH 0x41cea thru 0x43124 (0x143b bytes) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2869( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2870( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2871( 55 mod 256): MAPWRITE 0x3f000 thru 0x3f95e (0x95f bytes) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2872( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2873( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2874( 58 mod 256): MAPWRITE 0xd000 thru 0xe062 (0x1063 bytes) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2875( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2876( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2877( 61 mod 256): MAPWRITE 0x52000 thru 0x5375d (0x175e bytes) 2024-03-26T07:41:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: +2878( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2879( 63 mod 256): TRUNCATE DOWN from 0x5a250 to 0x44000 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2880( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2881( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2882( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2883( 67 mod 256): TRUNCATE UP from 0x44000 to 0x5d000 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2884( 68 mod 256): MAPREAD 0x2c000 thru 0x2ddce (0x1dcf bytes) 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2885( 69 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0x3c000 thru 0x3cfff 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2886( 70 mod 256): PUNCH 0x23b27 thru 0x2440d (0x8e7 bytes) 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2887( 71 mod 256): TRUNCATE DOWN from 0x5d000 to 0x54000 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2888( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2889( 73 mod 256): TRUNCATE UP from 0x54000 to 0x69000 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2890( 74 mod 256): TRUNCATE DOWN from 0x69000 to 0x3f000 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2891( 75 mod 256): PUNCH 0x15553 thru 0x1603f (0xaed bytes) 2024-03-26T07:41:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: +2892( 76 mod 256): MAPWRITE 0x1b000 thru 0x1c54a (0x154b bytes) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2893( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2894( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2895( 79 mod 256): TRUNCATE UP from 0x3f000 to 0x45000 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2896( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2897( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2898( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2899( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2900( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2901( 85 mod 256): TRUNCATE DOWN from 0x45000 to 0x15000 ******WWWW 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2902( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2903( 87 mod 256): TRUNCATE DOWN from 0x15000 to 0x0 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2904( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: +2905( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2906( 90 mod 256): MAPWRITE 0x23000 thru 0x23d7d (0xd7e bytes) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2907( 91 mod 256): TRUNCATE UP from 0x23d7e to 0x73000 ******WWWW 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2908( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2909( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2910( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2911( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2912( 96 mod 256): READ 0x4f000 thru 0x4ffff (0x1000 bytes) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2913( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2914( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2915( 99 mod 256): MAPWRITE 0x6e000 thru 0x6efe8 (0xfe9 bytes) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2916(100 mod 256): TRUNCATE DOWN from 0x73000 to 0x6c000 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2917(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2918(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: +2919(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2920(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2921(105 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2922(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2923(107 mod 256): TRUNCATE DOWN from 0x6c000 to 0x62000 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2924(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2925(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2926(110 mod 256): TRUNCATE DOWN from 0x62000 to 0x13000 ******WWWW 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2927(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2928(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2929(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2930(114 mod 256): TRUNCATE UP from 0x13000 to 0x5e000 ******WWWW 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2931(115 mod 256): TRUNCATE DOWN from 0x5e000 to 0x19000 ******WWWW 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2932(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: +2933(117 mod 256): MAPREAD 0x6000 thru 0x6d46 (0xd47 bytes) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2934(118 mod 256): MAPREAD 0xa000 thru 0xba37 (0x1a38 bytes) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2935(119 mod 256): PUNCH 0xd10e thru 0xea0a (0x18fd bytes) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2936(120 mod 256): MAPREAD 0x11000 thru 0x12b5c (0x1b5d bytes) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2937(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2938(122 mod 256): PUNCH 0x136a6 thru 0x145f3 (0xf4e bytes) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2939(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2940(124 mod 256): MAPWRITE 0x6c000 thru 0x6cbef (0xbf0 bytes) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2941(125 mod 256): TRUNCATE DOWN from 0x6cbf0 to 0x3a000 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2942(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2943(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2944(128 mod 256): MAPREAD 0x7000 thru 0x83f4 (0x13f5 bytes) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2945(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2946(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: +2947(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2948(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2949(133 mod 256): TRUNCATE DOWN from 0x3a000 to 0x38000 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2950(134 mod 256): WRITE 0x5d000 thru 0x5dfff (0x1000 bytes) HOLE 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2951(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2952(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2953(137 mod 256): MAPREAD 0x59000 thru 0x5a0e0 (0x10e1 bytes) 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2954(138 mod 256): TRUNCATE DOWN from 0x5e000 to 0x4f000 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2955(139 mod 256): PUNCH 0x33388 thru 0x349f3 (0x166c bytes) 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2956(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2957(141 mod 256): TRUNCATE DOWN from 0x4f000 to 0x45000 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2958(142 mod 256): COPY 0x35000 thru 0x36fff (0x2000 bytes) to 0x6b000 thru 0x6cfff 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2959(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: +2960(144 mod 256): READ 0x4a000 thru 0x4afff (0x1000 bytes) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2961(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2962(146 mod 256): MAPWRITE 0x5b000 thru 0x5bbe2 (0xbe3 bytes) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2963(147 mod 256): PUNCH 0x4f59e thru 0x513c9 (0x1e2c bytes) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2964(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2965(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2966(150 mod 256): MAPREAD 0x10000 thru 0x10d1a (0xd1b bytes) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2967(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2968(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2969(153 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2970(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2971(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2972(156 mod 256): WRITE 0x6b000 thru 0x6bfff (0x1000 bytes) 2024-03-26T07:41:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: +2973(157 mod 256): TRUNCATE DOWN from 0x6d000 to 0x24000 ******WWWW 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2974(158 mod 256): WRITE 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2975(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2976(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2977(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2978(162 mod 256): TRUNCATE UP from 0x24000 to 0x6b000 ******WWWW 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2979(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2980(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2981(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2982(166 mod 256): PUNCH 0x1feab thru 0x20f4c (0x10a2 bytes) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2983(167 mod 256): WRITE 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2984(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2985(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2986(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: +2987(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2988(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2989(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2990(174 mod 256): TRUNCATE DOWN from 0x6b000 to 0x6000 ******WWWW 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2991(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2992(176 mod 256): MAPREAD 0x4000 thru 0x50cb (0x10cc bytes) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2993(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2994(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2995(179 mod 256): MAPWRITE 0x15000 thru 0x16712 (0x1713 bytes) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2996(180 mod 256): PUNCH 0x11a5e thru 0x129bf (0xf62 bytes) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2997(181 mod 256): MAPREAD 0x5000 thru 0x56f3 (0x6f4 bytes) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2998(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +2999(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +3000(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: +3001(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3002(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3003(187 mod 256): PUNCH 0x161f7 thru 0x16712 (0x51c bytes) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3004(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3005(189 mod 256): MAPWRITE 0x2f000 thru 0x2fdb5 (0xdb6 bytes) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3006(190 mod 256): PUNCH 0x13733 thru 0x14111 (0x9df bytes) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3007(191 mod 256): MAPREAD 0x13000 thru 0x13048 (0x49 bytes) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3008(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3009(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3010(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3011(195 mod 256): MAPREAD 0x6000 thru 0x6a4d (0xa4e bytes) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3012(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3013(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3014(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: +3015(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3016(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3017(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3018(202 mod 256): WRITE 0x70000 thru 0x70fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3019(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3020(204 mod 256): READ 0xa000 thru 0xafff (0x1000 bytes) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3021(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3022(206 mod 256): PUNCH 0x39fb5 thru 0x3aea0 (0xeec bytes) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3023(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3024(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3025(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3026(210 mod 256): COPY 0x51000 thru 0x51fff (0x1000 bytes) to 0x6a000 thru 0x6afff 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3027(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3028(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: +3029(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3030(214 mod 256): MAPWRITE 0x67000 thru 0x68190 (0x1191 bytes) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3031(215 mod 256): MAPWRITE 0x47000 thru 0x4767d (0x67e bytes) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3032(216 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3033(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3034(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3035(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3036(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3037(221 mod 256): MAPWRITE 0x40000 thru 0x40921 (0x922 bytes) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3038(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3039(223 mod 256): MAPWRITE 0x74000 thru 0x754a3 (0x14a4 bytes) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3040(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3041(225 mod 256): PUNCH 0xa50f thru 0xbbad (0x169f bytes) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3042(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: +3043(227 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3044(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3045(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3046(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3047(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3048(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3049(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3050(234 mod 256): MAPWRITE 0x49000 thru 0x4aa55 (0x1a56 bytes) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3051(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3052(236 mod 256): MAPWRITE 0x5000 thru 0x6681 (0x1682 bytes) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3053(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3054(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3055(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3056(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: +3057(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3058(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3059(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3060(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3061(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3062(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3063(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3064(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3065(249 mod 256): TRUNCATE DOWN from 0x754a4 to 0x5b000 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3066(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3067(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3068(252 mod 256): MAPWRITE 0x5b000 thru 0x5c8ab (0x18ac bytes) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3069(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3070(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: +3071(255 mod 256): COPY 0xf000 thru 0xffff (0x1000 bytes) to 0x9000 thru 0x9fff 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3072( 0 mod 256): PUNCH 0x3c56b thru 0x3c87e (0x314 bytes) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3073( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3074( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3075( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3076( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3077( 5 mod 256): MAPWRITE 0x71000 thru 0x728de (0x18df bytes) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3078( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3079( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3080( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3081( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3082( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3083( 11 mod 256): MAPREAD 0x3b000 thru 0x3c5bb (0x15bc bytes) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3084( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: +3085( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3086( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3087( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3088( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3089( 17 mod 256): MAPREAD 0x35000 thru 0x355e5 (0x5e6 bytes) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3090( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3091( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3092( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3093( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3094( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3095( 23 mod 256): PUNCH 0x5dc32 thru 0x5e389 (0x758 bytes) 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3096( 24 mod 256): TRUNCATE DOWN from 0x728df to 0x1f000 ******WWWW 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3097( 25 mod 256): WRITE 0x50000 thru 0x50fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3098( 26 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x9000 thru 0x9fff 2024-03-26T07:41:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: +3099( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3100( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3101( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3102( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3103( 31 mod 256): TRUNCATE UP from 0x51000 to 0x54000 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3104( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3105( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3106( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3107( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3108( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3109( 37 mod 256): PUNCH 0x50ca2 thru 0x52af3 (0x1e52 bytes) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3110( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3111( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3112( 40 mod 256): COPY 0x1e000 thru 0x1efff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-26T07:41:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3113( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3114( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3115( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3116( 44 mod 256): PUNCH 0x34376 thru 0x3520a (0xe95 bytes) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3117( 45 mod 256): MAPREAD 0x3d000 thru 0x3ebc6 (0x1bc7 bytes) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3118( 46 mod 256): TRUNCATE UP from 0x54000 to 0x66000 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3119( 47 mod 256): PUNCH 0xef70 thru 0x10835 (0x18c6 bytes) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3120( 48 mod 256): COPY 0x50000 thru 0x50fff (0x1000 bytes) to 0x55000 thru 0x55fff 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3121( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3122( 50 mod 256): COPY 0x54000 thru 0x54fff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3123( 51 mod 256): MAPWRITE 0x49000 thru 0x4a76a (0x176b bytes) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3124( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3125( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3126( 54 mod 256): TRUNCATE DOWN from 0x66000 to 0x2b000 ******WWWW 2024-03-26T07:41:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: +3127( 55 mod 256): MAPWRITE 0x6f000 thru 0x6fb74 (0xb75 bytes) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3128( 56 mod 256): MAPWRITE 0x3a000 thru 0x3a251 (0x252 bytes) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3129( 57 mod 256): TRUNCATE DOWN from 0x6fb75 to 0x54000 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3130( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3131( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3132( 60 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3133( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3134( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3135( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3136( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3137( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3138( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3139( 67 mod 256): READ 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3140( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: +3141( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3142( 70 mod 256): READ 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3143( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3144( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3145( 73 mod 256): WRITE 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3146( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3147( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3148( 76 mod 256): MAPREAD 0x1000 thru 0x1983 (0x984 bytes) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3149( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3150( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3151( 79 mod 256): COPY 0x27000 thru 0x27fff (0x1000 bytes) to 0x3e000 thru 0x3efff 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3152( 80 mod 256): PUNCH 0x28453 thru 0x290ed (0xc9b bytes) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3153( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3154( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3155( 83 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x78000 thru 0x78fff 2024-03-26T07:41:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: +3156( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3157( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3158( 86 mod 256): PUNCH 0xd74a thru 0xead3 (0x138a bytes) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3159( 87 mod 256): TRUNCATE DOWN from 0x79000 to 0x31000 ******WWWW 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3160( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3161( 89 mod 256): WRITE 0x12000 thru 0x12fff (0x1000 bytes) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3162( 90 mod 256): PUNCH 0x2e2c5 thru 0x2f488 (0x11c4 bytes) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3163( 91 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3164( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3165( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3166( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3167( 95 mod 256): TRUNCATE UP from 0x31000 to 0x51000 ******WWWW 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3168( 96 mod 256): TRUNCATE DOWN from 0x51000 to 0x29000 ******WWWW 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3169( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: +3170( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3171( 99 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x36000 thru 0x36fff 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3172(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3173(101 mod 256): TRUNCATE UP from 0x37000 to 0x75000 ******WWWW 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3174(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3175(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3176(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3177(105 mod 256): WRITE 0xf000 thru 0xffff (0x1000 bytes) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3178(106 mod 256): PUNCH 0x412f9 thru 0x42a59 (0x1761 bytes) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3179(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3180(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3181(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3182(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: +3183(111 mod 256): READ 0x6a000 thru 0x6afff (0x1000 bytes) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3184(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3185(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3186(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3187(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3188(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3189(117 mod 256): TRUNCATE DOWN from 0x75000 to 0x6000 ******WWWW 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3190(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3191(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3192(120 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3193(121 mod 256): MAPWRITE 0x48000 thru 0x49b8a (0x1b8b bytes) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3194(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3195(123 mod 256): MAPWRITE 0x52000 thru 0x52a33 (0xa34 bytes) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3196(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3197(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: +3198(126 mod 256): TRUNCATE DOWN from 0x54000 to 0x0 ******WWWW 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3199(127 mod 256): MAPWRITE 0x78000 thru 0x7961c (0x161d bytes) 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3200(128 mod 256): COPY 0x44000 thru 0x44fff (0x1000 bytes) to 0x59000 thru 0x59fff 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3201(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3202(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3203(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3204(132 mod 256): TRUNCATE DOWN from 0x7961d to 0x52000 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3205(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3206(134 mod 256): MAPREAD 0x35000 thru 0x353e6 (0x3e7 bytes) 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3207(135 mod 256): WRITE 0x4a000 thru 0x4afff (0x1000 bytes) 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3208(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3209(137 mod 256): TRUNCATE DOWN from 0x52000 to 0x23000 ******WWWW 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3210(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: +3211(139 mod 256): PUNCH 0x1c69b thru 0x1dc7f (0x15e5 bytes) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3212(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3213(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3214(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3215(143 mod 256): PUNCH 0xebd4 thru 0x10b17 (0x1f44 bytes) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3216(144 mod 256): READ 0x17000 thru 0x17fff (0x1000 bytes) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3217(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3218(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3219(147 mod 256): MAPWRITE 0x47000 thru 0x473ab (0x3ac bytes) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3220(148 mod 256): TRUNCATE DOWN from 0x473ac to 0x3000 ******WWWW 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3221(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3222(150 mod 256): WRITE 0x57000 thru 0x57fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3223(151 mod 256): TRUNCATE UP from 0x58000 to 0x59000 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3224(152 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) HOLE 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3225(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: +3226(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3227(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3228(156 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3229(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3230(158 mod 256): MAPREAD 0x54000 thru 0x54297 (0x298 bytes) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3231(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3232(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3233(161 mod 256): MAPWRITE 0x43000 thru 0x4425a (0x125b bytes) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3234(162 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3235(163 mod 256): READ 0x4e000 thru 0x4efff (0x1000 bytes) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3236(164 mod 256): PUNCH 0x57f90 thru 0x5997b (0x19ec bytes) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3237(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3238(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3239(167 mod 256): COPY 0x26000 thru 0x26fff (0x1000 bytes) to 0x1000 thru 0x1fff 2024-03-26T07:41:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: +3240(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3241(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3242(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3243(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3244(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3245(173 mod 256): READ 0x1d000 thru 0x1dfff (0x1000 bytes) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3246(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3247(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3248(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3249(177 mod 256): TRUNCATE DOWN from 0x6f000 to 0x7000 ******WWWW 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3250(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3251(179 mod 256): MAPWRITE 0x1a000 thru 0x1a2a5 (0x2a6 bytes) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3252(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3253(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: +3254(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3255(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3256(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3257(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3258(186 mod 256): PUNCH 0x7da0 thru 0x91a7 (0x1408 bytes) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3259(187 mod 256): MAPREAD 0x7000 thru 0x7b6b (0xb6c bytes) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3260(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3261(189 mod 256): TRUNCATE DOWN from 0x1a2a6 to 0x2000 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3262(190 mod 256): MAPREAD 0x1000 thru 0x11f4 (0x1f5 bytes) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3263(191 mod 256): PUNCH 0x1ccd thru 0x1fff (0x333 bytes) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3264(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3265(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3266(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3267(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: +3268(196 mod 256): MAPWRITE 0x46000 thru 0x47ddc (0x1ddd bytes) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3269(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3270(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3271(199 mod 256): WRITE 0x66000 thru 0x66fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3272(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3273(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3274(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3275(203 mod 256): MAPREAD 0x42000 thru 0x43d92 (0x1d93 bytes) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3276(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3277(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3278(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3279(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3280(208 mod 256): PUNCH 0x237c7 thru 0x24a67 (0x12a1 bytes) 2024-03-26T07:41:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: +3281(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3282(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3283(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3284(212 mod 256): MAPREAD 0x4c000 thru 0x4ca05 (0xa06 bytes) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3285(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3286(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3287(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3288(216 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3289(217 mod 256): MAPREAD 0x2c000 thru 0x2c5df (0x5e0 bytes) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3290(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3291(219 mod 256): TRUNCATE DOWN from 0x67000 to 0x3a000 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3292(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3293(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: +3294(222 mod 256): TRUNCATE DOWN from 0x3a000 to 0x23000 ******WWWW 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3295(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3296(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3297(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3298(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3299(227 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3300(228 mod 256): WRITE 0x60000 thru 0x60fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3301(229 mod 256): COPY 0x8000 thru 0x8fff (0x1000 bytes) to 0x5e000 thru 0x5efff 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3302(230 mod 256): MAPREAD 0x4c000 thru 0x4dcf6 (0x1cf7 bytes) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3303(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3304(232 mod 256): MAPWRITE 0x11000 thru 0x114ee (0x4ef bytes) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3305(233 mod 256): WRITE 0x20000 thru 0x20fff (0x1000 bytes) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3306(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3307(235 mod 256): TRUNCATE UP from 0x61000 to 0x78000 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3308(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: +3309(237 mod 256): PUNCH 0x4fe26 thru 0x4fe45 (0x20 bytes) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3310(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3311(239 mod 256): PUNCH 0x315ca thru 0x3349b (0x1ed2 bytes) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3312(240 mod 256): MAPREAD 0x16000 thru 0x165a2 (0x5a3 bytes) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3313(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3314(242 mod 256): WRITE 0x78000 thru 0x78fff (0x1000 bytes) EXTEND 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3315(243 mod 256): PUNCH 0x1079 thru 0x2010 (0xf98 bytes) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3316(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3317(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3318(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3319(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3320(248 mod 256): TRUNCATE DOWN from 0x79000 to 0x74000 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3321(249 mod 256): PUNCH 0x6cc63 thru 0x6cc93 (0x31 bytes) 2024-03-26T07:41:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: +3322(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3323(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3324(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3325(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3326(254 mod 256): MAPREAD 0x49000 thru 0x4ad9f (0x1da0 bytes) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3327(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3328( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3329( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3330( 2 mod 256): MAPREAD 0xf000 thru 0x106ad (0x16ae bytes) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3331( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3332( 4 mod 256): COPY 0x22000 thru 0x22fff (0x1000 bytes) to 0x53000 thru 0x53fff 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3333( 5 mod 256): MAPREAD 0x45000 thru 0x45dc5 (0xdc6 bytes) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3334( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3335( 7 mod 256): PUNCH 0x5e273 thru 0x5fb4b (0x18d9 bytes) 2024-03-26T07:41:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: +3336( 8 mod 256): COPY 0x41000 thru 0x41fff (0x1000 bytes) to 0x33000 thru 0x33fff 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3337( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3338( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3339( 11 mod 256): COPY 0x6e000 thru 0x6efff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3340( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3341( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3342( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3343( 15 mod 256): MAPREAD 0x6000 thru 0x6a13 (0xa14 bytes) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3344( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3345( 17 mod 256): TRUNCATE DOWN from 0x74000 to 0x6b000 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3346( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3347( 19 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3348( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: +3349( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3350( 22 mod 256): MAPWRITE 0x24000 thru 0x246bb (0x6bc bytes) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3351( 23 mod 256): MAPWRITE 0x3b000 thru 0x3c9a8 (0x19a9 bytes) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3352( 24 mod 256): TRUNCATE DOWN from 0x6b000 to 0x51000 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3353( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3354( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3355( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3356( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3357( 29 mod 256): MAPREAD 0x12000 thru 0x12f40 (0xf41 bytes) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3358( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3359( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3360( 32 mod 256): MAPWRITE 0x56000 thru 0x57196 (0x1197 bytes) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3361( 33 mod 256): READ 0x1b000 thru 0x1bfff (0x1000 bytes) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3362( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: +3363( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3364( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3365( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3366( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3367( 39 mod 256): PUNCH 0xf536 thru 0x11394 (0x1e5f bytes) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3368( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3369( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3370( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3371( 43 mod 256): MAPREAD 0x51000 thru 0x52b54 (0x1b55 bytes) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3372( 44 mod 256): TRUNCATE DOWN from 0x57197 to 0x2000 ******WWWW 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3373( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3374( 46 mod 256): PUNCH 0x7f8 thru 0x1fff (0x1808 bytes) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3375( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3376( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3377( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: +3378( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3379( 51 mod 256): PUNCH 0x156a thru 0x1ee8 (0x97f bytes) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3380( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3381( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3382( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3383( 55 mod 256): TRUNCATE UP from 0x2000 to 0x8000 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3384( 56 mod 256): TRUNCATE UP from 0x8000 to 0x39000 ******WWWW 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3385( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3386( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3387( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3388( 60 mod 256): WRITE 0x69000 thru 0x69fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3389( 61 mod 256): PUNCH 0x1b7e1 thru 0x1c870 (0x1090 bytes) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3390( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3391( 63 mod 256): TRUNCATE DOWN from 0x6a000 to 0x19000 ******WWWW 2024-03-26T07:41:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: +3392( 64 mod 256): MAPREAD 0xa000 thru 0xb41f (0x1420 bytes) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3393( 65 mod 256): READ 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3394( 66 mod 256): PUNCH 0xf8f0 thru 0xfc20 (0x331 bytes) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3395( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3396( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3397( 69 mod 256): PUNCH 0xb6b6 thru 0xd39f (0x1cea bytes) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3398( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3399( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3400( 72 mod 256): MAPREAD 0xb000 thru 0xca3b (0x1a3c bytes) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3401( 73 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3402( 74 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3403( 75 mod 256): COPY 0x22000 thru 0x22fff (0x1000 bytes) to 0x70000 thru 0x70fff 2024-03-26T07:41:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: +3404( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3405( 77 mod 256): MAPWRITE 0x19000 thru 0x1aa73 (0x1a74 bytes) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3406( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3407( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3408( 80 mod 256): MAPWRITE 0x12000 thru 0x12bb4 (0xbb5 bytes) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3409( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3410( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3411( 83 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x73000 thru 0x73fff 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3412( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3413( 85 mod 256): TRUNCATE DOWN from 0x77000 to 0x59000 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3414( 86 mod 256): MAPREAD 0x18000 thru 0x19403 (0x1404 bytes) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3415( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3416( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3417( 89 mod 256): COPY 0x38000 thru 0x38fff (0x1000 bytes) to 0x4000 thru 0x4fff 2024-03-26T07:41:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: +3418( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3419( 91 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3420( 92 mod 256): MAPWRITE 0x4000 thru 0x41d5 (0x1d6 bytes) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3421( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3422( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3423( 95 mod 256): WRITE 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3424( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3425( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3426( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3427( 99 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3428(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3429(101 mod 256): TRUNCATE UP from 0x70000 to 0x74000 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3430(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3431(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3432(104 mod 256): MAPREAD 0x28000 thru 0x2891a (0x91b bytes) 2024-03-26T07:41:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: +3433(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3434(106 mod 256): MAPREAD 0x36000 thru 0x36a27 (0xa28 bytes) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3435(107 mod 256): MAPREAD 0x38000 thru 0x3850b (0x50c bytes) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3436(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3437(109 mod 256): MAPWRITE 0x53000 thru 0x54304 (0x1305 bytes) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3438(110 mod 256): MAPREAD 0x24000 thru 0x25df8 (0x1df9 bytes) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3439(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3440(112 mod 256): MAPREAD 0x40000 thru 0x40fcc (0xfcd bytes) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3441(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3442(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3443(115 mod 256): PUNCH 0x53bf9 thru 0x55987 (0x1d8f bytes) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3444(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3445(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3446(118 mod 256): MAPREAD 0x56000 thru 0x56b67 (0xb68 bytes) 2024-03-26T07:41:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: +3447(119 mod 256): PUNCH 0x487d2 thru 0x48945 (0x174 bytes) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3448(120 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3449(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3450(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3451(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3452(124 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3453(125 mod 256): READ 0x58000 thru 0x58fff (0x1000 bytes) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3454(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3455(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3456(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3457(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3458(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3459(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3460(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3461(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: +3462(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3463(135 mod 256): PUNCH 0x1ffc4 thru 0x20a02 (0xa3f bytes) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3464(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3465(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3466(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3467(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3468(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3469(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3470(142 mod 256): TRUNCATE DOWN from 0x74000 to 0x3c000 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3471(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3472(144 mod 256): MAPWRITE 0x4a000 thru 0x4a0a6 (0xa7 bytes) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3473(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3474(146 mod 256): MAPWRITE 0x3e000 thru 0x3e37b (0x37c bytes) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3475(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: +3476(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3477(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3478(150 mod 256): MAPWRITE 0x2d000 thru 0x2ed8b (0x1d8c bytes) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3479(151 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x14000 thru 0x14fff 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3480(152 mod 256): MAPWRITE 0x2b000 thru 0x2c1bb (0x11bc bytes) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3481(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3482(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3483(155 mod 256): PUNCH 0x5571 thru 0x7102 (0x1b92 bytes) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3484(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3485(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3486(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3487(159 mod 256): MAPREAD 0x19000 thru 0x194d9 (0x4da bytes) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3488(160 mod 256): TRUNCATE DOWN from 0x4a0a7 to 0x26000 ******WWWW 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3489(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3490(162 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0xd000 thru 0xdfff 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3491(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: +3492(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3493(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3494(166 mod 256): MAPREAD 0x3000 thru 0x3e46 (0xe47 bytes) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3495(167 mod 256): PUNCH 0x212d1 thru 0x224b5 (0x11e5 bytes) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3496(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3497(169 mod 256): MAPREAD 0xd000 thru 0xefe2 (0x1fe3 bytes) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3498(170 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3499(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3500(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3501(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3502(174 mod 256): PUNCH 0x52e27 thru 0x53065 (0x23f bytes) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3503(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3504(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3505(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3506(178 mod 256): WRITE 0x39000 thru 0x39fff (0x1000 bytes) 2024-03-26T07:41:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: +3507(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3508(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3509(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3510(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3511(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3512(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3513(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3514(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3515(187 mod 256): TRUNCATE DOWN from 0x5d000 to 0x3000 ******WWWW 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3516(188 mod 256): PUNCH 0x624 thru 0x17c4 (0x11a1 bytes) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3517(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3518(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3519(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: +3520(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3521(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3522(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3523(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3524(196 mod 256): PUNCH 0x6cf thru 0x1dd5 (0x1707 bytes) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3525(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3526(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3527(199 mod 256): PUNCH 0x178a thru 0x2a03 (0x127a bytes) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3528(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3529(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3530(202 mod 256): MAPWRITE 0x58000 thru 0x59b24 (0x1b25 bytes) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3531(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3532(204 mod 256): MAPWRITE 0x4e000 thru 0x4ee97 (0xe98 bytes) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3533(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3534(206 mod 256): MAPWRITE 0x6000 thru 0x7aba (0x1abb bytes) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3535(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: +3536(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3537(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3538(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3539(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3540(212 mod 256): READ 0x49000 thru 0x49fff (0x1000 bytes) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3541(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3542(214 mod 256): PUNCH 0x483c4 thru 0x4931c (0xf59 bytes) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3543(215 mod 256): WRITE 0x44000 thru 0x44fff (0x1000 bytes) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3544(216 mod 256): COPY 0x15000 thru 0x15fff (0x1000 bytes) to 0x73000 thru 0x73fff 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3545(217 mod 256): MAPREAD 0x2b000 thru 0x2b811 (0x812 bytes) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3546(218 mod 256): MAPREAD 0xa000 thru 0xb10d (0x110e bytes) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3547(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3548(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3549(221 mod 256): MAPWRITE 0x5b000 thru 0x5bdc8 (0xdc9 bytes) 2024-03-26T07:41:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: +3550(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3551(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3552(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3553(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3554(226 mod 256): TRUNCATE DOWN from 0x74000 to 0x4f000 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3555(227 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3556(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3557(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3558(230 mod 256): MAPREAD 0x18000 thru 0x1863d (0x63e bytes) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3559(231 mod 256): MAPWRITE 0x28000 thru 0x29eaf (0x1eb0 bytes) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3560(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3561(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3562(234 mod 256): MAPWRITE 0x68000 thru 0x69b54 (0x1b55 bytes) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3563(235 mod 256): PUNCH 0xf4d1 thru 0x111e0 (0x1d10 bytes) 2024-03-26T07:41:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: +3564(236 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3565(237 mod 256): MAPWRITE 0x33000 thru 0x33caa (0xcab bytes) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3566(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3567(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3568(240 mod 256): MAPREAD 0x67000 thru 0x67e5d (0xe5e bytes) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3569(241 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x2a000 thru 0x2afff 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3570(242 mod 256): READ 0x48000 thru 0x48fff (0x1000 bytes) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3571(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3572(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3573(245 mod 256): READ 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3574(246 mod 256): MAPREAD 0x57000 thru 0x58d50 (0x1d51 bytes) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3575(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3576(248 mod 256): MAPREAD 0x24000 thru 0x240de (0xdf bytes) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3577(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: +3578(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3579(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3580(252 mod 256): PUNCH 0x4915b thru 0x4a7ea (0x1690 bytes) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3581(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3582(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3583(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3584( 0 mod 256): TRUNCATE DOWN from 0x69b55 to 0x9000 ******WWWW 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3585( 1 mod 256): TRUNCATE UP from 0x9000 to 0x52000 ******WWWW 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3586( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3587( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3588( 4 mod 256): WRITE 0x47000 thru 0x47fff (0x1000 bytes) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3589( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3590( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3591( 7 mod 256): MAPWRITE 0x79000 thru 0x79c0b (0xc0c bytes) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3592( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: +3593( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3594( 10 mod 256): MAPWRITE 0x51000 thru 0x529fa (0x19fb bytes) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3595( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3596( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3597( 13 mod 256): MAPREAD 0x25000 thru 0x26420 (0x1421 bytes) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3598( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3599( 15 mod 256): READ 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3600( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3601( 17 mod 256): MAPWRITE 0x70000 thru 0x7012c (0x12d bytes) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3602( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3603( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3604( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3605( 21 mod 256): MAPREAD 0x5d000 thru 0x5dda2 (0xda3 bytes) 2024-03-26T07:41:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: +3606( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3607( 23 mod 256): COPY 0x53000 thru 0x53fff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3608( 24 mod 256): TRUNCATE DOWN from 0x79c0c to 0x23000 ******WWWW 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3609( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3610( 26 mod 256): PUNCH 0xa8ed thru 0xc80a (0x1f1e bytes) 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3611( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3612( 28 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3613( 29 mod 256): MAPREAD 0x12000 thru 0x121d9 (0x1da bytes) 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3614( 30 mod 256): TRUNCATE UP from 0x23000 to 0x47000 ******WWWW 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3615( 31 mod 256): COPY 0x1d000 thru 0x1dfff (0x1000 bytes) to 0x2e000 thru 0x2efff 2024-03-26T07:41:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: +3616( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3617( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3618( 34 mod 256): MAPWRITE 0x6d000 thru 0x6e969 (0x196a bytes) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3619( 35 mod 256): READ 0x52000 thru 0x52fff (0x1000 bytes) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3620( 36 mod 256): PUNCH 0x588e4 thru 0x5a066 (0x1783 bytes) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3621( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3622( 38 mod 256): MAPREAD 0x48000 thru 0x49bff (0x1c00 bytes) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3623( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3624( 40 mod 256): MAPWRITE 0x26000 thru 0x27fda (0x1fdb bytes) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3625( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3626( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3627( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3628( 44 mod 256): MAPREAD 0x12000 thru 0x134bd (0x14be bytes) 2024-03-26T07:41:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: +3629( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3630( 46 mod 256): PUNCH 0x5cfba thru 0x5d14d (0x194 bytes) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3631( 47 mod 256): MAPWRITE 0x15000 thru 0x16f89 (0x1f8a bytes) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3632( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3633( 49 mod 256): WRITE 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3634( 50 mod 256): PUNCH 0x1d5d3 thru 0x1ecdc (0x170a bytes) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3635( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3636( 52 mod 256): PUNCH 0x6c332 thru 0x6c541 (0x210 bytes) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3637( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3638( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3639( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3640( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3641( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: +3642( 58 mod 256): WRITE 0x71000 thru 0x71fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3643( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3644( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3645( 61 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3646( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3647( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3648( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3649( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3650( 66 mod 256): TRUNCATE DOWN from 0x77000 to 0x3000 ******WWWW 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3651( 67 mod 256): READ 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3652( 68 mod 256): MAPREAD 0x1000 thru 0x1628 (0x629 bytes) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3653( 69 mod 256): PUNCH 0x8e3 thru 0x2209 (0x1927 bytes) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3654( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3655( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: +3656( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3657( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3658( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3659( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3660( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3661( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3662( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3663( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3664( 80 mod 256): MAPREAD 0x0 thru 0xb78 (0xb79 bytes) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3665( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3666( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3667( 83 mod 256): PUNCH 0x9fb thru 0xf7a (0x580 bytes) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3668( 84 mod 256): PUNCH 0x242e thru 0x2fff (0xbd2 bytes) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3669( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: +3670( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3671( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3672( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3673( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3674( 90 mod 256): PUNCH 0x2c69 thru 0x2fff (0x397 bytes) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3675( 91 mod 256): TRUNCATE UP from 0x3000 to 0x49000 ******WWWW 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3676( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3677( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3678( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3679( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3680( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3681( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3682( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: +3683( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3684(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3685(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3686(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3687(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3688(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3689(105 mod 256): MAPREAD 0x9000 thru 0x952a (0x52b bytes) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3690(106 mod 256): MAPWRITE 0x16000 thru 0x171f5 (0x11f6 bytes) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3691(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3692(108 mod 256): MAPWRITE 0x6c000 thru 0x6c105 (0x106 bytes) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3693(109 mod 256): TRUNCATE UP from 0x6c106 to 0x71000 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3694(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3695(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3696(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: +3697(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3698(114 mod 256): COPY 0x17000 thru 0x17fff (0x1000 bytes) to 0x3c000 thru 0x3cfff 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3699(115 mod 256): MAPWRITE 0x34000 thru 0x35c2a (0x1c2b bytes) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3700(116 mod 256): TRUNCATE DOWN from 0x71000 to 0x22000 ******WWWW 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3701(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3702(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3703(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3704(120 mod 256): WRITE 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3705(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3706(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3707(123 mod 256): WRITE 0x40000 thru 0x40fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3708(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3709(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3710(126 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x1c000 thru 0x1cfff 2024-03-26T07:41:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: +3711(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3712(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3713(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3714(130 mod 256): TRUNCATE UP from 0x41000 to 0x5a000 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3715(131 mod 256): MAPREAD 0x3e000 thru 0x3e72d (0x72e bytes) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3716(132 mod 256): MAPWRITE 0xa000 thru 0xa8a1 (0x8a2 bytes) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3717(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3718(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3719(135 mod 256): MAPREAD 0x35000 thru 0x36231 (0x1232 bytes) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3720(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3721(137 mod 256): COPY 0x2d000 thru 0x2dfff (0x1000 bytes) to 0x61000 thru 0x61fff 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3722(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3723(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3724(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: +3725(141 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3726(142 mod 256): COPY 0x47000 thru 0x47fff (0x1000 bytes) to 0x77000 thru 0x77fff 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3727(143 mod 256): COPY 0x6a000 thru 0x6afff (0x1000 bytes) to 0x68000 thru 0x68fff 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3728(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3729(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3730(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3731(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3732(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3733(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3734(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3735(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3736(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3737(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: +3738(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3739(155 mod 256): MAPWRITE 0x5d000 thru 0x5d4df (0x4e0 bytes) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3740(156 mod 256): PUNCH 0x2c305 thru 0x2c7ac (0x4a8 bytes) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3741(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3742(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3743(159 mod 256): MAPREAD 0x53000 thru 0x54ffc (0x1ffd bytes) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3744(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3745(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3746(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3747(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3748(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3749(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3750(166 mod 256): WRITE 0x27000 thru 0x27fff (0x1000 bytes) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3751(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: +3752(168 mod 256): TRUNCATE DOWN from 0x78000 to 0x50000 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3753(169 mod 256): MAPREAD 0x6000 thru 0x73b2 (0x13b3 bytes) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3754(170 mod 256): MAPREAD 0x20000 thru 0x20c9d (0xc9e bytes) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3755(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3756(172 mod 256): MAPWRITE 0xf000 thru 0x107c2 (0x17c3 bytes) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3757(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3758(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3759(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3760(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3761(177 mod 256): TRUNCATE DOWN from 0x50000 to 0x22000 ******WWWW 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3762(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3763(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3764(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: +3765(181 mod 256): TRUNCATE DOWN from 0x22000 to 0xa000 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3766(182 mod 256): TRUNCATE UP from 0xa000 to 0x2c000 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3767(183 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3768(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3769(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3770(186 mod 256): PUNCH 0x3dd0b thru 0x3e6c0 (0x9b6 bytes) 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3771(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3772(188 mod 256): MAPWRITE 0x19000 thru 0x1a1a1 (0x11a2 bytes) 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3773(189 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3774(190 mod 256): MAPWRITE 0xc000 thru 0xc38d (0x38e bytes) 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3775(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3776(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3777(193 mod 256): COPY 0xc000 thru 0xcfff (0x1000 bytes) to 0x63000 thru 0x63fff 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3778(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: +3779(195 mod 256): TRUNCATE DOWN from 0x64000 to 0x31000 ******WWWW 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3780(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3781(197 mod 256): PUNCH 0x1c282 thru 0x1cdf6 (0xb75 bytes) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3782(198 mod 256): READ 0xf000 thru 0xffff (0x1000 bytes) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3783(199 mod 256): MAPWRITE 0x42000 thru 0x4239e (0x39f bytes) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3784(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3785(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3786(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3787(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3788(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3789(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3790(206 mod 256): PUNCH 0x37e07 thru 0x392ce (0x14c8 bytes) ******PPPP 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3791(207 mod 256): MAPWRITE 0xc000 thru 0xda4b (0x1a4c bytes) 2024-03-26T07:41:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: +3792(208 mod 256): PUNCH 0xb1b6 thru 0xb7cc (0x617 bytes) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3793(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3794(210 mod 256): MAPREAD 0x1f000 thru 0x1ffd3 (0xfd4 bytes) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3795(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3796(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3797(213 mod 256): TRUNCATE DOWN from 0x4239f to 0x22000 ******WWWW 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3798(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3799(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3800(216 mod 256): MAPREAD 0xd000 thru 0xe0c4 (0x10c5 bytes) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3801(217 mod 256): MAPREAD 0xe000 thru 0xe4ae (0x4af bytes) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3802(218 mod 256): WRITE 0x5b000 thru 0x5bfff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3803(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3804(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3805(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: +3806(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3807(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3808(224 mod 256): PUNCH 0x6069 thru 0x713c (0x10d4 bytes) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3809(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3810(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3811(227 mod 256): MAPREAD 0x2b000 thru 0x2bc78 (0xc79 bytes) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3812(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3813(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3814(230 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3815(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3816(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3817(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3818(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: +3819(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3820(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3821(237 mod 256): READ 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3822(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3823(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3824(240 mod 256): MAPWRITE 0x69000 thru 0x6ac7e (0x1c7f bytes) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3825(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3826(242 mod 256): MAPREAD 0x10000 thru 0x112ee (0x12ef bytes) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3827(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3828(244 mod 256): COPY 0x60000 thru 0x60fff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3829(245 mod 256): TRUNCATE UP from 0x6ac7f to 0x72000 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3830(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3831(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: +3832(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3833(249 mod 256): TRUNCATE DOWN from 0x72000 to 0x2000 ******WWWW 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3834(250 mod 256): MAPWRITE 0x1e000 thru 0x1f762 (0x1763 bytes) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3835(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3836(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3837(253 mod 256): PUNCH 0x1b1bc thru 0x1c131 (0xf76 bytes) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3838(254 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3839(255 mod 256): PUNCH 0x1890b thru 0x1a7a2 (0x1e98 bytes) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3840( 0 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3841( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3842( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3843( 3 mod 256): PUNCH 0xc2ee thru 0xdeb4 (0x1bc7 bytes) 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3844( 4 mod 256): COPY 0x3000 thru 0x3fff (0x1000 bytes) to 0xa000 thru 0xafff 2024-03-26T07:41:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: +3845( 5 mod 256): MAPREAD 0x16000 thru 0x161ae (0x1af bytes) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3846( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3847( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3848( 8 mod 256): MAPREAD 0xe000 thru 0xf7ea (0x17eb bytes) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3849( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3850( 10 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3851( 11 mod 256): COPY 0x2e000 thru 0x2efff (0x1000 bytes) to 0x6e000 thru 0x6efff 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3852( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3853( 13 mod 256): WRITE 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3854( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3855( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3856( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3857( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3858( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: +3859( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3860( 20 mod 256): MAPWRITE 0x6b000 thru 0x6ce8a (0x1e8b bytes) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3861( 21 mod 256): MAPWRITE 0x68000 thru 0x68d03 (0xd04 bytes) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3862( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3863( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3864( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3865( 25 mod 256): TRUNCATE DOWN from 0x6f000 to 0x2d000 ******WWWW 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3866( 26 mod 256): MAPWRITE 0x57000 thru 0x5893b (0x193c bytes) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3867( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3868( 28 mod 256): COPY 0x2b000 thru 0x2bfff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3869( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3870( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3871( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3872( 32 mod 256): MAPREAD 0x32000 thru 0x32da4 (0xda5 bytes) 2024-03-26T07:41:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: +3873( 33 mod 256): MAPWRITE 0x6a000 thru 0x6b73e (0x173f bytes) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3874( 34 mod 256): MAPREAD 0x4a000 thru 0x4b33c (0x133d bytes) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3875( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3876( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3877( 37 mod 256): WRITE 0x2f000 thru 0x2ffff (0x1000 bytes) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3878( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3879( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3880( 40 mod 256): WRITE 0x4e000 thru 0x4efff (0x1000 bytes) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3881( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3882( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3883( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3884( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3885( 45 mod 256): MAPREAD 0x65000 thru 0x665d3 (0x15d4 bytes) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3886( 46 mod 256): PUNCH 0x302ce thru 0x318d3 (0x1606 bytes) 2024-03-26T07:41:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: +3887( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3888( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3889( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3890( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3891( 51 mod 256): COPY 0x2d000 thru 0x2dfff (0x1000 bytes) to 0x4d000 thru 0x4dfff 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3892( 52 mod 256): COPY 0x47000 thru 0x47fff (0x1000 bytes) to 0x6000 thru 0x6fff 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3893( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3894( 54 mod 256): MAPREAD 0x24000 thru 0x256eb (0x16ec bytes) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3895( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3896( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3897( 57 mod 256): PUNCH 0x3ff74 thru 0x41dde (0x1e6b bytes) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3898( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3899( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: +3900( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3901( 61 mod 256): TRUNCATE DOWN from 0x6b73f to 0x41000 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3902( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3903( 63 mod 256): PUNCH 0x2816e thru 0x2817c (0xf bytes) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3904( 64 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3905( 65 mod 256): READ 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3906( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3907( 67 mod 256): WRITE 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3908( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3909( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3910( 70 mod 256): COPY 0xc000 thru 0xcfff (0x1000 bytes) to 0x72000 thru 0x72fff 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3911( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3912( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3913( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: +3914( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3915( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3916( 76 mod 256): TRUNCATE DOWN from 0x73000 to 0x5c000 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3917( 77 mod 256): MAPWRITE 0x3000 thru 0x3e66 (0xe67 bytes) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3918( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3919( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3920( 80 mod 256): MAPWRITE 0x1a000 thru 0x1ae02 (0xe03 bytes) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3921( 81 mod 256): COPY 0x44000 thru 0x44fff (0x1000 bytes) to 0x2a000 thru 0x2afff 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3922( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3923( 83 mod 256): WRITE 0x48000 thru 0x48fff (0x1000 bytes) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3924( 84 mod 256): MAPWRITE 0x3c000 thru 0x3c69f (0x6a0 bytes) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3925( 85 mod 256): COPY 0x37000 thru 0x37fff (0x1000 bytes) to 0x13000 thru 0x13fff EEEE****** 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3926( 86 mod 256): PUNCH 0x16f8e thru 0x180b3 (0x1126 bytes) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3927( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: +3928( 88 mod 256): WRITE 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3929( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3930( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3931( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3932( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3933( 93 mod 256): WRITE 0x45000 thru 0x45fff (0x1000 bytes) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3934( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3935( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3936( 96 mod 256): MAPREAD 0xd000 thru 0xd603 (0x604 bytes) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3937( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3938( 98 mod 256): TRUNCATE DOWN from 0x5c000 to 0x30000 ******WWWW 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3939( 99 mod 256): MAPWRITE 0x4000 thru 0x4f43 (0xf44 bytes) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3940(100 mod 256): TRUNCATE DOWN from 0x30000 to 0xc000 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3941(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: +3942(102 mod 256): TRUNCATE UP from 0xc000 to 0x22000 2024-03-26T07:41:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: +3943(103 mod 256): TRUNCATE UP from 0x22000 to 0x70000 ******WWWW 2024-03-26T07:41:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: +3944(104 mod 256): MAPWRITE 0x4a000 thru 0x4a18b (0x18c bytes) 2024-03-26T07:41:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: +3945(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: +3946(106 mod 256): MAPWRITE 0x74000 thru 0x750ae (0x10af bytes) 2024-03-26T07:41:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: +3947(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: +3948(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: +3949(109 mod 256): COPY 0x53000 thru 0x53fff (0x1000 bytes) to 0x3b000 thru 0x3bfff 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3950(110 mod 256): PUNCH 0x21abc thru 0x2279c (0xce1 bytes) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3951(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3952(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3953(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3954(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3955(115 mod 256): PUNCH 0x7f27 thru 0x9408 (0x14e2 bytes) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3956(116 mod 256): MAPREAD 0x5c000 thru 0x5c9c9 (0x9ca bytes) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3957(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3958(118 mod 256): PUNCH 0x22655 thru 0x23d4b (0x16f7 bytes) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3959(119 mod 256): COPY 0x29000 thru 0x29fff (0x1000 bytes) to 0x21000 thru 0x21fff 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3960(120 mod 256): PUNCH 0x878 thru 0x25af (0x1d38 bytes) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3961(121 mod 256): MAPREAD 0x41000 thru 0x41ad7 (0xad8 bytes) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3962(122 mod 256): READ 0x6e000 thru 0x6efff (0x1000 bytes) 2024-03-26T07:41:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: +3963(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3964(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3965(125 mod 256): PUNCH 0x33cbd thru 0x357f6 (0x1b3a bytes) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3966(126 mod 256): MAPWRITE 0x66000 thru 0x67bab (0x1bac bytes) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3967(127 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3968(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3969(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3970(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3971(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3972(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3973(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3974(134 mod 256): MAPREAD 0x9000 thru 0xa10b (0x110c bytes) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3975(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3976(136 mod 256): MAPWRITE 0x2b000 thru 0x2ba5d (0xa5e bytes) 2024-03-26T07:41:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: +3977(137 mod 256): PUNCH 0x138aa thru 0x147fe (0xf55 bytes) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3978(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3979(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3980(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3981(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3982(142 mod 256): TRUNCATE DOWN from 0x750af to 0x52000 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3983(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3984(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3985(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3986(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3987(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3988(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3989(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3990(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3991(151 mod 256): PUNCH 0x1b9b0 thru 0x1d50d (0x1b5e bytes) 2024-03-26T07:41:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: +3992(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +3993(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +3994(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +3995(155 mod 256): MAPREAD 0x10000 thru 0x115e7 (0x15e8 bytes) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +3996(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +3997(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +3998(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +3999(159 mod 256): MAPREAD 0x34000 thru 0x34d74 (0xd75 bytes) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +4000(160 mod 256): COPY 0x23000 thru 0x23fff (0x1000 bytes) to 0x54000 thru 0x54fff 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +4001(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +4002(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +4003(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +4004(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +4005(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: +4006(166 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x41000 thru 0x41fff 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4007(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4008(168 mod 256): MAPREAD 0x3a000 thru 0x3b8ab (0x18ac bytes) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4009(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4010(170 mod 256): TRUNCATE DOWN from 0x55000 to 0x41000 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4011(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4012(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4013(173 mod 256): COPY 0x1c000 thru 0x1cfff (0x1000 bytes) to 0x4e000 thru 0x4efff 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4014(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4015(175 mod 256): PUNCH 0x280e3 thru 0x2958a (0x14a8 bytes) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4016(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4017(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4018(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4019(179 mod 256): WRITE 0x46000 thru 0x46fff (0x1000 bytes) 2024-03-26T07:41:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: +4020(180 mod 256): MAPREAD 0x11000 thru 0x11910 (0x911 bytes) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4021(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4022(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4023(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4024(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4025(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4026(186 mod 256): TRUNCATE DOWN from 0x4f000 to 0x26000 ******WWWW 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4027(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4028(188 mod 256): TRUNCATE UP from 0x26000 to 0x29000 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4029(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4030(190 mod 256): READ 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4031(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4032(192 mod 256): WRITE 0x48000 thru 0x48fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4033(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4034(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: +4035(195 mod 256): MAPWRITE 0x3e000 thru 0x3e950 (0x951 bytes) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4036(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4037(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4038(198 mod 256): PUNCH 0x34448 thru 0x35bac (0x1765 bytes) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4039(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4040(200 mod 256): TRUNCATE UP from 0x49000 to 0x57000 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4041(201 mod 256): TRUNCATE UP from 0x57000 to 0x59000 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4042(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4043(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4044(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4045(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4046(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4047(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4048(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: +4049(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4050(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4051(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4052(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4053(213 mod 256): WRITE 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4054(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4055(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4056(216 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4057(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4058(218 mod 256): MAPREAD 0x18000 thru 0x1984b (0x184c bytes) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4059(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4060(220 mod 256): PUNCH 0x4fe70 thru 0x5098c (0xb1d bytes) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4061(221 mod 256): READ 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-26T07:41:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: +4062(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4063(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4064(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4065(225 mod 256): TRUNCATE DOWN from 0x59000 to 0x36000 ******WWWW 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4066(226 mod 256): WRITE 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4067(227 mod 256): MAPREAD 0x25000 thru 0x268a9 (0x18aa bytes) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4068(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4069(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4070(230 mod 256): PUNCH 0x26041 thru 0x2651d (0x4dd bytes) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4071(231 mod 256): COPY 0x5000 thru 0x5fff (0x1000 bytes) to 0x3d000 thru 0x3dfff 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4072(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4073(233 mod 256): MAPWRITE 0x57000 thru 0x57bcd (0xbce bytes) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4074(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4075(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4076(236 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x23000 thru 0x23fff 2024-03-26T07:41:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: +4077(237 mod 256): MAPWRITE 0x14000 thru 0x14242 (0x243 bytes) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4078(238 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4079(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4080(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4081(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4082(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4083(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4084(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4085(245 mod 256): WRITE 0x37000 thru 0x37fff (0x1000 bytes) ***WWWW 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4086(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4087(247 mod 256): COPY 0x31000 thru 0x31fff (0x1000 bytes) to 0x57000 thru 0x57fff 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4088(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4089(249 mod 256): MAPREAD 0x1e000 thru 0x1f97c (0x197d bytes) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4090(250 mod 256): WRITE 0x4c000 thru 0x4cfff (0x1000 bytes) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4091(251 mod 256): READ 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-26T07:41:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: +4092(252 mod 256): READ 0x37000 thru 0x37fff (0x1000 bytes) ***RRRR*** 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4093(253 mod 256): PUNCH 0x36c46 thru 0x3758b (0x946 bytes) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4094(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4095(255 mod 256): MAPWRITE 0x6f000 thru 0x6f3c4 (0x3c5 bytes) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4096( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4097( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4098( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4099( 3 mod 256): COPY 0x35000 thru 0x35fff (0x1000 bytes) to 0x1c000 thru 0x1cfff 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4100( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4101( 5 mod 256): MAPREAD 0x61000 thru 0x62c1e (0x1c1f bytes) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4102( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4103( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4104( 8 mod 256): COPY 0x68000 thru 0x68fff (0x1000 bytes) to 0x59000 thru 0x59fff 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4105( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: +4106( 10 mod 256): MAPWRITE 0x1f000 thru 0x1f921 (0x922 bytes) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4107( 11 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4108( 12 mod 256): COPY 0x47000 thru 0x47fff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4109( 13 mod 256): PUNCH 0x41dd1 thru 0x42907 (0xb37 bytes) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4110( 14 mod 256): TRUNCATE UP from 0x6f3c5 to 0x75000 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4111( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4112( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4113( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4114( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4115( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4116( 20 mod 256): TRUNCATE UP from 0x75000 to 0x76000 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4117( 21 mod 256): MAPREAD 0x69000 thru 0x69176 (0x177 bytes) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4118( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4119( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: +4120( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4121( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4122( 26 mod 256): MAPWRITE 0x66000 thru 0x673f9 (0x13fa bytes) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4123( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4124( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4125( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4126( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4127( 31 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x34000 thru 0x34fff 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4128( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4129( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4130( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4131( 35 mod 256): MAPWRITE 0x25000 thru 0x260e9 (0x10ea bytes) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4132( 36 mod 256): COPY 0x4c000 thru 0x4cfff (0x1000 bytes) to 0x13000 thru 0x13fff 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4133( 37 mod 256): MAPWRITE 0x60000 thru 0x615eb (0x15ec bytes) 2024-03-26T07:41:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: +4134( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4135( 39 mod 256): TRUNCATE DOWN from 0x76000 to 0xd000 ******WWWW 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4136( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4137( 41 mod 256): PUNCH 0x5438 thru 0x6172 (0xd3b bytes) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4138( 42 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4139( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4140( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4141( 45 mod 256): MAPREAD 0x4000 thru 0x584e (0x184f bytes) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4142( 46 mod 256): MAPREAD 0x0 thru 0x1c89 (0x1c8a bytes) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4143( 47 mod 256): TRUNCATE UP from 0xd000 to 0x2c000 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4144( 48 mod 256): READ 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4145( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4146( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4147( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: +4148( 52 mod 256): MAPREAD 0x22000 thru 0x22e4e (0xe4f bytes) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4149( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4150( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4151( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4152( 56 mod 256): MAPWRITE 0x17000 thru 0x184ae (0x14af bytes) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4153( 57 mod 256): MAPWRITE 0x28000 thru 0x283b7 (0x3b8 bytes) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4154( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4155( 59 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4156( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4157( 61 mod 256): READ 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4158( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4159( 63 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4160( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4161( 65 mod 256): READ 0x26000 thru 0x26fff (0x1000 bytes) 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4162( 66 mod 256): TRUNCATE UP from 0x54000 to 0x61000 2024-03-26T07:41:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: +4163( 67 mod 256): TRUNCATE UP from 0x61000 to 0x6e000 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4164( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4165( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4166( 70 mod 256): READ 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4167( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4168( 72 mod 256): TRUNCATE DOWN from 0x6e000 to 0x45000 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4169( 73 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x4b000 thru 0x4bfff 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4170( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4171( 75 mod 256): TRUNCATE UP from 0x4c000 to 0x79000 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4172( 76 mod 256): MAPWRITE 0x54000 thru 0x54669 (0x66a bytes) 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4173( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4174( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4175( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4176( 80 mod 256): TRUNCATE DOWN from 0x79000 to 0x69000 2024-03-26T07:41:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: +4177( 81 mod 256): MAPREAD 0x1d000 thru 0x1d15a (0x15b bytes) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4178( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4179( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4180( 84 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x15000 thru 0x15fff 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4181( 85 mod 256): WRITE 0x3000 thru 0x3fff (0x1000 bytes) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4182( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4183( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4184( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4185( 89 mod 256): MAPWRITE 0x55000 thru 0x5523c (0x23d bytes) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4186( 90 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4187( 91 mod 256): PUNCH 0x4a1c1 thru 0x4a437 (0x277 bytes) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4188( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4189( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4190( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: +4191( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4192( 96 mod 256): MAPREAD 0x34000 thru 0x34a60 (0xa61 bytes) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4193( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4194( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4195( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4196(100 mod 256): MAPWRITE 0x52000 thru 0x533f3 (0x13f4 bytes) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4197(101 mod 256): MAPWRITE 0x16000 thru 0x16d9e (0xd9f bytes) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4198(102 mod 256): MAPREAD 0x27000 thru 0x28a1e (0x1a1f bytes) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4199(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4200(104 mod 256): READ 0x6e000 thru 0x6efff (0x1000 bytes) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4201(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4202(106 mod 256): COPY 0x5f000 thru 0x5ffff (0x1000 bytes) to 0x20000 thru 0x20fff 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4203(107 mod 256): PUNCH 0x17bb thru 0x3686 (0x1ecc bytes) 2024-03-26T07:41:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: +4204(108 mod 256): MAPREAD 0xf000 thru 0x10efe (0x1eff bytes) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4205(109 mod 256): MAPREAD 0x5c000 thru 0x5cbe0 (0xbe1 bytes) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4206(110 mod 256): TRUNCATE DOWN from 0x70000 to 0x34000 ******WWWW 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4207(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4208(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4209(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4210(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4211(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4212(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4213(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4214(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4215(119 mod 256): PUNCH 0x12f7e thru 0x13f73 (0xff6 bytes) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4216(120 mod 256): MAPREAD 0x13000 thru 0x14c04 (0x1c05 bytes) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4217(121 mod 256): MAPREAD 0x29000 thru 0x2aeba (0x1ebb bytes) 2024-03-26T07:41:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: +4218(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4219(123 mod 256): MAPREAD 0x14000 thru 0x1505a (0x105b bytes) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4220(124 mod 256): TRUNCATE DOWN from 0x34000 to 0x17000 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4221(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4222(126 mod 256): READ 0xc000 thru 0xcfff (0x1000 bytes) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4223(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4224(128 mod 256): MAPWRITE 0x68000 thru 0x68d05 (0xd06 bytes) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4225(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4226(130 mod 256): PUNCH 0x9a41 thru 0xb994 (0x1f54 bytes) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4227(131 mod 256): MAPREAD 0x3d000 thru 0x3e727 (0x1728 bytes) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4228(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4229(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4230(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: +4231(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4232(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4233(137 mod 256): MAPWRITE 0x56000 thru 0x5738a (0x138b bytes) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4234(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4235(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4236(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4237(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4238(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4239(143 mod 256): MAPREAD 0xe000 thru 0xe2fe (0x2ff bytes) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4240(144 mod 256): TRUNCATE DOWN from 0x68d06 to 0x3d000 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4241(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4242(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4243(147 mod 256): WRITE 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4244(148 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4245(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: +4246(150 mod 256): PUNCH 0x391bb thru 0x3a293 (0x10d9 bytes) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4247(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4248(152 mod 256): PUNCH 0x14a5a thru 0x15815 (0xdbc bytes) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4249(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4250(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4251(155 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x4000 thru 0x4fff 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4252(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4253(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4254(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4255(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4256(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4257(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4258(162 mod 256): MAPREAD 0x2a000 thru 0x2a7bb (0x7bc bytes) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4259(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: +4260(164 mod 256): WRITE 0x3a000 thru 0x3afff (0x1000 bytes) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4261(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4262(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4263(167 mod 256): TRUNCATE DOWN from 0x3d000 to 0x35000 ******WWWW 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4264(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4265(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4266(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4267(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4268(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4269(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4270(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4271(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4272(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4273(177 mod 256): PUNCH 0x1afbf thru 0x1bf65 (0xfa7 bytes) 2024-03-26T07:41:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: +4274(178 mod 256): WRITE 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4275(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4276(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4277(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4278(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4279(183 mod 256): WRITE 0x66000 thru 0x66fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4280(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4281(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4282(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4283(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4284(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4285(189 mod 256): COPY 0x48000 thru 0x48fff (0x1000 bytes) to 0x11000 thru 0x11fff 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4286(190 mod 256): TRUNCATE DOWN from 0x67000 to 0x27000 ******WWWW 2024-03-26T07:41:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: +4287(191 mod 256): PUNCH 0xf204 thru 0x11022 (0x1e1f bytes) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4288(192 mod 256): MAPWRITE 0x42000 thru 0x42a56 (0xa57 bytes) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4289(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4290(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4291(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4292(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4293(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4294(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4295(199 mod 256): COPY 0x2a000 thru 0x2afff (0x1000 bytes) to 0x23000 thru 0x23fff 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4296(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4297(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4298(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4299(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4300(204 mod 256): MAPWRITE 0x4000 thru 0x4443 (0x444 bytes) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4301(205 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: +4302(206 mod 256): TRUNCATE DOWN from 0x42a57 to 0x8000 ******WWWW 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4303(207 mod 256): PUNCH 0x7ec2 thru 0x7fff (0x13e bytes) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4304(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4305(209 mod 256): MAPWRITE 0x53000 thru 0x54c2f (0x1c30 bytes) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4306(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4307(211 mod 256): PUNCH 0x540fb thru 0x54c2f (0xb35 bytes) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4308(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4309(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4310(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4311(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4312(216 mod 256): TRUNCATE UP from 0x54c30 to 0x70000 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4313(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4314(218 mod 256): READ 0x20000 thru 0x20fff (0x1000 bytes) 2024-03-26T07:41:44.872 INFO:teuthology.orchestra.run.smithi063.stdout: +4315(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4316(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4317(221 mod 256): MAPWRITE 0x2c000 thru 0x2c248 (0x249 bytes) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4318(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4319(223 mod 256): MAPWRITE 0x34000 thru 0x350e4 (0x10e5 bytes) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4320(224 mod 256): PUNCH 0x257c7 thru 0x2693a (0x1174 bytes) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4321(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4322(226 mod 256): MAPWRITE 0x6f000 thru 0x6f0ec (0xed bytes) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4323(227 mod 256): TRUNCATE DOWN from 0x70000 to 0xd000 ******WWWW 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4324(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4325(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4326(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4327(231 mod 256): PUNCH 0x58a8 thru 0x75d6 (0x1d2f bytes) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4328(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: +4329(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4330(234 mod 256): PUNCH 0xa494 thru 0xc020 (0x1b8d bytes) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4331(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4332(236 mod 256): PUNCH 0x7a0c thru 0x815d (0x752 bytes) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4333(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4334(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4335(239 mod 256): MAPREAD 0x6000 thru 0x7e6c (0x1e6d bytes) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4336(240 mod 256): MAPWRITE 0xd000 thru 0xd1b7 (0x1b8 bytes) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4337(241 mod 256): COPY 0x3000 thru 0x3fff (0x1000 bytes) to 0x30000 thru 0x30fff 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4338(242 mod 256): TRUNCATE DOWN from 0x31000 to 0x13000 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4339(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4340(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4341(245 mod 256): PUNCH 0x333c thru 0x4ae6 (0x17ab bytes) 2024-03-26T07:41:44.874 INFO:teuthology.orchestra.run.smithi063.stdout: +4342(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4343(247 mod 256): TRUNCATE UP from 0x13000 to 0x5b000 ******WWWW 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4344(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4345(249 mod 256): MAPREAD 0x19000 thru 0x1a641 (0x1642 bytes) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4346(250 mod 256): PUNCH 0xbf10 thru 0xc673 (0x764 bytes) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4347(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4348(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4349(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4350(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4351(255 mod 256): WRITE 0x2e000 thru 0x2efff (0x1000 bytes) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4352( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4353( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4354( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: +4355( 3 mod 256): MAPREAD 0x2a000 thru 0x2bc45 (0x1c46 bytes) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4356( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4357( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4358( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4359( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4360( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4361( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4362( 10 mod 256): MAPREAD 0x19000 thru 0x1a345 (0x1346 bytes) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4363( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4364( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4365( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4366( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4367( 15 mod 256): TRUNCATE DOWN from 0x5b000 to 0x2000 ******WWWW 2024-03-26T07:41:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: +4368( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4369( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4370( 18 mod 256): PUNCH 0xcfe thru 0x1fff (0x1302 bytes) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4371( 19 mod 256): PUNCH 0x12ff thru 0x1fff (0xd01 bytes) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4372( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4373( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4374( 22 mod 256): WRITE 0x52000 thru 0x52fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4375( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4376( 24 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x4e000 thru 0x4efff 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4377( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4378( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4379( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4380( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: +4381( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4382( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4383( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4384( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4385( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4386( 34 mod 256): TRUNCATE DOWN from 0x53000 to 0x4f000 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4387( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4388( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4389( 37 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x1c000 thru 0x1cfff 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4390( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4391( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4392( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4393( 41 mod 256): MAPREAD 0x36000 thru 0x36065 (0x66 bytes) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4394( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: +4395( 43 mod 256): COPY 0x3000 thru 0x3fff (0x1000 bytes) to 0x2d000 thru 0x2dfff 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4396( 44 mod 256): MAPREAD 0x2d000 thru 0x2d8ef (0x8f0 bytes) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4397( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4398( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4399( 47 mod 256): WRITE 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4400( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4401( 49 mod 256): MAPREAD 0x45000 thru 0x462f7 (0x12f8 bytes) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4402( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4403( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4404( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4405( 53 mod 256): MAPWRITE 0x77000 thru 0x78122 (0x1123 bytes) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4406( 54 mod 256): TRUNCATE DOWN from 0x78123 to 0x5e000 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4407( 55 mod 256): MAPREAD 0x38000 thru 0x38464 (0x465 bytes) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4408( 56 mod 256): READ 0x1e000 thru 0x1efff (0x1000 bytes) 2024-03-26T07:41:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: +4409( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4410( 58 mod 256): READ 0x4c000 thru 0x4cfff (0x1000 bytes) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4411( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4412( 60 mod 256): PUNCH 0x55aef thru 0x5616d (0x67f bytes) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4413( 61 mod 256): TRUNCATE DOWN from 0x5e000 to 0xb000 ******WWWW 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4414( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4415( 63 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x72000 thru 0x72fff 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4416( 64 mod 256): PUNCH 0x38794 thru 0x39c54 (0x14c1 bytes) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4417( 65 mod 256): PUNCH 0x2d878 thru 0x2e8e5 (0x106e bytes) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4418( 66 mod 256): TRUNCATE DOWN from 0x73000 to 0x2b000 ******WWWW 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4419( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4420( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4421( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4422( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: +4423( 71 mod 256): PUNCH 0x29d0f thru 0x2a8d3 (0xbc5 bytes) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4424( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4425( 73 mod 256): TRUNCATE DOWN from 0x2b000 to 0x1f000 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4426( 74 mod 256): TRUNCATE DOWN from 0x1f000 to 0x10000 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4427( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4428( 76 mod 256): PUNCH 0xe217 thru 0xeab7 (0x8a1 bytes) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4429( 77 mod 256): PUNCH 0x21f2 thru 0x41a8 (0x1fb7 bytes) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4430( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4431( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4432( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4433( 81 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x66000 thru 0x66fff 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4434( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4435( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4436( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: +4437( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4438( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4439( 87 mod 256): TRUNCATE DOWN from 0x67000 to 0x1000 ******WWWW 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4440( 88 mod 256): TRUNCATE UP from 0x1000 to 0x50000 ******WWWW 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4441( 89 mod 256): COPY 0xf000 thru 0xffff (0x1000 bytes) to 0x2e000 thru 0x2efff 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4442( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4443( 91 mod 256): COPY 0x3b000 thru 0x3bfff (0x1000 bytes) to 0xe000 thru 0xefff 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4444( 92 mod 256): MAPWRITE 0xd000 thru 0xd239 (0x23a bytes) 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4445( 93 mod 256): MAPWRITE 0x51000 thru 0x5102e (0x2f bytes) 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4446( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4447( 95 mod 256): TRUNCATE UP from 0x5102f to 0x77000 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4448( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4449( 97 mod 256): MAPWRITE 0x54000 thru 0x55702 (0x1703 bytes) 2024-03-26T07:41:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: +4450( 98 mod 256): MAPWRITE 0x29000 thru 0x29360 (0x361 bytes) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4451( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4452(100 mod 256): PUNCH 0x4f0f7 thru 0x4f636 (0x540 bytes) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4453(101 mod 256): PUNCH 0x6faee thru 0x7104f (0x1562 bytes) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4454(102 mod 256): MAPWRITE 0x4f000 thru 0x4f138 (0x139 bytes) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4455(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4456(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4457(105 mod 256): TRUNCATE DOWN from 0x77000 to 0x18000 ******WWWW 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4458(106 mod 256): PUNCH 0x154ee thru 0x165d2 (0x10e5 bytes) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4459(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4460(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4461(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4462(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4463(111 mod 256): MAPREAD 0x5000 thru 0x6acc (0x1acd bytes) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4464(112 mod 256): MAPWRITE 0x1d000 thru 0x1d39f (0x3a0 bytes) 2024-03-26T07:41:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: +4465(113 mod 256): PUNCH 0x119df thru 0x132b9 (0x18db bytes) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4466(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4467(115 mod 256): TRUNCATE UP from 0x1d3a0 to 0x37000 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4468(116 mod 256): MAPREAD 0x28000 thru 0x296dc (0x16dd bytes) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4469(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4470(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4471(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4472(120 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4473(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4474(122 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4475(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4476(124 mod 256): MAPREAD 0x2f000 thru 0x3011f (0x1120 bytes) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4477(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: +4478(126 mod 256): TRUNCATE DOWN from 0x37000 to 0x34000 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4479(127 mod 256): PUNCH 0x12f9e thru 0x1422c (0x128f bytes) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4480(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4481(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4482(130 mod 256): MAPWRITE 0x70000 thru 0x716cf (0x16d0 bytes) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4483(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4484(132 mod 256): WRITE 0x46000 thru 0x46fff (0x1000 bytes) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4485(133 mod 256): MAPREAD 0x36000 thru 0x37467 (0x1468 bytes) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4486(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4487(135 mod 256): MAPREAD 0x3f000 thru 0x3fa79 (0xa7a bytes) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4488(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4489(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4490(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4491(139 mod 256): WRITE 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-26T07:41:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: +4492(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4493(141 mod 256): MAPREAD 0x1e000 thru 0x1e9ef (0x9f0 bytes) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4494(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4495(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4496(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4497(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4498(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4499(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4500(148 mod 256): MAPREAD 0x26000 thru 0x2733b (0x133c bytes) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4501(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4502(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4503(151 mod 256): COPY 0x5e000 thru 0x5efff (0x1000 bytes) to 0x30000 thru 0x30fff 2024-03-26T07:41:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: +4504(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4505(153 mod 256): MAPREAD 0x7000 thru 0x8750 (0x1751 bytes) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4506(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4507(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4508(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4509(157 mod 256): TRUNCATE DOWN from 0x716d0 to 0x5000 ******WWWW 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4510(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4511(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4512(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4513(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4514(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4515(163 mod 256): READ 0x0 thru 0xfff (0x1000 bytes) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4516(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: +4517(165 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4518(166 mod 256): COPY 0x66000 thru 0x66fff (0x1000 bytes) to 0x54000 thru 0x54fff 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4519(167 mod 256): PUNCH 0x663dc thru 0x6793e (0x1563 bytes) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4520(168 mod 256): WRITE 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4521(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4522(170 mod 256): MAPWRITE 0x0 thru 0xc1d (0xc1e bytes) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4523(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4524(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4525(173 mod 256): MAPREAD 0x10000 thru 0x10770 (0x771 bytes) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4526(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4527(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4528(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4529(177 mod 256): MAPREAD 0xd000 thru 0xe93d (0x193e bytes) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4530(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: +4531(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4532(180 mod 256): TRUNCATE DOWN from 0x70000 to 0x13000 ******WWWW 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4533(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4534(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4535(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4536(184 mod 256): PUNCH 0x8ab thru 0xdbf (0x515 bytes) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4537(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4538(186 mod 256): MAPREAD 0x8000 thru 0x8b22 (0xb23 bytes) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4539(187 mod 256): TRUNCATE UP from 0x13000 to 0x2b000 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4540(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4541(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4542(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4543(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4544(192 mod 256): WRITE 0x10000 thru 0x10fff (0x1000 bytes) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4545(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: +4546(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4547(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4548(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4549(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4550(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4551(199 mod 256): COPY 0x26000 thru 0x26fff (0x1000 bytes) to 0x6a000 thru 0x6afff 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4552(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4553(201 mod 256): MAPWRITE 0x33000 thru 0x344c3 (0x14c4 bytes) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4554(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4555(203 mod 256): MAPREAD 0x66000 thru 0x67ffa (0x1ffb bytes) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4556(204 mod 256): PUNCH 0x48357 thru 0x487ec (0x496 bytes) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4557(205 mod 256): TRUNCATE DOWN from 0x6b000 to 0x4c000 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4558(206 mod 256): MAPWRITE 0xa000 thru 0xb08e (0x108f bytes) 2024-03-26T07:41:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: +4559(207 mod 256): WRITE 0x5c000 thru 0x5cfff (0x1000 bytes) HOLE 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4560(208 mod 256): TRUNCATE UP from 0x5d000 to 0x5f000 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4561(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4562(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4563(211 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4564(212 mod 256): READ 0x52000 thru 0x52fff (0x1000 bytes) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4565(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4566(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4567(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4568(216 mod 256): WRITE 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4569(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4570(218 mod 256): MAPWRITE 0x50000 thru 0x5075d (0x75e bytes) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4571(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4572(220 mod 256): READ 0xf000 thru 0xffff (0x1000 bytes) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4573(221 mod 256): TRUNCATE DOWN from 0x5f000 to 0x2d000 ******WWWW 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4574(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: +4575(223 mod 256): MAPREAD 0x1d000 thru 0x1ec8c (0x1c8d bytes) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4576(224 mod 256): TRUNCATE UP from 0x2d000 to 0x31000 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4577(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4578(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4579(227 mod 256): MAPWRITE 0x38000 thru 0x389e3 (0x9e4 bytes) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4580(228 mod 256): MAPWRITE 0x2000 thru 0x263d (0x63e bytes) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4581(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4582(230 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x31000 thru 0x31fff 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4583(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4584(232 mod 256): MAPREAD 0x1b000 thru 0x1bc2f (0xc30 bytes) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4585(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4586(234 mod 256): TRUNCATE DOWN from 0x389e4 to 0x32000 ******WWWW 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4587(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4588(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: +4589(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4590(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4591(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4592(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4593(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4594(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4595(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4596(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4597(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4598(246 mod 256): TRUNCATE UP from 0x32000 to 0x74000 ******WWWW 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4599(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4600(248 mod 256): MAPWRITE 0x64000 thru 0x655db (0x15dc bytes) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4601(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4602(250 mod 256): TRUNCATE DOWN from 0x74000 to 0x51000 2024-03-26T07:41:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: +4603(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4604(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4605(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4606(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4607(255 mod 256): READ 0x3a000 thru 0x3afff (0x1000 bytes) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4608( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4609( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4610( 2 mod 256): MAPWRITE 0x6e000 thru 0x6f232 (0x1233 bytes) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4611( 3 mod 256): MAPWRITE 0x1d000 thru 0x1d2f9 (0x2fa bytes) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4612( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4613( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4614( 6 mod 256): TRUNCATE DOWN from 0x6f233 to 0x2d000 ******WWWW 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4615( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: +4616( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4617( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4618( 10 mod 256): MAPREAD 0x9000 thru 0x923b (0x23c bytes) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4619( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4620( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4621( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4622( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4623( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4624( 16 mod 256): TRUNCATE UP from 0x2d000 to 0x2d000 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4625( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4626( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4627( 19 mod 256): WRITE 0x50000 thru 0x50fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4628( 20 mod 256): PUNCH 0x47be5 thru 0x499bc (0x1dd8 bytes) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4629( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: +4630( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4631( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4632( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4633( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4634( 26 mod 256): READ 0x49000 thru 0x49fff (0x1000 bytes) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4635( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4636( 28 mod 256): READ 0x35000 thru 0x35fff (0x1000 bytes) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4637( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4638( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4639( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4640( 32 mod 256): TRUNCATE UP from 0x51000 to 0x63000 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4641( 33 mod 256): READ 0x46000 thru 0x46fff (0x1000 bytes) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4642( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4643( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: +4644( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4645( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4646( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4647( 39 mod 256): READ 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4648( 40 mod 256): PUNCH 0x25e8d thru 0x26c0e (0xd82 bytes) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4649( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4650( 42 mod 256): MAPREAD 0x49000 thru 0x49dc4 (0xdc5 bytes) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4651( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4652( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4653( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4654( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4655( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: +4656( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4657( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4658( 50 mod 256): MAPREAD 0x4c000 thru 0x4de87 (0x1e88 bytes) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4659( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4660( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4661( 53 mod 256): MAPWRITE 0x39000 thru 0x392a7 (0x2a8 bytes) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4662( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4663( 55 mod 256): MAPWRITE 0x6b000 thru 0x6b462 (0x463 bytes) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4664( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4665( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4666( 58 mod 256): MAPWRITE 0x59000 thru 0x5ae12 (0x1e13 bytes) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4667( 59 mod 256): COPY 0xf000 thru 0xffff (0x1000 bytes) to 0x17000 thru 0x17fff 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4668( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4669( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: +4670( 62 mod 256): WRITE 0x75000 thru 0x75fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4671( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4672( 64 mod 256): READ 0x60000 thru 0x60fff (0x1000 bytes) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4673( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4674( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4675( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4676( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4677( 69 mod 256): MAPREAD 0x2f000 thru 0x30bfd (0x1bfe bytes) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4678( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4679( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4680( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4681( 73 mod 256): WRITE 0x21000 thru 0x21fff (0x1000 bytes) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4682( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4683( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: +4684( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4685( 77 mod 256): PUNCH 0x6a665 thru 0x6a6ec (0x88 bytes) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4686( 78 mod 256): TRUNCATE DOWN from 0x76000 to 0x47000 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4687( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4688( 80 mod 256): TRUNCATE DOWN from 0x47000 to 0x4000 ******WWWW 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4689( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4690( 82 mod 256): MAPWRITE 0x79000 thru 0x7985d (0x85e bytes) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4691( 83 mod 256): MAPREAD 0x3000 thru 0x4674 (0x1675 bytes) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4692( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4693( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4694( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4695( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4696( 88 mod 256): READ 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4697( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4698( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: +4699( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4700( 92 mod 256): MAPWRITE 0x9000 thru 0xa691 (0x1692 bytes) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4701( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4702( 94 mod 256): WRITE 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4703( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4704( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4705( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4706( 98 mod 256): PUNCH 0x471de thru 0x48421 (0x1244 bytes) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4707( 99 mod 256): PUNCH 0x698c2 thru 0x6ab93 (0x12d2 bytes) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4708(100 mod 256): READ 0x13000 thru 0x13fff (0x1000 bytes) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4709(101 mod 256): PUNCH 0x6f959 thru 0x7156f (0x1c17 bytes) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4710(102 mod 256): PUNCH 0x35d18 thru 0x36b09 (0xdf2 bytes) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4711(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4712(104 mod 256): READ 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-26T07:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: +4713(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4714(106 mod 256): READ 0x15000 thru 0x15fff (0x1000 bytes) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4715(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4716(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4717(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4718(110 mod 256): TRUNCATE DOWN from 0x7985e to 0x75000 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4719(111 mod 256): WRITE 0x72000 thru 0x72fff (0x1000 bytes) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4720(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4721(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4722(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4723(115 mod 256): MAPWRITE 0x32000 thru 0x33b86 (0x1b87 bytes) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4724(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4725(117 mod 256): READ 0x15000 thru 0x15fff (0x1000 bytes) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4726(118 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-26T07:41:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: +4727(119 mod 256): COPY 0x53000 thru 0x53fff (0x1000 bytes) to 0x73000 thru 0x73fff 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4728(120 mod 256): TRUNCATE DOWN from 0x75000 to 0x9000 ******WWWW 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4729(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4730(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4731(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4732(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4733(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4734(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4735(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4736(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4737(129 mod 256): TRUNCATE UP from 0x9000 to 0x73000 ******WWWW 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4738(130 mod 256): MAPREAD 0x49000 thru 0x4a061 (0x1062 bytes) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4739(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: +4740(132 mod 256): PUNCH 0x4b36c thru 0x4b854 (0x4e9 bytes) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4741(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4742(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4743(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4744(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4745(137 mod 256): READ 0x1c000 thru 0x1cfff (0x1000 bytes) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4746(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4747(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4748(140 mod 256): COPY 0x63000 thru 0x63fff (0x1000 bytes) to 0x4c000 thru 0x4cfff 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4749(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4750(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4751(143 mod 256): PUNCH 0x437e9 thru 0x44525 (0xd3d bytes) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4752(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4753(145 mod 256): TRUNCATE DOWN from 0x73000 to 0x12000 ******WWWW 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4754(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: +4755(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4756(148 mod 256): COPY 0x5000 thru 0x5fff (0x1000 bytes) to 0x65000 thru 0x65fff 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4757(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4758(150 mod 256): TRUNCATE DOWN from 0x66000 to 0x47000 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4759(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4760(152 mod 256): TRUNCATE UP from 0x47000 to 0x5e000 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4761(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4762(154 mod 256): MAPREAD 0x18000 thru 0x18aec (0xaed bytes) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4763(155 mod 256): WRITE 0x3f000 thru 0x3ffff (0x1000 bytes) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4764(156 mod 256): MAPREAD 0x7000 thru 0x7acb (0xacc bytes) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4765(157 mod 256): TRUNCATE DOWN from 0x5e000 to 0x27000 ******WWWW 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4766(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4767(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4768(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4769(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: +4770(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4771(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4772(164 mod 256): WRITE 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4773(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4774(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4775(167 mod 256): PUNCH 0x2601f thru 0x26fff (0xfe1 bytes) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4776(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4777(169 mod 256): TRUNCATE DOWN from 0x27000 to 0x26000 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4778(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4779(171 mod 256): PUNCH 0x15dbe thru 0x16e93 (0x10d6 bytes) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4780(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4781(173 mod 256): PUNCH 0x23066 thru 0x23eea (0xe85 bytes) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4782(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: +4783(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4784(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4785(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4786(178 mod 256): TRUNCATE DOWN from 0x26000 to 0x6000 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4787(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4788(180 mod 256): MAPREAD 0x2000 thru 0x3543 (0x1544 bytes) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4789(181 mod 256): TRUNCATE DOWN from 0x6000 to 0x1000 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4790(182 mod 256): MAPWRITE 0xa000 thru 0xaa32 (0xa33 bytes) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4791(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4792(184 mod 256): MAPREAD 0x1000 thru 0x2c05 (0x1c06 bytes) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4793(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4794(186 mod 256): MAPWRITE 0x2b000 thru 0x2b053 (0x54 bytes) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4795(187 mod 256): MAPWRITE 0x6f000 thru 0x70b50 (0x1b51 bytes) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4796(188 mod 256): PUNCH 0x8d34 thru 0x9516 (0x7e3 bytes) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4797(189 mod 256): PUNCH 0x5ff53 thru 0x60321 (0x3cf bytes) 2024-03-26T07:41:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: +4798(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4799(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4800(192 mod 256): COPY 0x54000 thru 0x54fff (0x1000 bytes) to 0x55000 thru 0x55fff 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4801(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4802(194 mod 256): MAPWRITE 0x40000 thru 0x40500 (0x501 bytes) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4803(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4804(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4805(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4806(198 mod 256): PUNCH 0x2421e thru 0x24788 (0x56b bytes) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4807(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4808(200 mod 256): TRUNCATE DOWN from 0x70b51 to 0x49000 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4809(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4810(202 mod 256): MAPREAD 0x25000 thru 0x26fda (0x1fdb bytes) 2024-03-26T07:41:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: +4811(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4812(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4813(205 mod 256): WRITE 0x6c000 thru 0x6cfff (0x1000 bytes) HOLE 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4814(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4815(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4816(208 mod 256): PUNCH 0x5bb9f thru 0x5c415 (0x877 bytes) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4817(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4818(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4819(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4820(212 mod 256): TRUNCATE DOWN from 0x6d000 to 0x1f000 ******WWWW 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4821(213 mod 256): TRUNCATE UP from 0x1f000 to 0x4c000 ******WWWW 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4822(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4823(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4824(216 mod 256): MAPWRITE 0x6e000 thru 0x6f4b0 (0x14b1 bytes) 2024-03-26T07:41:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: +4825(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4826(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4827(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4828(220 mod 256): MAPREAD 0xc000 thru 0xd26b (0x126c bytes) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4829(221 mod 256): COPY 0x4d000 thru 0x4dfff (0x1000 bytes) to 0x10000 thru 0x10fff 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4830(222 mod 256): PUNCH 0x588d thru 0x6c34 (0x13a8 bytes) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4831(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4832(224 mod 256): PUNCH 0x2623 thru 0x3d23 (0x1701 bytes) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4833(225 mod 256): MAPREAD 0x4000 thru 0x506a (0x106b bytes) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4834(226 mod 256): TRUNCATE DOWN from 0x6f4b1 to 0x63000 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4835(227 mod 256): PUNCH 0x3a688 thru 0x3be09 (0x1782 bytes) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4836(228 mod 256): MAPWRITE 0x74000 thru 0x753d8 (0x13d9 bytes) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4837(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: +4838(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4839(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4840(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4841(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4842(234 mod 256): MAPREAD 0x3c000 thru 0x3c3ff (0x400 bytes) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4843(235 mod 256): PUNCH 0x66f8f thru 0x68a04 (0x1a76 bytes) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4844(236 mod 256): READ 0x5f000 thru 0x5ffff (0x1000 bytes) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4845(237 mod 256): MAPWRITE 0x6d000 thru 0x6dcf8 (0xcf9 bytes) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4846(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4847(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4848(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4849(241 mod 256): MAPWRITE 0x5f000 thru 0x5f0bd (0xbe bytes) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4850(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4851(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4852(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: +4853(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4854(246 mod 256): MAPWRITE 0x24000 thru 0x2515e (0x115f bytes) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4855(247 mod 256): MAPWRITE 0x35000 thru 0x3650c (0x150d bytes) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4856(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4857(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4858(250 mod 256): READ 0x71000 thru 0x71fff (0x1000 bytes) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4859(251 mod 256): TRUNCATE DOWN from 0x753d9 to 0x32000 ******WWWW 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4860(252 mod 256): PUNCH 0xe603 thru 0xec32 (0x630 bytes) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4861(253 mod 256): COPY 0x1e000 thru 0x1efff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4862(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4863(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4864( 0 mod 256): TRUNCATE UP from 0x32000 to 0x51000 ******WWWW 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4865( 1 mod 256): MAPWRITE 0x62000 thru 0x62f6e (0xf6f bytes) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4866( 2 mod 256): MAPWRITE 0x51000 thru 0x51e39 (0xe3a bytes) 2024-03-26T07:41:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: +4867( 3 mod 256): TRUNCATE DOWN from 0x62f6f to 0x4f000 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4868( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4869( 5 mod 256): MAPREAD 0x4000 thru 0x47d0 (0x7d1 bytes) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4870( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4871( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4872( 8 mod 256): MAPWRITE 0x62000 thru 0x63f69 (0x1f6a bytes) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4873( 9 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4874( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4875( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4876( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4877( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4878( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4879( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4880( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4881( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: +4882( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4883( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4884( 20 mod 256): TRUNCATE DOWN from 0x63f6a to 0x18000 ******WWWW 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4885( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4886( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4887( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4888( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4889( 25 mod 256): MAPREAD 0x5000 thru 0x5548 (0x549 bytes) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4890( 26 mod 256): TRUNCATE DOWN from 0x18000 to 0x8000 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4891( 27 mod 256): TRUNCATE UP from 0x8000 to 0x4b000 ******WWWW 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4892( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4893( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4894( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4895( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: +4896( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4897( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4898( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4899( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4900( 36 mod 256): MAPREAD 0x13000 thru 0x13d7f (0xd80 bytes) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4901( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4902( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4903( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4904( 40 mod 256): PUNCH 0x3f2b0 thru 0x404f8 (0x1249 bytes) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4905( 41 mod 256): PUNCH 0x2a1b3 thru 0x2b2bd (0x110b bytes) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4906( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4907( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4908( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4909( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: +4910( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4911( 47 mod 256): PUNCH 0x32a59 thru 0x32dd3 (0x37b bytes) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4912( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4913( 49 mod 256): PUNCH 0x41a25 thru 0x42cfa (0x12d6 bytes) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4914( 50 mod 256): MAPREAD 0x11000 thru 0x12787 (0x1788 bytes) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4915( 51 mod 256): MAPWRITE 0x63000 thru 0x64897 (0x1898 bytes) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4916( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4917( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4918( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4919( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4920( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4921( 57 mod 256): MAPREAD 0x2d000 thru 0x2dcbd (0xcbe bytes) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4922( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4923( 59 mod 256): MAPREAD 0x61000 thru 0x627d0 (0x17d1 bytes) 2024-03-26T07:41:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: +4924( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4925( 61 mod 256): READ 0x23000 thru 0x23fff (0x1000 bytes) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4926( 62 mod 256): TRUNCATE DOWN from 0x64898 to 0x5d000 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4927( 63 mod 256): READ 0x0 thru 0xfff (0x1000 bytes) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4928( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4929( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4930( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4931( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4932( 68 mod 256): MAPREAD 0x36000 thru 0x36e71 (0xe72 bytes) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4933( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4934( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4935( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4936( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: +4937( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4938( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4939( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4940( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4941( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4942( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4943( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4944( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4945( 81 mod 256): MAPWRITE 0x44000 thru 0x45cde (0x1cdf bytes) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4946( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4947( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4948( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4949( 85 mod 256): MAPREAD 0x2b000 thru 0x2bcff (0xd00 bytes) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4950( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: +4951( 87 mod 256): READ 0x49000 thru 0x49fff (0x1000 bytes) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4952( 88 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x1b000 thru 0x1bfff 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4953( 89 mod 256): TRUNCATE UP from 0x5d000 to 0x74000 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4954( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4955( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4956( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4957( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4958( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4959( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4960( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4961( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4962( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4963( 99 mod 256): WRITE 0x52000 thru 0x52fff (0x1000 bytes) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4964(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: +4965(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4966(102 mod 256): PUNCH 0x22c6d thru 0x23890 (0xc24 bytes) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4967(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4968(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4969(105 mod 256): MAPWRITE 0x0 thru 0x1875 (0x1876 bytes) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4970(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4971(107 mod 256): TRUNCATE DOWN from 0x74000 to 0x47000 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4972(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4973(109 mod 256): WRITE 0x19000 thru 0x19fff (0x1000 bytes) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4974(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4975(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4976(112 mod 256): MAPREAD 0x25000 thru 0x26091 (0x1092 bytes) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4977(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4978(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4979(115 mod 256): MAPREAD 0x1a000 thru 0x1b4d3 (0x14d4 bytes) 2024-03-26T07:41:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: +4980(116 mod 256): PUNCH 0x28a7d thru 0x298fc (0xe80 bytes) 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4981(117 mod 256): TRUNCATE DOWN from 0x47000 to 0xe000 ******WWWW 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4982(118 mod 256): TRUNCATE UP from 0xe000 to 0x4e000 ******WWWW 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4983(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4984(120 mod 256): COPY 0x4a000 thru 0x4afff (0x1000 bytes) to 0x1f000 thru 0x1ffff 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4985(121 mod 256): PUNCH 0xd517 thru 0xdd9b (0x885 bytes) 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4986(122 mod 256): MAPWRITE 0x1a000 thru 0x1a3d4 (0x3d5 bytes) 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4987(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4988(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4989(125 mod 256): READ 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4990(126 mod 256): TRUNCATE UP from 0x4e000 to 0x4e000 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4991(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4992(128 mod 256): TRUNCATE DOWN from 0x4e000 to 0x15000 ******WWWW 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4993(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: +4994(130 mod 256): MAPREAD 0x7000 thru 0x7fb3 (0xfb4 bytes) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +4995(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +4996(132 mod 256): READ 0x13000 thru 0x13fff (0x1000 bytes) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +4997(133 mod 256): MAPWRITE 0x3c000 thru 0x3c0f6 (0xf7 bytes) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +4998(134 mod 256): MAPREAD 0x11000 thru 0x1110c (0x10d bytes) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +4999(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +5000(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +5001(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +5002(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +5003(139 mod 256): TRUNCATE DOWN from 0x3c0f7 to 0x1f000 ******WWWW 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +5004(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +5005(141 mod 256): MAPWRITE 0x54000 thru 0x55cda (0x1cdb bytes) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +5006(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +5007(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: +5008(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5009(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5010(146 mod 256): TRUNCATE DOWN from 0x55cdb to 0x6000 ******WWWW 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5011(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5012(148 mod 256): PUNCH 0x46a4 thru 0x5fff (0x195c bytes) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5013(149 mod 256): TRUNCATE UP from 0x6000 to 0x6000 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5014(150 mod 256): READ 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5015(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5016(152 mod 256): TRUNCATE UP from 0x6000 to 0x44000 ******WWWW 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5017(153 mod 256): TRUNCATE DOWN from 0x44000 to 0x29000 ******WWWW 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5018(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5019(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5020(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5021(157 mod 256): WRITE 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-26T07:41:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: +5022(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5023(159 mod 256): PUNCH 0x1d137 thru 0x1e932 (0x17fc bytes) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5024(160 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5025(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5026(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5027(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5028(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5029(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5030(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5031(167 mod 256): PUNCH 0x225ae thru 0x2422c (0x1c7f bytes) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5032(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5033(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5034(170 mod 256): READ 0x3000 thru 0x3fff (0x1000 bytes) 2024-03-26T07:41:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: +5035(171 mod 256): WRITE 0x3e000 thru 0x3efff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5036(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5037(173 mod 256): PUNCH 0x1944d thru 0x1a71e (0x12d2 bytes) 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5038(174 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x40000 thru 0x40fff 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5039(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5040(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5041(177 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5042(178 mod 256): WRITE 0x78000 thru 0x78fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5043(179 mod 256): TRUNCATE DOWN from 0x79000 to 0x29000 ******WWWW 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5044(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5045(181 mod 256): PUNCH 0x169fd thru 0x16f4b (0x54f bytes) 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5046(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5047(183 mod 256): COPY 0x1a000 thru 0x1afff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5048(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: +5049(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5050(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5051(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5052(188 mod 256): WRITE 0x32000 thru 0x32fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5053(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5054(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5055(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5056(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5057(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5058(194 mod 256): COPY 0x16000 thru 0x16fff (0x1000 bytes) to 0x6e000 thru 0x6efff 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5059(195 mod 256): MAPREAD 0x4a000 thru 0x4b92c (0x192d bytes) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5060(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5061(197 mod 256): READ 0x58000 thru 0x58fff (0x1000 bytes) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5062(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: +5063(199 mod 256): MAPWRITE 0x71000 thru 0x71305 (0x306 bytes) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5064(200 mod 256): MAPREAD 0x69000 thru 0x6a8e5 (0x18e6 bytes) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5065(201 mod 256): MAPWRITE 0x5a000 thru 0x5a543 (0x544 bytes) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5066(202 mod 256): READ 0xc000 thru 0xcfff (0x1000 bytes) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5067(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5068(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5069(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5070(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5071(207 mod 256): PUNCH 0x87f9 thru 0x96f2 (0xefa bytes) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5072(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5073(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5074(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5075(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5076(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: +5077(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5078(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5079(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5080(216 mod 256): TRUNCATE DOWN from 0x71306 to 0x65000 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5081(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5082(218 mod 256): MAPWRITE 0x3000 thru 0x499c (0x199d bytes) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5083(219 mod 256): TRUNCATE DOWN from 0x65000 to 0x4000 ******WWWW 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5084(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5085(221 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5086(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5087(223 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5088(224 mod 256): PUNCH 0x39f5e thru 0x3afa0 (0x1043 bytes) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5089(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: +5090(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5091(227 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5092(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5093(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5094(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5095(231 mod 256): MAPREAD 0x1000 thru 0x21fe (0x11ff bytes) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5096(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5097(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5098(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5099(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5100(236 mod 256): PUNCH 0x66bd4 thru 0x670da (0x507 bytes) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5101(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5102(238 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5103(239 mod 256): PUNCH 0x62c57 thru 0x63822 (0xbcc bytes) 2024-03-26T07:41:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: +5104(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5105(241 mod 256): MAPREAD 0x32000 thru 0x32c88 (0xc89 bytes) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5106(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5107(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5108(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5109(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5110(246 mod 256): PUNCH 0x24fc2 thru 0x252e1 (0x320 bytes) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5111(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5112(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5113(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5114(250 mod 256): MAPREAD 0x42000 thru 0x42dda (0xddb bytes) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5115(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5116(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: +5117(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5118(254 mod 256): MAPREAD 0xf000 thru 0x1044c (0x144d bytes) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5119(255 mod 256): MAPWRITE 0x26000 thru 0x278e5 (0x18e6 bytes) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5120( 0 mod 256): PUNCH 0x3e677 thru 0x3ee70 (0x7fa bytes) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5121( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5122( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5123( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5124( 4 mod 256): WRITE 0x43000 thru 0x43fff (0x1000 bytes) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5125( 5 mod 256): MAPREAD 0x37000 thru 0x38e5b (0x1e5c bytes) ***RRRR*** 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5126( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5127( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5128( 8 mod 256): MAPWRITE 0xd000 thru 0xe531 (0x1532 bytes) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5129( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: +5130( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5131( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5132( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5133( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5134( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5135( 15 mod 256): READ 0x6c000 thru 0x6cfff (0x1000 bytes) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5136( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5137( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5138( 18 mod 256): READ 0x75000 thru 0x75fff (0x1000 bytes) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5139( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5140( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5141( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5142( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5143( 23 mod 256): MAPWRITE 0x4000 thru 0x503b (0x103c bytes) 2024-03-26T07:41:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: +5144( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5145( 25 mod 256): MAPREAD 0x27000 thru 0x288a8 (0x18a9 bytes) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5146( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5147( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5148( 28 mod 256): MAPWRITE 0x6e000 thru 0x6e9d5 (0x9d6 bytes) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5149( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5150( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5151( 31 mod 256): COPY 0x4e000 thru 0x4efff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5152( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5153( 33 mod 256): PUNCH 0x4b615 thru 0x4b6e2 (0xce bytes) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5154( 34 mod 256): PUNCH 0x1221e thru 0x13c63 (0x1a46 bytes) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5155( 35 mod 256): TRUNCATE DOWN from 0x77000 to 0xe000 ******WWWW 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5156( 36 mod 256): WRITE 0x12000 thru 0x12fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5157( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: +5158( 38 mod 256): PUNCH 0xdae0 thru 0xdb1f (0x40 bytes) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5159( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5160( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5161( 41 mod 256): MAPREAD 0x4000 thru 0x4f69 (0xf6a bytes) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5162( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5163( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5164( 44 mod 256): TRUNCATE UP from 0x13000 to 0x2f000 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5165( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5166( 46 mod 256): MAPREAD 0x24000 thru 0x25313 (0x1314 bytes) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5167( 47 mod 256): MAPREAD 0x23000 thru 0x23775 (0x776 bytes) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5168( 48 mod 256): PUNCH 0x17791 thru 0x19336 (0x1ba6 bytes) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5169( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5170( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5171( 51 mod 256): PUNCH 0x2d459 thru 0x2d4cd (0x75 bytes) 2024-03-26T07:41:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: +5172( 52 mod 256): MAPWRITE 0x3a000 thru 0x3acda (0xcdb bytes) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5173( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5174( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5175( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5176( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5177( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5178( 58 mod 256): MAPWRITE 0x6b000 thru 0x6bc72 (0xc73 bytes) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5179( 59 mod 256): MAPREAD 0x17000 thru 0x18d4e (0x1d4f bytes) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5180( 60 mod 256): WRITE 0x55000 thru 0x55fff (0x1000 bytes) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5181( 61 mod 256): MAPWRITE 0x1a000 thru 0x1b88c (0x188d bytes) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5182( 62 mod 256): READ 0x42000 thru 0x42fff (0x1000 bytes) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5183( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5184( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5185( 65 mod 256): PUNCH 0x288f6 thru 0x2a2cc (0x19d7 bytes) 2024-03-26T07:41:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: +5186( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5187( 67 mod 256): TRUNCATE DOWN from 0x6bc73 to 0x4c000 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5188( 68 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x3000 thru 0x3fff 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5189( 69 mod 256): READ 0x1a000 thru 0x1afff (0x1000 bytes) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5190( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5191( 71 mod 256): PUNCH 0x352a8 thru 0x36b57 (0x18b0 bytes) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5192( 72 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5193( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5194( 74 mod 256): WRITE 0x27000 thru 0x27fff (0x1000 bytes) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5195( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5196( 76 mod 256): TRUNCATE DOWN from 0x4c000 to 0x38000 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5197( 77 mod 256): TRUNCATE UP from 0x38000 to 0x5d000 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5198( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5199( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: +5200( 80 mod 256): TRUNCATE DOWN from 0x5d000 to 0x21000 ******WWWW 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5201( 81 mod 256): MAPWRITE 0x12000 thru 0x1233b (0x33c bytes) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5202( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5203( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5204( 84 mod 256): TRUNCATE UP from 0x21000 to 0x4e000 ******WWWW 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5205( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5206( 86 mod 256): MAPREAD 0x1000 thru 0x1b18 (0xb19 bytes) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5207( 87 mod 256): MAPWRITE 0x6f000 thru 0x6f7cf (0x7d0 bytes) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5208( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5209( 89 mod 256): TRUNCATE DOWN from 0x6f7d0 to 0x2f000 ******WWWW 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5210( 90 mod 256): TRUNCATE UP from 0x2f000 to 0x4c000 ******WWWW 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5211( 91 mod 256): MAPWRITE 0xa000 thru 0xb65c (0x165d bytes) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5212( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5213( 93 mod 256): MAPREAD 0x38000 thru 0x380d1 (0xd2 bytes) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5214( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: +5215( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5216( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5217( 97 mod 256): PUNCH 0x2861c thru 0x28f35 (0x91a bytes) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5218( 98 mod 256): MAPREAD 0x31000 thru 0x32796 (0x1797 bytes) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5219( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5220(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5221(101 mod 256): MAPWRITE 0x73000 thru 0x739e9 (0x9ea bytes) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5222(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5223(103 mod 256): MAPREAD 0x6000 thru 0x7628 (0x1629 bytes) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5224(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5225(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5226(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5227(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: +5228(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5229(109 mod 256): TRUNCATE DOWN from 0x739ea to 0x22000 ******WWWW 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5230(110 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5231(111 mod 256): COPY 0x2000 thru 0x2fff (0x1000 bytes) to 0x3f000 thru 0x3ffff 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5232(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5233(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5234(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5235(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5236(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5237(117 mod 256): MAPREAD 0x2f000 thru 0x2f286 (0x287 bytes) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5238(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5239(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5240(120 mod 256): TRUNCATE UP from 0x40000 to 0x6c000 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5241(121 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-26T07:41:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: +5242(122 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x72000 thru 0x72fff 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5243(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5244(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5245(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5246(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5247(127 mod 256): COPY 0x2c000 thru 0x2cfff (0x1000 bytes) to 0x3000 thru 0x3fff 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5248(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5249(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5250(130 mod 256): MAPWRITE 0x6a000 thru 0x6ad72 (0xd73 bytes) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5251(131 mod 256): PUNCH 0x5a012 thru 0x5af4d (0xf3c bytes) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5252(132 mod 256): READ 0x4e000 thru 0x4efff (0x1000 bytes) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5253(133 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5254(134 mod 256): TRUNCATE UP from 0x73000 to 0x77000 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5255(135 mod 256): COPY 0x3b000 thru 0x3bfff (0x1000 bytes) to 0x12000 thru 0x12fff 2024-03-26T07:41:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: +5256(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5257(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5258(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5259(139 mod 256): PUNCH 0x608bf thru 0x6189f (0xfe1 bytes) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5260(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5261(141 mod 256): MAPWRITE 0x1f000 thru 0x1fc56 (0xc57 bytes) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5262(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5263(143 mod 256): PUNCH 0x37b72 thru 0x38562 (0x9f1 bytes) ******PPPP 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5264(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5265(145 mod 256): PUNCH 0x2ddfa thru 0x2f9af (0x1bb6 bytes) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5266(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5267(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5268(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5269(149 mod 256): MAPWRITE 0x79000 thru 0x792d0 (0x2d1 bytes) 2024-03-26T07:41:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: +5270(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5271(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5272(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5273(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5274(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5275(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5276(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5277(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5278(158 mod 256): READ 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5279(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: +5280(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5281(161 mod 256): MAPWRITE 0x17000 thru 0x187ae (0x17af bytes) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5282(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5283(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5284(164 mod 256): TRUNCATE DOWN from 0x792d1 to 0x4c000 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5285(165 mod 256): MAPREAD 0x47000 thru 0x48f8f (0x1f90 bytes) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5286(166 mod 256): READ 0x1e000 thru 0x1efff (0x1000 bytes) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5287(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5288(168 mod 256): TRUNCATE DOWN from 0x4c000 to 0x16000 ******WWWW 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5289(169 mod 256): COPY 0xc000 thru 0xcfff (0x1000 bytes) to 0x76000 thru 0x76fff 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5290(170 mod 256): MAPWRITE 0x31000 thru 0x31815 (0x816 bytes) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5291(171 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x4a000 thru 0x4afff 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5292(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5293(173 mod 256): MAPWRITE 0x1d000 thru 0x1d1f0 (0x1f1 bytes) 2024-03-26T07:41:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: +5294(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5295(175 mod 256): PUNCH 0x46844 thru 0x4808e (0x184b bytes) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5296(176 mod 256): TRUNCATE DOWN from 0x77000 to 0x5c000 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5297(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5298(178 mod 256): MAPWRITE 0x7000 thru 0x83e9 (0x13ea bytes) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5299(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5300(180 mod 256): MAPWRITE 0x64000 thru 0x646a1 (0x6a2 bytes) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5301(181 mod 256): PUNCH 0x4cf47 thru 0x4d9a2 (0xa5c bytes) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5302(182 mod 256): PUNCH 0x56d73 thru 0x57f37 (0x11c5 bytes) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5303(183 mod 256): MAPWRITE 0x3000 thru 0x3dca (0xdcb bytes) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5304(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5305(185 mod 256): PUNCH 0x21b3f thru 0x22c97 (0x1159 bytes) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5306(186 mod 256): PUNCH 0x58d94 thru 0x5a4c4 (0x1731 bytes) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5307(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: +5308(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5309(189 mod 256): PUNCH 0x5e924 thru 0x603b0 (0x1a8d bytes) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5310(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5311(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5312(192 mod 256): TRUNCATE UP from 0x646a2 to 0x74000 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5313(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5314(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5315(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5316(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5317(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5318(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5319(199 mod 256): MAPWRITE 0x20000 thru 0x216ab (0x16ac bytes) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5320(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: +5321(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5322(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5323(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5324(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5325(205 mod 256): MAPREAD 0x26000 thru 0x266c6 (0x6c7 bytes) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5326(206 mod 256): COPY 0x11000 thru 0x11fff (0x1000 bytes) to 0x3e000 thru 0x3efff 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5327(207 mod 256): MAPREAD 0x52000 thru 0x53ccd (0x1cce bytes) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5328(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5329(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5330(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5331(211 mod 256): TRUNCATE DOWN from 0x74000 to 0x7000 ******WWWW 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5332(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5333(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5334(214 mod 256): MAPREAD 0x2000 thru 0x3ced (0x1cee bytes) 2024-03-26T07:41:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: +5335(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5336(216 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5337(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5338(218 mod 256): PUNCH 0x5777 thru 0x621e (0xaa8 bytes) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5339(219 mod 256): TRUNCATE UP from 0x7000 to 0x2f000 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5340(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5341(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5342(222 mod 256): MAPREAD 0x28000 thru 0x28861 (0x862 bytes) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5343(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5344(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5345(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5346(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5347(227 mod 256): WRITE 0x3a000 thru 0x3afff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5348(228 mod 256): MAPREAD 0x19000 thru 0x1a1fd (0x11fe bytes) 2024-03-26T07:41:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: +5349(229 mod 256): READ 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5350(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5351(231 mod 256): MAPWRITE 0x3e000 thru 0x3fa49 (0x1a4a bytes) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5352(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5353(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5354(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5355(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5356(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5357(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5358(238 mod 256): PUNCH 0x3dbf6 thru 0x3fa49 (0x1e54 bytes) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5359(239 mod 256): WRITE 0x3a000 thru 0x3afff (0x1000 bytes) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5360(240 mod 256): MAPWRITE 0x10000 thru 0x10901 (0x902 bytes) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5361(241 mod 256): TRUNCATE DOWN from 0x3fa4a to 0xa000 ******WWWW 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5362(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: +5363(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5364(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5365(245 mod 256): TRUNCATE UP from 0xa000 to 0x62000 ******WWWW 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5366(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5367(247 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5368(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5369(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5370(250 mod 256): MAPREAD 0x5a000 thru 0x5be1f (0x1e20 bytes) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5371(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5372(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5373(253 mod 256): MAPWRITE 0x71000 thru 0x7202e (0x102f bytes) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5374(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5375(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: +5376( 0 mod 256): COPY 0x33000 thru 0x33fff (0x1000 bytes) to 0x2e000 thru 0x2efff 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5377( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5378( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5379( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5380( 4 mod 256): MAPREAD 0x58000 thru 0x59ee5 (0x1ee6 bytes) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5381( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5382( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5383( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5384( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5385( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5386( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5387( 11 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0xf000 thru 0xffff 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5388( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5389( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: +5390( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5391( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5392( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5393( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5394( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5395( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5396( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5397( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5398( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5399( 23 mod 256): WRITE 0x60000 thru 0x60fff (0x1000 bytes) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5400( 24 mod 256): MAPWRITE 0xb000 thru 0xb693 (0x694 bytes) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5401( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5402( 26 mod 256): WRITE 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5403( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5404( 28 mod 256): PUNCH 0x2aa41 thru 0x2b0c4 (0x684 bytes) 2024-03-26T07:41:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: +5405( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5406( 30 mod 256): PUNCH 0x189d thru 0x2052 (0x7b6 bytes) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5407( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5408( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5409( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5410( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5411( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5412( 36 mod 256): MAPREAD 0x4a000 thru 0x4b23b (0x123c bytes) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5413( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5414( 38 mod 256): PUNCH 0x61d24 thru 0x63571 (0x184e bytes) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5415( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5416( 40 mod 256): MAPWRITE 0x10000 thru 0x10093 (0x94 bytes) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5417( 41 mod 256): WRITE 0x6d000 thru 0x6dfff (0x1000 bytes) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5418( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: +5419( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5420( 44 mod 256): COPY 0x51000 thru 0x51fff (0x1000 bytes) to 0x41000 thru 0x41fff 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5421( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5422( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5423( 47 mod 256): TRUNCATE DOWN from 0x7202f to 0x42000 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5424( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5425( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5426( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5427( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5428( 52 mod 256): TRUNCATE DOWN from 0x42000 to 0x3f000 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5429( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5430( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5431( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5432( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: +5433( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5434( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5435( 59 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5436( 60 mod 256): MAPWRITE 0x50000 thru 0x50922 (0x923 bytes) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5437( 61 mod 256): MAPWRITE 0x3a000 thru 0x3bded (0x1dee bytes) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5438( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5439( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5440( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5441( 65 mod 256): MAPREAD 0x14000 thru 0x143f7 (0x3f8 bytes) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5442( 66 mod 256): READ 0x12000 thru 0x12fff (0x1000 bytes) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5443( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5444( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5445( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5446( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: +5447( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5448( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5449( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5450( 74 mod 256): TRUNCATE DOWN from 0x50923 to 0x1000 ******WWWW 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5451( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5452( 76 mod 256): MAPWRITE 0x2f000 thru 0x300d9 (0x10da bytes) 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5453( 77 mod 256): MAPWRITE 0x41000 thru 0x41e66 (0xe67 bytes) 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5454( 78 mod 256): TRUNCATE DOWN from 0x41e67 to 0x38000 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5455( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5456( 80 mod 256): WRITE 0x66000 thru 0x66fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5457( 81 mod 256): MAPWRITE 0x6e000 thru 0x6fa15 (0x1a16 bytes) 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5458( 82 mod 256): COPY 0x32000 thru 0x32fff (0x1000 bytes) to 0x2c000 thru 0x2cfff 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5459( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: +5460( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5461( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5462( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5463( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5464( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5465( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5466( 90 mod 256): PUNCH 0x3df37 thru 0x3effe (0x10c8 bytes) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5467( 91 mod 256): WRITE 0x39000 thru 0x39fff (0x1000 bytes) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5468( 92 mod 256): TRUNCATE DOWN from 0x6fa16 to 0x3b000 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5469( 93 mod 256): COPY 0x25000 thru 0x25fff (0x1000 bytes) to 0x5000 thru 0x5fff 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5470( 94 mod 256): PUNCH 0x39f5c thru 0x3a84d (0x8f2 bytes) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5471( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5472( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5473( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5474( 98 mod 256): COPY 0x23000 thru 0x23fff (0x1000 bytes) to 0x14000 thru 0x14fff 2024-03-26T07:41:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: +5475( 99 mod 256): MAPWRITE 0x1e000 thru 0x1fcab (0x1cac bytes) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5476(100 mod 256): PUNCH 0x34330 thru 0x34af7 (0x7c8 bytes) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5477(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5478(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5479(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5480(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5481(105 mod 256): MAPREAD 0x19000 thru 0x1abe1 (0x1be2 bytes) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5482(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5483(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5484(108 mod 256): COPY 0x24000 thru 0x24fff (0x1000 bytes) to 0x6c000 thru 0x6cfff 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5485(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5486(110 mod 256): PUNCH 0x381b2 thru 0x3976b (0x15ba bytes) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5487(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5488(112 mod 256): TRUNCATE DOWN from 0x6d000 to 0x16000 ******WWWW 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5489(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: +5490(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5491(115 mod 256): MAPWRITE 0xe000 thru 0xf67c (0x167d bytes) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5492(116 mod 256): READ 0xf000 thru 0xffff (0x1000 bytes) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5493(117 mod 256): MAPWRITE 0x6a000 thru 0x6ad44 (0xd45 bytes) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5494(118 mod 256): COPY 0x3e000 thru 0x3efff (0x1000 bytes) to 0x70000 thru 0x70fff 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5495(119 mod 256): MAPREAD 0x30000 thru 0x31b11 (0x1b12 bytes) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5496(120 mod 256): MAPWRITE 0x6d000 thru 0x6ed98 (0x1d99 bytes) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5497(121 mod 256): COPY 0x3b000 thru 0x3bfff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5498(122 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x44000 thru 0x44fff 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5499(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5500(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5501(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5502(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: +5503(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5504(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5505(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5506(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5507(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5508(132 mod 256): MAPREAD 0xa000 thru 0xa58a (0x58b bytes) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5509(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5510(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5511(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5512(136 mod 256): PUNCH 0x6e98d thru 0x70890 (0x1f04 bytes) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5513(137 mod 256): TRUNCATE DOWN from 0x71000 to 0x25000 ******WWWW 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5514(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5515(139 mod 256): COPY 0x1f000 thru 0x1ffff (0x1000 bytes) to 0x1000 thru 0x1fff 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5516(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: +5517(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5518(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5519(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5520(144 mod 256): TRUNCATE UP from 0x25000 to 0x57000 ******WWWW 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5521(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5522(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5523(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5524(148 mod 256): TRUNCATE UP from 0x57000 to 0x6e000 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5525(149 mod 256): PUNCH 0xd9b9 thru 0xea7d (0x10c5 bytes) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5526(150 mod 256): TRUNCATE DOWN from 0x6e000 to 0x54000 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5527(151 mod 256): MAPWRITE 0x23000 thru 0x24b78 (0x1b79 bytes) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5528(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5529(153 mod 256): TRUNCATE UP from 0x54000 to 0x67000 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5530(154 mod 256): PUNCH 0x53484 thru 0x55037 (0x1bb4 bytes) 2024-03-26T07:41:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: +5531(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5532(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5533(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5534(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5535(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5536(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5537(161 mod 256): MAPREAD 0x2e000 thru 0x2e49a (0x49b bytes) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5538(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5539(163 mod 256): WRITE 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5540(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5541(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5542(166 mod 256): TRUNCATE UP from 0x67000 to 0x71000 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5543(167 mod 256): MAPREAD 0x38000 thru 0x38ad1 (0xad2 bytes) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5544(168 mod 256): PUNCH 0x1f70d thru 0x213e1 (0x1cd5 bytes) 2024-03-26T07:41:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: +5545(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5546(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5547(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5548(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5549(173 mod 256): PUNCH 0x3405 thru 0x49e9 (0x15e5 bytes) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5550(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5551(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5552(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5553(177 mod 256): READ 0x50000 thru 0x50fff (0x1000 bytes) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5554(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5555(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5556(180 mod 256): MAPWRITE 0x74000 thru 0x75d8d (0x1d8e bytes) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5557(181 mod 256): READ 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5558(182 mod 256): MAPREAD 0x23000 thru 0x24604 (0x1605 bytes) 2024-03-26T07:41:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: +5559(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5560(184 mod 256): WRITE 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5561(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5562(186 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5563(187 mod 256): PUNCH 0x623d thru 0x6362 (0x126 bytes) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5564(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5565(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5566(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5567(191 mod 256): COPY 0x59000 thru 0x59fff (0x1000 bytes) to 0x39000 thru 0x39fff 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5568(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5569(193 mod 256): PUNCH 0x144dd thru 0x1530a (0xe2e bytes) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5570(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5571(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5572(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: +5573(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5574(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5575(199 mod 256): WRITE 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5576(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5577(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5578(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5579(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5580(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5581(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5582(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5583(207 mod 256): MAPWRITE 0x16000 thru 0x17edd (0x1ede bytes) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5584(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5585(209 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5586(210 mod 256): MAPREAD 0x2b000 thru 0x2b46a (0x46b bytes) 2024-03-26T07:41:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: +5587(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5588(212 mod 256): WRITE 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5589(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5590(214 mod 256): PUNCH 0x15aa5 thru 0x170f3 (0x164f bytes) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5591(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5592(216 mod 256): TRUNCATE DOWN from 0x75d8e to 0x63000 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5593(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5594(218 mod 256): MAPREAD 0x5f000 thru 0x60d2e (0x1d2f bytes) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5595(219 mod 256): MAPREAD 0x48000 thru 0x49c1a (0x1c1b bytes) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5596(220 mod 256): MAPWRITE 0x28000 thru 0x2871b (0x71c bytes) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5597(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5598(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5599(223 mod 256): TRUNCATE DOWN from 0x63000 to 0x40000 2024-03-26T07:41:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: +5600(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5601(225 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5602(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5603(227 mod 256): MAPREAD 0x25000 thru 0x26bdf (0x1be0 bytes) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5604(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5605(229 mod 256): PUNCH 0x2e43c thru 0x2fa34 (0x15f9 bytes) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5606(230 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x6b000 thru 0x6bfff 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5607(231 mod 256): TRUNCATE DOWN from 0x6c000 to 0x51000 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5608(232 mod 256): MAPREAD 0x21000 thru 0x210eb (0xec bytes) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5609(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5610(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5611(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5612(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: +5613(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5614(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5615(239 mod 256): TRUNCATE DOWN from 0x51000 to 0x2d000 ******WWWW 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5616(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5617(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5618(242 mod 256): MAPREAD 0x11000 thru 0x119ba (0x9bb bytes) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5619(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5620(244 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5621(245 mod 256): PUNCH 0x1c0c7 thru 0x1c5d5 (0x50f bytes) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5622(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5623(247 mod 256): MAPWRITE 0x76000 thru 0x77608 (0x1609 bytes) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5624(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5625(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5626(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: +5627(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5628(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5629(253 mod 256): PUNCH 0x16f1c thru 0x17e5f (0xf44 bytes) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5630(254 mod 256): MAPWRITE 0x1000 thru 0x11ad (0x1ae bytes) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5631(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5632( 0 mod 256): MAPWRITE 0x6f000 thru 0x6fd82 (0xd83 bytes) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5633( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5634( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5635( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5636( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5637( 5 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5638( 6 mod 256): MAPWRITE 0x13000 thru 0x149df (0x19e0 bytes) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5639( 7 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5640( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: +5641( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5642( 10 mod 256): PUNCH 0x4344f thru 0x44776 (0x1328 bytes) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5643( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5644( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5645( 13 mod 256): MAPWRITE 0x35000 thru 0x367e5 (0x17e6 bytes) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5646( 14 mod 256): READ 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5647( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5648( 16 mod 256): TRUNCATE DOWN from 0x77609 to 0x1f000 ******WWWW 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5649( 17 mod 256): MAPWRITE 0x6c000 thru 0x6da1c (0x1a1d bytes) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5650( 18 mod 256): MAPREAD 0x0 thru 0x72f (0x730 bytes) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5651( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5652( 20 mod 256): TRUNCATE DOWN from 0x6da1d to 0x52000 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5653( 21 mod 256): TRUNCATE DOWN from 0x52000 to 0x0 ******WWWW 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5654( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5655( 23 mod 256): TRUNCATE UP from 0x0 to 0x26000 2024-03-26T07:41:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: +5656( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5657( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5658( 26 mod 256): PUNCH 0x192d4 thru 0x19534 (0x261 bytes) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5659( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5660( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5661( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5662( 30 mod 256): MAPWRITE 0x3b000 thru 0x3be49 (0xe4a bytes) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5663( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5664( 32 mod 256): PUNCH 0x435a thru 0x57cc (0x1473 bytes) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5665( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5666( 34 mod 256): MAPREAD 0x10000 thru 0x11aec (0x1aed bytes) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5667( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5668( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: +5669( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5670( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5671( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5672( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5673( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5674( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5675( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5676( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5677( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5678( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5679( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5680( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5681( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5682( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5683( 51 mod 256): MAPWRITE 0x74000 thru 0x751c4 (0x11c5 bytes) 2024-03-26T07:41:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: +5684( 52 mod 256): MAPWRITE 0x64000 thru 0x65119 (0x111a bytes) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5685( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5686( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5687( 55 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5688( 56 mod 256): MAPREAD 0x21000 thru 0x22c70 (0x1c71 bytes) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5689( 57 mod 256): PUNCH 0x27948 thru 0x28a93 (0x114c bytes) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5690( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5691( 59 mod 256): TRUNCATE DOWN from 0x751c5 to 0x20000 ******WWWW 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5692( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5693( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5694( 62 mod 256): MAPREAD 0x1c000 thru 0x1d70d (0x170e bytes) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5695( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5696( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5697( 65 mod 256): MAPWRITE 0x6f000 thru 0x6f0e7 (0xe8 bytes) 2024-03-26T07:41:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: +5698( 66 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5699( 67 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5700( 68 mod 256): COPY 0x1f000 thru 0x1ffff (0x1000 bytes) to 0x5e000 thru 0x5efff 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5701( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5702( 70 mod 256): TRUNCATE DOWN from 0x75000 to 0xf000 ******WWWW 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5703( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5704( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5705( 73 mod 256): PUNCH 0xda14 thru 0xefff (0x15ec bytes) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5706( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5707( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5708( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5709( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5710( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5711( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: +5712( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5713( 81 mod 256): PUNCH 0x70f9 thru 0x7f26 (0xe2e bytes) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5714( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5715( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5716( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5717( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5718( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5719( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5720( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5721( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5722( 90 mod 256): READ 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5723( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5724( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5725( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: +5726( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5727( 95 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5728( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5729( 97 mod 256): TRUNCATE UP from 0xf000 to 0x4b000 ******WWWW 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5730( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5731( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5732(100 mod 256): PUNCH 0x21b50 thru 0x2261d (0xace bytes) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5733(101 mod 256): TRUNCATE UP from 0x4b000 to 0x4f000 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5734(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5735(103 mod 256): TRUNCATE DOWN from 0x4f000 to 0x13000 ******WWWW 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5736(104 mod 256): READ 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5737(105 mod 256): TRUNCATE UP from 0x13000 to 0x67000 ******WWWW 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5738(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5739(107 mod 256): WRITE 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5740(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: +5741(109 mod 256): TRUNCATE DOWN from 0x67000 to 0x1f000 ******WWWW 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5742(110 mod 256): PUNCH 0x1b242 thru 0x1be7f (0xc3e bytes) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5743(111 mod 256): MAPWRITE 0x26000 thru 0x26640 (0x641 bytes) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5744(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5745(113 mod 256): TRUNCATE DOWN from 0x26641 to 0xd000 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5746(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5747(115 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5748(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5749(117 mod 256): MAPREAD 0x4000 thru 0x58e4 (0x18e5 bytes) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5750(118 mod 256): TRUNCATE UP from 0xd000 to 0x60000 ******WWWW 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5751(119 mod 256): READ 0x59000 thru 0x59fff (0x1000 bytes) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5752(120 mod 256): MAPREAD 0x53000 thru 0x538e7 (0x8e8 bytes) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5753(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5754(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: +5755(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5756(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5757(125 mod 256): TRUNCATE UP from 0x60000 to 0x72000 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5758(126 mod 256): TRUNCATE DOWN from 0x72000 to 0x8000 ******WWWW 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5759(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5760(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5761(129 mod 256): MAPREAD 0x3000 thru 0x3ccf (0xcd0 bytes) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5762(130 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5763(131 mod 256): MAPREAD 0x7000 thru 0x77ae (0x7af bytes) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5764(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5765(133 mod 256): TRUNCATE UP from 0x8000 to 0x58000 ******WWWW 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5766(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5767(135 mod 256): MAPREAD 0xa000 thru 0xaa0b (0xa0c bytes) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5768(136 mod 256): MAPREAD 0x29000 thru 0x292fe (0x2ff bytes) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5769(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: +5770(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5771(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5772(140 mod 256): WRITE 0x24000 thru 0x24fff (0x1000 bytes) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5773(141 mod 256): MAPREAD 0x3000 thru 0x3d16 (0xd17 bytes) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5774(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5775(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5776(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5777(145 mod 256): PUNCH 0x40687 thru 0x41668 (0xfe2 bytes) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5778(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5779(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5780(148 mod 256): TRUNCATE DOWN from 0x58000 to 0x36000 ******WWWW 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5781(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5782(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: +5783(151 mod 256): MAPWRITE 0x50000 thru 0x51754 (0x1755 bytes) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5784(152 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5785(153 mod 256): PUNCH 0x1fd13 thru 0x21838 (0x1b26 bytes) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5786(154 mod 256): TRUNCATE DOWN from 0x51755 to 0xf000 ******WWWW 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5787(155 mod 256): WRITE 0x61000 thru 0x61fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5788(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5789(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5790(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5791(159 mod 256): READ 0x33000 thru 0x33fff (0x1000 bytes) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5792(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5793(161 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5794(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5795(163 mod 256): TRUNCATE UP from 0x62000 to 0x74000 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5796(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5797(165 mod 256): MAPWRITE 0x17000 thru 0x170d8 (0xd9 bytes) 2024-03-26T07:41:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: +5798(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5799(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5800(168 mod 256): MAPWRITE 0x1a000 thru 0x1b2ca (0x12cb bytes) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5801(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5802(170 mod 256): WRITE 0x51000 thru 0x51fff (0x1000 bytes) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5803(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5804(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5805(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5806(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5807(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5808(176 mod 256): MAPWRITE 0x8000 thru 0x9cfd (0x1cfe bytes) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5809(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5810(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5811(179 mod 256): PUNCH 0x65c3e thru 0x65d87 (0x14a bytes) 2024-03-26T07:41:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: +5812(180 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5813(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5814(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5815(183 mod 256): MAPREAD 0x2b000 thru 0x2bf4f (0xf50 bytes) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5816(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5817(185 mod 256): MAPWRITE 0x51000 thru 0x52cd2 (0x1cd3 bytes) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5818(186 mod 256): PUNCH 0x6f533 thru 0x6fd5e (0x82c bytes) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5819(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5820(188 mod 256): MAPWRITE 0x4a000 thru 0x4b32a (0x132b bytes) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5821(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5822(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5823(191 mod 256): PUNCH 0x4b824 thru 0x4cb35 (0x1312 bytes) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5824(192 mod 256): COPY 0x56000 thru 0x56fff (0x1000 bytes) to 0x8000 thru 0x8fff 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5825(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5826(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: +5827(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5828(196 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5829(197 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5830(198 mod 256): MAPWRITE 0x2e000 thru 0x2fb1c (0x1b1d bytes) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5831(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5832(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5833(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5834(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5835(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5836(204 mod 256): MAPWRITE 0x74000 thru 0x75765 (0x1766 bytes) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5837(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5838(206 mod 256): WRITE 0x32000 thru 0x32fff (0x1000 bytes) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5839(207 mod 256): WRITE 0x54000 thru 0x54fff (0x1000 bytes) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5840(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: +5841(209 mod 256): WRITE 0x4d000 thru 0x4dfff (0x1000 bytes) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5842(210 mod 256): TRUNCATE DOWN from 0x75766 to 0x20000 ******WWWW 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5843(211 mod 256): READ 0x19000 thru 0x19fff (0x1000 bytes) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5844(212 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5845(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5846(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5847(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5848(216 mod 256): MAPREAD 0x5000 thru 0x5ce2 (0xce3 bytes) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5849(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5850(218 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5851(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5852(220 mod 256): PUNCH 0x7cca thru 0x7e91 (0x1c8 bytes) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5853(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5854(222 mod 256): MAPWRITE 0x59000 thru 0x5a069 (0x106a bytes) 2024-03-26T07:41:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: +5855(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5856(224 mod 256): TRUNCATE DOWN from 0x5a06a to 0x58000 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5857(225 mod 256): TRUNCATE DOWN from 0x58000 to 0x1f000 ******WWWW 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5858(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5859(227 mod 256): TRUNCATE UP from 0x1f000 to 0x77000 ******WWWW 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5860(228 mod 256): COPY 0x72000 thru 0x72fff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5861(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5862(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5863(231 mod 256): TRUNCATE DOWN from 0x77000 to 0x22000 ******WWWW 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5864(232 mod 256): MAPWRITE 0xe000 thru 0xe14c (0x14d bytes) 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5865(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5866(234 mod 256): COPY 0x1b000 thru 0x1bfff (0x1000 bytes) to 0x28000 thru 0x28fff 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5867(235 mod 256): MAPREAD 0x1e000 thru 0x1e840 (0x841 bytes) 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5868(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: +5869(237 mod 256): PUNCH 0x6f6d thru 0x7b62 (0xbf6 bytes) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5870(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5871(239 mod 256): MAPWRITE 0x6d000 thru 0x6eb69 (0x1b6a bytes) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5872(240 mod 256): MAPWRITE 0x48000 thru 0x48475 (0x476 bytes) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5873(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5874(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5875(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5876(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5877(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5878(246 mod 256): READ 0x55000 thru 0x55fff (0x1000 bytes) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5879(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5880(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5881(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5882(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: +5883(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5884(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5885(253 mod 256): MAPWRITE 0x2e000 thru 0x2f955 (0x1956 bytes) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5886(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5887(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5888( 0 mod 256): MAPWRITE 0x74000 thru 0x74a1a (0xa1b bytes) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5889( 1 mod 256): TRUNCATE DOWN from 0x74a1b to 0x4000 ******WWWW 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5890( 2 mod 256): PUNCH 0x2823 thru 0x3fff (0x17dd bytes) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5891( 3 mod 256): PUNCH 0xe24 thru 0x23b6 (0x1593 bytes) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5892( 4 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5893( 5 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5894( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5895( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5896( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: +5897( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5898( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5899( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5900( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5901( 13 mod 256): PUNCH 0x1e13 thru 0x3c3b (0x1e29 bytes) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5902( 14 mod 256): TRUNCATE UP from 0x4000 to 0x34000 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5903( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5904( 16 mod 256): MAPREAD 0x8000 thru 0x9969 (0x196a bytes) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5905( 17 mod 256): PUNCH 0x64ac thru 0x841b (0x1f70 bytes) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5906( 18 mod 256): MAPREAD 0x15000 thru 0x166ab (0x16ac bytes) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5907( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5908( 20 mod 256): PUNCH 0x27705 thru 0x27afb (0x3f7 bytes) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5909( 21 mod 256): PUNCH 0x2fa09 thru 0x309da (0xfd2 bytes) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5910( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: +5911( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5912( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5913( 25 mod 256): TRUNCATE UP from 0x34000 to 0x4f000 ******WWWW 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5914( 26 mod 256): MAPWRITE 0x3a000 thru 0x3ad37 (0xd38 bytes) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5915( 27 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x1f000 thru 0x1ffff 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5916( 28 mod 256): MAPWRITE 0x54000 thru 0x55f97 (0x1f98 bytes) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5917( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5918( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5919( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5920( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5921( 33 mod 256): WRITE 0x55000 thru 0x55fff (0x1000 bytes) EXTEND 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5922( 34 mod 256): TRUNCATE DOWN from 0x56000 to 0x22000 ******WWWW 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5923( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5924( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: +5925( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5926( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5927( 39 mod 256): MAPWRITE 0xc000 thru 0xdd1a (0x1d1b bytes) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5928( 40 mod 256): PUNCH 0x1d5f7 thru 0x1d898 (0x2a2 bytes) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5929( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5930( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5931( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5932( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5933( 45 mod 256): MAPWRITE 0x59000 thru 0x59050 (0x51 bytes) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5934( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5935( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5936( 48 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5937( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: +5938( 50 mod 256): TRUNCATE DOWN from 0x59051 to 0xa000 ******WWWW 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5939( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5940( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5941( 53 mod 256): WRITE 0x25000 thru 0x25fff (0x1000 bytes) HOLE 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5942( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5943( 55 mod 256): MAPREAD 0x8000 thru 0x82e3 (0x2e4 bytes) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5944( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5945( 57 mod 256): PUNCH 0x12ee1 thru 0x138d3 (0x9f3 bytes) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5946( 58 mod 256): READ 0x14000 thru 0x14fff (0x1000 bytes) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5947( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5948( 60 mod 256): PUNCH 0x20685 thru 0x206ba (0x36 bytes) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5949( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5950( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: +5951( 63 mod 256): PUNCH 0x234c4 thru 0x24f39 (0x1a76 bytes) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5952( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5953( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5954( 66 mod 256): MAPREAD 0x9000 thru 0xa632 (0x1633 bytes) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5955( 67 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5956( 68 mod 256): PUNCH 0x7dc4 thru 0x89f4 (0xc31 bytes) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5957( 69 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5958( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5959( 71 mod 256): MAPREAD 0x16000 thru 0x1677f (0x780 bytes) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5960( 72 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5961( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5962( 74 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5963( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5964( 76 mod 256): MAPREAD 0x27000 thru 0x2795f (0x960 bytes) 2024-03-26T07:41:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: +5965( 77 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5966( 78 mod 256): TRUNCATE DOWN from 0x57000 to 0x3a000 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5967( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5968( 80 mod 256): MAPREAD 0x33000 thru 0x34d4b (0x1d4c bytes) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5969( 81 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5970( 82 mod 256): TRUNCATE DOWN from 0x3a000 to 0x34000 ******WWWW 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5971( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5972( 84 mod 256): MAPWRITE 0x4000 thru 0x56d3 (0x16d4 bytes) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5973( 85 mod 256): TRUNCATE UP from 0x34000 to 0x46000 ******WWWW 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5974( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5975( 87 mod 256): MAPREAD 0x24000 thru 0x25ba4 (0x1ba5 bytes) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5976( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5977( 89 mod 256): TRUNCATE DOWN from 0x46000 to 0x2a000 ******WWWW 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5978( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: +5979( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5980( 92 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x15000 thru 0x15fff 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5981( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5982( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5983( 95 mod 256): MAPWRITE 0x4f000 thru 0x4fad3 (0xad4 bytes) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5984( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5985( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5986( 98 mod 256): PUNCH 0x1b816 thru 0x1c9b8 (0x11a3 bytes) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5987( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5988(100 mod 256): MAPWRITE 0x17000 thru 0x18df0 (0x1df1 bytes) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5989(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5990(102 mod 256): PUNCH 0x260e9 thru 0x26c49 (0xb61 bytes) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5991(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5992(104 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-26T07:41:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: +5993(105 mod 256): MAPREAD 0x21000 thru 0x22afe (0x1aff bytes) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +5994(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +5995(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +5996(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +5997(109 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +5998(110 mod 256): PUNCH 0x1f2b0 thru 0x20bb7 (0x1908 bytes) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +5999(111 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +6000(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +6001(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +6002(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +6003(115 mod 256): PUNCH 0x4046 thru 0x5795 (0x1750 bytes) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +6004(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +6005(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +6006(118 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-26T07:41:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: +6007(119 mod 256): MAPWRITE 0x71000 thru 0x71557 (0x558 bytes) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6008(120 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6009(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6010(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6011(123 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6012(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6013(125 mod 256): TRUNCATE DOWN from 0x71558 to 0x61000 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6014(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6015(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6016(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6017(129 mod 256): TRUNCATE UP from 0x61000 to 0x6f000 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6018(130 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x3a000 thru 0x3afff 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6019(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6020(132 mod 256): MAPREAD 0x4000 thru 0x427a (0x27b bytes) 2024-03-26T07:41:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: +6021(133 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6022(134 mod 256): PUNCH 0x297e2 thru 0x2a9f9 (0x1218 bytes) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6023(135 mod 256): MAPWRITE 0x2f000 thru 0x30924 (0x1925 bytes) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6024(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6025(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6026(138 mod 256): MAPREAD 0x3f000 thru 0x409ea (0x19eb bytes) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6027(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6028(140 mod 256): MAPREAD 0x35000 thru 0x36114 (0x1115 bytes) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6029(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6030(142 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5f000 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6031(143 mod 256): MAPWRITE 0x56000 thru 0x575ec (0x15ed bytes) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6032(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6033(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6034(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: +6035(147 mod 256): MAPREAD 0x3e000 thru 0x3efc8 (0xfc9 bytes) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6036(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6037(149 mod 256): COPY 0x56000 thru 0x56fff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6038(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6039(151 mod 256): READ 0x26000 thru 0x26fff (0x1000 bytes) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6040(152 mod 256): WRITE 0x14000 thru 0x14fff (0x1000 bytes) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6041(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6042(154 mod 256): TRUNCATE DOWN from 0x5f000 to 0x55000 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6043(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6044(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6045(157 mod 256): WRITE 0x5a000 thru 0x5afff (0x1000 bytes) HOLE 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6046(158 mod 256): MAPREAD 0x24000 thru 0x244bd (0x4be bytes) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6047(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6048(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: +6049(161 mod 256): COPY 0x19000 thru 0x19fff (0x1000 bytes) to 0x42000 thru 0x42fff 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6050(162 mod 256): READ 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6051(163 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6052(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6053(165 mod 256): COPY 0x49000 thru 0x49fff (0x1000 bytes) to 0x0 thru 0xfff 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6054(166 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6055(167 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6056(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6057(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6058(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6059(171 mod 256): MAPWRITE 0x17000 thru 0x1748d (0x48e bytes) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6060(172 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6061(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: +6062(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6063(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6064(176 mod 256): MAPREAD 0x1c000 thru 0x1ccc5 (0xcc6 bytes) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6065(177 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x40000 thru 0x40fff 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6066(178 mod 256): MAPREAD 0x1b000 thru 0x1b415 (0x416 bytes) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6067(179 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6068(180 mod 256): TRUNCATE DOWN from 0x5b000 to 0x8000 ******WWWW 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6069(181 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6070(182 mod 256): MAPREAD 0x1000 thru 0x1768 (0x769 bytes) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6071(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6072(184 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6073(185 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6074(186 mod 256): PUNCH 0x3501 thru 0x3827 (0x327 bytes) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6075(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6076(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: +6077(189 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x41000 thru 0x41fff 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6078(190 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6079(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6080(192 mod 256): TRUNCATE UP from 0x42000 to 0x54000 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6081(193 mod 256): MAPWRITE 0x53000 thru 0x539c0 (0x9c1 bytes) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6082(194 mod 256): MAPREAD 0x2e000 thru 0x2ec05 (0xc06 bytes) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6083(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6084(196 mod 256): COPY 0x31000 thru 0x31fff (0x1000 bytes) to 0x5e000 thru 0x5efff 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6085(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6086(198 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6087(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6088(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6089(201 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6090(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6091(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: +6092(204 mod 256): MAPWRITE 0x64000 thru 0x654f3 (0x14f4 bytes) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6093(205 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6094(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6095(207 mod 256): PUNCH 0x1336f thru 0x13a4f (0x6e1 bytes) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6096(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6097(209 mod 256): TRUNCATE DOWN from 0x654f4 to 0x4b000 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6098(210 mod 256): READ 0x23000 thru 0x23fff (0x1000 bytes) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6099(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6100(212 mod 256): TRUNCATE DOWN from 0x4b000 to 0x2000 ******WWWW 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6101(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6102(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6103(215 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6104(216 mod 256): PUNCH 0x11d5 thru 0x1fff (0xe2b bytes) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6105(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6106(218 mod 256): MAPREAD 0x1000 thru 0x132c (0x32d bytes) 2024-03-26T07:41:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: +6107(219 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6108(220 mod 256): MAPWRITE 0x3a000 thru 0x3ae4a (0xe4b bytes) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6109(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6110(222 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6111(223 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6112(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6113(225 mod 256): COPY 0x16000 thru 0x16fff (0x1000 bytes) to 0x69000 thru 0x69fff 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6114(226 mod 256): MAPREAD 0x44000 thru 0x445e4 (0x5e5 bytes) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6115(227 mod 256): WRITE 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6116(228 mod 256): MAPWRITE 0x34000 thru 0x34eb3 (0xeb4 bytes) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6117(229 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x54000 thru 0x54fff 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6118(230 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x76000 thru 0x76fff 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6119(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: +6120(232 mod 256): READ 0x17000 thru 0x17fff (0x1000 bytes) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6121(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6122(234 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6123(235 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6124(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6125(237 mod 256): MAPREAD 0xb000 thru 0xbdc4 (0xdc5 bytes) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6126(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6127(239 mod 256): PUNCH 0x18c2a thru 0x1a71c (0x1af3 bytes) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6128(240 mod 256): READ 0x41000 thru 0x41fff (0x1000 bytes) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6129(241 mod 256): PUNCH 0x600e thru 0x70ac (0x109f bytes) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6130(242 mod 256): PUNCH 0x1f97 thru 0x3669 (0x16d3 bytes) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6131(243 mod 256): COPY 0x4f000 thru 0x4ffff (0x1000 bytes) to 0x14000 thru 0x14fff 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6132(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6133(245 mod 256): COPY 0x6b000 thru 0x6bfff (0x1000 bytes) to 0x57000 thru 0x57fff 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6134(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6135(247 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: +6136(248 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6137(249 mod 256): READ 0xa000 thru 0xafff (0x1000 bytes) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6138(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6139(251 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6140(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6141(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6142(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6143(255 mod 256): TRUNCATE DOWN from 0x77000 to 0xc000 ******WWWW 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6144( 0 mod 256): MAPWRITE 0x79000 thru 0x7a05f (0x1060 bytes) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6145( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6146( 2 mod 256): READ 0x1c000 thru 0x1cfff (0x1000 bytes) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6147( 3 mod 256): MAPREAD 0x1a000 thru 0x1a315 (0x316 bytes) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6148( 4 mod 256): TRUNCATE DOWN from 0x7a060 to 0x6b000 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6149( 5 mod 256): READ 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6150( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: +6151( 7 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6152( 8 mod 256): TRUNCATE DOWN from 0x6b000 to 0xd000 ******WWWW 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6153( 9 mod 256): MAPWRITE 0x26000 thru 0x272b7 (0x12b8 bytes) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6154( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6155( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6156( 12 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6157( 13 mod 256): PUNCH 0xf380 thru 0xfa19 (0x69a bytes) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6158( 14 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6159( 15 mod 256): MAPWRITE 0x2e000 thru 0x2e1c2 (0x1c3 bytes) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6160( 16 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6161( 17 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6162( 18 mod 256): WRITE 0x32000 thru 0x32fff (0x1000 bytes) HOLE 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6163( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6164( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: +6165( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6166( 22 mod 256): TRUNCATE UP from 0x33000 to 0x43000 ******WWWW 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6167( 23 mod 256): MAPWRITE 0x1c000 thru 0x1deec (0x1eed bytes) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6168( 24 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6169( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6170( 26 mod 256): MAPREAD 0x16000 thru 0x175a8 (0x15a9 bytes) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6171( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6172( 28 mod 256): MAPREAD 0x3d000 thru 0x3dc9d (0xc9e bytes) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6173( 29 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6174( 30 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x49000 thru 0x49fff 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6175( 31 mod 256): MAPWRITE 0x71000 thru 0x72ee6 (0x1ee7 bytes) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6176( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6177( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: +6178( 34 mod 256): PUNCH 0x56af5 thru 0x57a17 (0xf23 bytes) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6179( 35 mod 256): MAPREAD 0x16000 thru 0x17556 (0x1557 bytes) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6180( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6181( 37 mod 256): PUNCH 0x699f1 thru 0x6a120 (0x730 bytes) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6182( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6183( 39 mod 256): TRUNCATE DOWN from 0x72ee7 to 0x46000 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6184( 40 mod 256): MAPWRITE 0x17000 thru 0x17317 (0x318 bytes) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6185( 41 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6186( 42 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6187( 43 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6188( 44 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6189( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6190( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6191( 47 mod 256): MAPREAD 0x29000 thru 0x29f56 (0xf57 bytes) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6192( 48 mod 256): TRUNCATE DOWN from 0x46000 to 0x14000 ******WWWW 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6193( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: +6194( 50 mod 256): TRUNCATE UP from 0x14000 to 0x46000 ******WWWW 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6195( 51 mod 256): MAPWRITE 0x18000 thru 0x19f51 (0x1f52 bytes) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6196( 52 mod 256): READ 0x21000 thru 0x21fff (0x1000 bytes) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6197( 53 mod 256): PUNCH 0x39c53 thru 0x3a4fb (0x8a9 bytes) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6198( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6199( 55 mod 256): TRUNCATE UP from 0x46000 to 0x5b000 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6200( 56 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6201( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6202( 58 mod 256): PUNCH 0x4349b thru 0x43d95 (0x8fb bytes) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6203( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6204( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6205( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6206( 62 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6207( 63 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6208( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: +6209( 65 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6210( 66 mod 256): COPY 0x3f000 thru 0x3ffff (0x1000 bytes) to 0x1d000 thru 0x1dfff 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6211( 67 mod 256): READ 0x2c000 thru 0x2cfff (0x1000 bytes) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6212( 68 mod 256): TRUNCATE DOWN from 0x5b000 to 0x53000 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6213( 69 mod 256): TRUNCATE DOWN from 0x53000 to 0x51000 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6214( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6215( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6216( 72 mod 256): MAPWRITE 0x79000 thru 0x7994e (0x94f bytes) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6217( 73 mod 256): WRITE 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6218( 74 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6219( 75 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6220( 76 mod 256): MAPREAD 0x41000 thru 0x421de (0x11df bytes) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6221( 77 mod 256): MAPREAD 0x2000 thru 0x3d8b (0x1d8c bytes) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6222( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6223( 79 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: +6224( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6225( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6226( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6227( 83 mod 256): PUNCH 0x49834 thru 0x4b03e (0x180b bytes) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6228( 84 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6229( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6230( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6231( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6232( 88 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6233( 89 mod 256): MAPREAD 0xf000 thru 0xfa46 (0xa47 bytes) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6234( 90 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x6c000 thru 0x6cfff 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6235( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6236( 92 mod 256): READ 0x27000 thru 0x27fff (0x1000 bytes) 2024-03-26T07:41:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: +6237( 93 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6238( 94 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6239( 95 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6240( 96 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6241( 97 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6242( 98 mod 256): MAPREAD 0x3f000 thru 0x4009f (0x10a0 bytes) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6243( 99 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6244(100 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6245(101 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6246(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6247(103 mod 256): TRUNCATE DOWN from 0x7994f to 0x23000 ******WWWW 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6248(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6249(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6250(106 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: +6251(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6252(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6253(109 mod 256): MAPWRITE 0x1e000 thru 0x1f7a1 (0x17a2 bytes) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6254(110 mod 256): TRUNCATE UP from 0x23000 to 0x79000 ******WWWW 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6255(111 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6256(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6257(113 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6258(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6259(115 mod 256): PUNCH 0x26a0c thru 0x27018 (0x60d bytes) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6260(116 mod 256): READ 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6261(117 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6262(118 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6263(119 mod 256): READ 0x6c000 thru 0x6cfff (0x1000 bytes) 2024-03-26T07:41:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: +6264(120 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6265(121 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6266(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6267(123 mod 256): PUNCH 0x469a2 thru 0x474a5 (0xb04 bytes) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6268(124 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6269(125 mod 256): MAPREAD 0x20000 thru 0x21cd5 (0x1cd6 bytes) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6270(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6271(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6272(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6273(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6274(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6275(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6276(132 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6277(133 mod 256): READ 0x71000 thru 0x71fff (0x1000 bytes) 2024-03-26T07:41:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: +6278(134 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6279(135 mod 256): READ 0x67000 thru 0x67fff (0x1000 bytes) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6280(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6281(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6282(138 mod 256): TRUNCATE DOWN from 0x79000 to 0x23000 ******WWWW 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6283(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6284(140 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6285(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6286(142 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6287(143 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6288(144 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6289(145 mod 256): MAPWRITE 0x45000 thru 0x46ff7 (0x1ff8 bytes) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6290(146 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: +6291(147 mod 256): TRUNCATE UP from 0x46ff8 to 0x77000 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6292(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6293(149 mod 256): TRUNCATE DOWN from 0x77000 to 0x26000 ******WWWW 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6294(150 mod 256): PUNCH 0x25cbb thru 0x25fff (0x345 bytes) 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6295(151 mod 256): TRUNCATE DOWN from 0x26000 to 0x1d000 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6296(152 mod 256): TRUNCATE UP from 0x1d000 to 0x5d000 ******WWWW 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6297(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6298(154 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6299(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6300(156 mod 256): READ 0x2e000 thru 0x2efff (0x1000 bytes) 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6301(157 mod 256): WRITE 0x55000 thru 0x55fff (0x1000 bytes) 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6302(158 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6303(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: +6304(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6305(161 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6306(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6307(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6308(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6309(165 mod 256): MAPWRITE 0x26000 thru 0x26c9f (0xca0 bytes) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6310(166 mod 256): COPY 0x28000 thru 0x28fff (0x1000 bytes) to 0x9000 thru 0x9fff 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6311(167 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6312(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6313(169 mod 256): TRUNCATE UP from 0x5d000 to 0x79000 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6314(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6315(171 mod 256): MAPWRITE 0x17000 thru 0x17fb1 (0xfb2 bytes) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6316(172 mod 256): PUNCH 0x38491 thru 0x38e4f (0x9bf bytes) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6317(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: +6318(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6319(175 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6320(176 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6321(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6322(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6323(179 mod 256): TRUNCATE DOWN from 0x79000 to 0x28000 ******WWWW 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6324(180 mod 256): MAPREAD 0x10000 thru 0x1073b (0x73c bytes) 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6325(181 mod 256): WRITE 0x3e000 thru 0x3efff (0x1000 bytes) HOLE ***WWWW 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6326(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6327(183 mod 256): MAPWRITE 0x54000 thru 0x55afe (0x1aff bytes) 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6328(184 mod 256): TRUNCATE DOWN from 0x55aff to 0x2b000 ******WWWW 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6329(185 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x46000 thru 0x46fff 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6330(186 mod 256): TRUNCATE DOWN from 0x47000 to 0x33000 ******WWWW 2024-03-26T07:41:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: +6331(187 mod 256): WRITE 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6332(188 mod 256): MAPWRITE 0x71000 thru 0x72d2d (0x1d2e bytes) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6333(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6334(190 mod 256): MAPREAD 0xb000 thru 0xceda (0x1edb bytes) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6335(191 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6336(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6337(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6338(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6339(195 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6340(196 mod 256): READ 0x50000 thru 0x50fff (0x1000 bytes) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6341(197 mod 256): PUNCH 0x10f45 thru 0x122c8 (0x1384 bytes) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6342(198 mod 256): COPY 0x25000 thru 0x25fff (0x1000 bytes) to 0x4f000 thru 0x4ffff 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6343(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6344(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: +6345(201 mod 256): MAPWRITE 0x4d000 thru 0x4da71 (0xa72 bytes) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6346(202 mod 256): TRUNCATE DOWN from 0x72d2e to 0x14000 ******WWWW 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6347(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6348(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6349(205 mod 256): MAPREAD 0xc000 thru 0xc59f (0x5a0 bytes) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6350(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6351(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6352(208 mod 256): WRITE 0x24000 thru 0x24fff (0x1000 bytes) HOLE 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6353(209 mod 256): WRITE 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6354(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6355(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6356(212 mod 256): TRUNCATE UP from 0x25000 to 0x67000 ******WWWW 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6357(213 mod 256): PUNCH 0x242d thru 0x2eea (0xabe bytes) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6358(214 mod 256): MAPWRITE 0x8000 thru 0x82e6 (0x2e7 bytes) 2024-03-26T07:41:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: +6359(215 mod 256): PUNCH 0x35c40 thru 0x36ba7 (0xf68 bytes) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6360(216 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6361(217 mod 256): MAPREAD 0x21000 thru 0x222cb (0x12cc bytes) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6362(218 mod 256): MAPWRITE 0x7000 thru 0x80e5 (0x10e6 bytes) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6363(219 mod 256): TRUNCATE DOWN from 0x67000 to 0x5f000 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6364(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6365(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6366(222 mod 256): MAPREAD 0x59000 thru 0x59628 (0x629 bytes) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6367(223 mod 256): MAPREAD 0x8000 thru 0x87ad (0x7ae bytes) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6368(224 mod 256): PUNCH 0x2d0d7 thru 0x2da54 (0x97e bytes) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6369(225 mod 256): MAPWRITE 0x16000 thru 0x17ac0 (0x1ac1 bytes) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6370(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6371(227 mod 256): COPY 0x2a000 thru 0x2afff (0x1000 bytes) to 0x7000 thru 0x7fff 2024-03-26T07:41:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: +6372(228 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6373(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6374(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6375(231 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6376(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6377(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6378(234 mod 256): TRUNCATE DOWN from 0x5f000 to 0x3e000 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6379(235 mod 256): MAPWRITE 0x66000 thru 0x67b5f (0x1b60 bytes) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6380(236 mod 256): PUNCH 0x2602f thru 0x27efb (0x1ecd bytes) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6381(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6382(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6383(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6384(240 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6385(241 mod 256): PUNCH 0x1a7ea thru 0x1a8b4 (0xcb bytes) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6386(242 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-26T07:41:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: +6387(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6388(244 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6389(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6390(246 mod 256): MAPREAD 0x2e000 thru 0x2ec4f (0xc50 bytes) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6391(247 mod 256): TRUNCATE DOWN from 0x67b60 to 0x53000 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6392(248 mod 256): TRUNCATE DOWN from 0x53000 to 0x4f000 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6393(249 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6394(250 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6395(251 mod 256): PUNCH 0xa535 thru 0xb5a1 (0x106d bytes) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6396(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6397(253 mod 256): TRUNCATE DOWN from 0x4f000 to 0x22000 ******WWWW 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6398(254 mod 256): PUNCH 0x4f05 thru 0x4f11 (0xd bytes) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6399(255 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6400( 0 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x40000 thru 0x40fff 2024-03-26T07:41:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: +6401( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6402( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6403( 3 mod 256): COPY 0x2e000 thru 0x2efff (0x1000 bytes) to 0x4c000 thru 0x4cfff 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6404( 4 mod 256): MAPREAD 0x2d000 thru 0x2e05f (0x1060 bytes) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6405( 5 mod 256): TRUNCATE UP from 0x4d000 to 0x75000 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6406( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6407( 7 mod 256): MAPWRITE 0x12000 thru 0x12a80 (0xa81 bytes) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6408( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6409( 9 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6410( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6411( 11 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6412( 12 mod 256): PUNCH 0x49c6c thru 0x4afff (0x1394 bytes) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6413( 13 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6414( 14 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6415( 15 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6416( 16 mod 256): WRITE 0x39000 thru 0x39fff (0x1000 bytes) 2024-03-26T07:41:45.023 INFO:teuthology.orchestra.run.smithi063.stdout: +6417( 17 mod 256): PUNCH 0xf5ac thru 0x10eb5 (0x190a bytes) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6418( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6419( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6420( 20 mod 256): MAPWRITE 0x56000 thru 0x57025 (0x1026 bytes) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6421( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6422( 22 mod 256): MAPREAD 0x3d000 thru 0x3df5d (0xf5e bytes) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6423( 23 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6424( 24 mod 256): MAPREAD 0x12000 thru 0x13795 (0x1796 bytes) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6425( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6426( 26 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6427( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6428( 28 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6429( 29 mod 256): PUNCH 0x4b103 thru 0x4b9c4 (0x8c2 bytes) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6430( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6431( 31 mod 256): PUNCH 0x5870 thru 0x6ec0 (0x1651 bytes) 2024-03-26T07:41:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: +6432( 32 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6433( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6434( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6435( 35 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6436( 36 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6437( 37 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6438( 38 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6439( 39 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6440( 40 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6441( 41 mod 256): MAPREAD 0x74000 thru 0x74b9d (0xb9e bytes) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6442( 42 mod 256): WRITE 0x9000 thru 0x9fff (0x1000 bytes) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6443( 43 mod 256): PUNCH 0x669eb thru 0x67140 (0x756 bytes) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6444( 44 mod 256): COPY 0x1a000 thru 0x1afff (0x1000 bytes) to 0x19000 thru 0x19fff 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6445( 45 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.025 INFO:teuthology.orchestra.run.smithi063.stdout: +6446( 46 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6447( 47 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6448( 48 mod 256): TRUNCATE DOWN from 0x75000 to 0x1e000 ******WWWW 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6449( 49 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6450( 50 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6451( 51 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6452( 52 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6453( 53 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6454( 54 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6455( 55 mod 256): PUNCH 0x57b thru 0x1106 (0xb8c bytes) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6456( 56 mod 256): COPY 0x2000 thru 0x2fff (0x1000 bytes) to 0xb000 thru 0xbfff 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6457( 57 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6458( 58 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.026 INFO:teuthology.orchestra.run.smithi063.stdout: +6459( 59 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6460( 60 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6461( 61 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6462( 62 mod 256): MAPWRITE 0x30000 thru 0x30129 (0x12a bytes) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6463( 63 mod 256): PUNCH 0x2c99 thru 0x2fdc (0x344 bytes) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6464( 64 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6465( 65 mod 256): MAPWRITE 0x2e000 thru 0x2ee78 (0xe79 bytes) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6466( 66 mod 256): TRUNCATE DOWN from 0x3012a to 0x6000 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6467( 67 mod 256): COPY 0x3000 thru 0x3fff (0x1000 bytes) to 0x47000 thru 0x47fff 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6468( 68 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6469( 69 mod 256): MAPWRITE 0x20000 thru 0x2020c (0x20d bytes) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6470( 70 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6471( 71 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.027 INFO:teuthology.orchestra.run.smithi063.stdout: +6472( 72 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6473( 73 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6474( 74 mod 256): MAPWRITE 0x69000 thru 0x695ec (0x5ed bytes) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6475( 75 mod 256): MAPWRITE 0x70000 thru 0x70f13 (0xf14 bytes) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6476( 76 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6477( 77 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x4a000 thru 0x4afff 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6478( 78 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6479( 79 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x77000 thru 0x77fff 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6480( 80 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6481( 81 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6482( 82 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6483( 83 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6484( 84 mod 256): PUNCH 0xd34b thru 0xef88 (0x1c3e bytes) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6485( 85 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6486( 86 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6487( 87 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: +6488( 88 mod 256): PUNCH 0x3bb65 thru 0x3d59f (0x1a3b bytes) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6489( 89 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6490( 90 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6491( 91 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6492( 92 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6493( 93 mod 256): WRITE 0x35000 thru 0x35fff (0x1000 bytes) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6494( 94 mod 256): READ 0x68000 thru 0x68fff (0x1000 bytes) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6495( 95 mod 256): PUNCH 0x17f05 thru 0x19e3e (0x1f3a bytes) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6496( 96 mod 256): MAPWRITE 0x2000 thru 0x30d4 (0x10d5 bytes) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6497( 97 mod 256): MAPREAD 0x20000 thru 0x211a5 (0x11a6 bytes) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6498( 98 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6499( 99 mod 256): MAPWRITE 0x66000 thru 0x67745 (0x1746 bytes) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6500(100 mod 256): MAPREAD 0x64000 thru 0x643cc (0x3cd bytes) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6501(101 mod 256): MAPREAD 0x34000 thru 0x35b1a (0x1b1b bytes) 2024-03-26T07:41:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: +6502(102 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6503(103 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6504(104 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6505(105 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6506(106 mod 256): PUNCH 0x643c7 thru 0x6503d (0xc77 bytes) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6507(107 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6508(108 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6509(109 mod 256): MAPREAD 0x2f000 thru 0x30bec (0x1bed bytes) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6510(110 mod 256): MAPWRITE 0x27000 thru 0x27b7e (0xb7f bytes) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6511(111 mod 256): MAPWRITE 0x53000 thru 0x53c57 (0xc58 bytes) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6512(112 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6513(113 mod 256): TRUNCATE DOWN from 0x78000 to 0x52000 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6514(114 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6515(115 mod 256): MAPWRITE 0x8000 thru 0x9809 (0x180a bytes) 2024-03-26T07:41:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: +6516(116 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6517(117 mod 256): PUNCH 0x1d4d6 thru 0x1edae (0x18d9 bytes) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6518(118 mod 256): PUNCH 0x27dcc thru 0x296f7 (0x192c bytes) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6519(119 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6520(120 mod 256): MAPREAD 0x31000 thru 0x3154c (0x54d bytes) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6521(121 mod 256): MAPWRITE 0x24000 thru 0x2461d (0x61e bytes) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6522(122 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6523(123 mod 256): PUNCH 0x4e262 thru 0x4eded (0xb8c bytes) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6524(124 mod 256): TRUNCATE UP from 0x52000 to 0x55000 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6525(125 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6526(126 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6527(127 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6528(128 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6529(129 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6530(130 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: +6531(131 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6532(132 mod 256): COPY 0x24000 thru 0x24fff (0x1000 bytes) to 0x5b000 thru 0x5bfff 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6533(133 mod 256): PUNCH 0x49239 thru 0x4a75f (0x1527 bytes) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6534(134 mod 256): MAPREAD 0x4000 thru 0x5214 (0x1215 bytes) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6535(135 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6536(136 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6537(137 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6538(138 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6539(139 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6540(140 mod 256): READ 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6541(141 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6542(142 mod 256): MAPREAD 0x1e000 thru 0x1e7b4 (0x7b5 bytes) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6543(143 mod 256): WRITE 0x3f000 thru 0x3ffff (0x1000 bytes) 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6544(144 mod 256): TRUNCATE UP from 0x5c000 to 0x6e000 2024-03-26T07:41:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: +6545(145 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6546(146 mod 256): WRITE 0x70000 thru 0x70fff (0x1000 bytes) HOLE 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6547(147 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6548(148 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6549(149 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6550(150 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6551(151 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6552(152 mod 256): PUNCH 0x2937 thru 0x3214 (0x8de bytes) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6553(153 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6554(154 mod 256): PUNCH 0x22a1b thru 0x23fa5 (0x158b bytes) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6555(155 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6556(156 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6557(157 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6558(158 mod 256): MAPWRITE 0x8000 thru 0x916b (0x116c bytes) 2024-03-26T07:41:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: +6559(159 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6560(160 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6561(161 mod 256): PUNCH 0x259ec thru 0x278e6 (0x1efb bytes) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6562(162 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6563(163 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6564(164 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6565(165 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6566(166 mod 256): MAPWRITE 0x44000 thru 0x44834 (0x835 bytes) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6567(167 mod 256): MAPWRITE 0x20000 thru 0x21e04 (0x1e05 bytes) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6568(168 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6569(169 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6570(170 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6571(171 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: +6572(172 mod 256): MAPWRITE 0x71000 thru 0x712fe (0x2ff bytes) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6573(173 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6574(174 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6575(175 mod 256): TRUNCATE DOWN from 0x712ff to 0x38000 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6576(176 mod 256): PUNCH 0x2739a thru 0x27cb8 (0x91f bytes) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6577(177 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6578(178 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6579(179 mod 256): TRUNCATE UP from 0x38000 to 0x58000 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6580(180 mod 256): MAPREAD 0x1000 thru 0x1d51 (0xd52 bytes) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6581(181 mod 256): MAPREAD 0x38000 thru 0x39ba1 (0x1ba2 bytes) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6582(182 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6583(183 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6584(184 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6585(185 mod 256): WRITE 0x1d000 thru 0x1dfff (0x1000 bytes) 2024-03-26T07:41:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: +6586(186 mod 256): MAPREAD 0x2c000 thru 0x2d7f5 (0x17f6 bytes) 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6587(187 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6588(188 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6589(189 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6590(190 mod 256): TRUNCATE UP from 0x58000 to 0x75000 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6591(191 mod 256): TRUNCATE DOWN from 0x75000 to 0x18000 ******WWWW 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6592(192 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6593(193 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6594(194 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6595(195 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x46000 thru 0x46fff 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6596(196 mod 256): PUNCH 0x3a94a thru 0x3c54f (0x1c06 bytes) 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6597(197 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6598(198 mod 256): WRITE 0x37000 thru 0x37fff (0x1000 bytes) ***WWWW 2024-03-26T07:41:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: +6599(199 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6600(200 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6601(201 mod 256): READ 0x2a000 thru 0x2afff (0x1000 bytes) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6602(202 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6603(203 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6604(204 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6605(205 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x33000 thru 0x33fff 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6606(206 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6607(207 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6608(208 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6609(209 mod 256): MAPREAD 0xc000 thru 0xd404 (0x1405 bytes) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6610(210 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6611(211 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: +6612(212 mod 256): WRITE 0x15000 thru 0x15fff (0x1000 bytes) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6613(213 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6614(214 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6615(215 mod 256): WRITE 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6616(216 mod 256): PUNCH 0x19d2f thru 0x1afeb (0x12bd bytes) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6617(217 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6618(218 mod 256): READ 0x34000 thru 0x34fff (0x1000 bytes) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6619(219 mod 256): MAPREAD 0xa000 thru 0xb184 (0x1185 bytes) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6620(220 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6621(221 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6622(222 mod 256): COPY 0x17000 thru 0x17fff (0x1000 bytes) to 0x35000 thru 0x35fff 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6623(223 mod 256): MAPWRITE 0x54000 thru 0x55d80 (0x1d81 bytes) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6624(224 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6625(225 mod 256): TRUNCATE UP from 0x55d81 to 0x61000 2024-03-26T07:41:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: +6626(226 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6627(227 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6628(228 mod 256): MAPREAD 0x5a000 thru 0x5acce (0xccf bytes) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6629(229 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6630(230 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6631(231 mod 256): MAPWRITE 0x47000 thru 0x4799d (0x99e bytes) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6632(232 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6633(233 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6634(234 mod 256): MAPREAD 0x58000 thru 0x59863 (0x1864 bytes) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6635(235 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x33000 thru 0x33fff 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6636(236 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6637(237 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6638(238 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6639(239 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: +6640(240 mod 256): MAPWRITE 0x39000 thru 0x3ae3b (0x1e3c bytes) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6641(241 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6642(242 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6643(243 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6644(244 mod 256): PUNCH 0x1b47e thru 0x1c5d4 (0x1157 bytes) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6645(245 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6646(246 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6647(247 mod 256): MAPREAD 0x54000 thru 0x54dcc (0xdcd bytes) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6648(248 mod 256): PUNCH 0x2013f thru 0x219f3 (0x18b5 bytes) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6649(249 mod 256): MAPREAD 0x5c000 thru 0x5d508 (0x1509 bytes) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6650(250 mod 256): PUNCH 0x51a6d thru 0x525ce (0xb62 bytes) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6651(251 mod 256): PUNCH 0x4aa6 thru 0x4c26 (0x181 bytes) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6652(252 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6653(253 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: +6654(254 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6655(255 mod 256): MAPWRITE 0x2f000 thru 0x307c0 (0x17c1 bytes) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6656( 0 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6657( 1 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6658( 2 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6659( 3 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6660( 4 mod 256): COPY 0x1f000 thru 0x1ffff (0x1000 bytes) to 0x3b000 thru 0x3bfff 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6661( 5 mod 256): MAPREAD 0x3c000 thru 0x3cc3e (0xc3f bytes) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6662( 6 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6663( 7 mod 256): MAPWRITE 0x21000 thru 0x223f5 (0x13f6 bytes) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6664( 8 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6665( 9 mod 256): READ 0x0 thru 0xfff (0x1000 bytes) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6666( 10 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6667( 11 mod 256): MAPREAD 0x49000 thru 0x49d7b (0xd7c bytes) 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6668( 12 mod 256): WRITE 0x6a000 thru 0x6afff (0x1000 bytes) HOLE 2024-03-26T07:41:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: +6669( 13 mod 256): MAPWRITE 0x1d000 thru 0x1dfda (0xfdb bytes) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6670( 14 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6671( 15 mod 256): MAPREAD 0x0 thru 0x1a71 (0x1a72 bytes) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6672( 16 mod 256): MAPWRITE 0x21000 thru 0x2198a (0x98b bytes) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6673( 17 mod 256): MAPWRITE 0x72000 thru 0x722f2 (0x2f3 bytes) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6674( 18 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6675( 19 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6676( 20 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6677( 21 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6678( 22 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6679( 23 mod 256): MAPWRITE 0xf000 thru 0x10f15 (0x1f16 bytes) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6680( 24 mod 256): MAPREAD 0x5b000 thru 0x5c7ac (0x17ad bytes) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6681( 25 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: +6682( 26 mod 256): TRUNCATE DOWN from 0x722f3 to 0x6f000 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6683( 27 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6684( 28 mod 256): TRUNCATE DOWN from 0x6f000 to 0x39000 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6685( 29 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6686( 30 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6687( 31 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6688( 32 mod 256): READ 0x32000 thru 0x32fff (0x1000 bytes) 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6689( 33 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6690( 34 mod 256): SKIPPED (no operation) 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6691( 35 mod 256): PUNCH 0xcb30 thru 0xe83a (0x1d0b bytes) 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +6692( 36 mod 256): MAPREAD 0x37000 thru 0x382a5 (0x12a6 bytes) ***RRRR*** 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +Log of operations saved to "/tmp/tmp.LsIyRsPUXptest/junk.fsxops"; replay with --replay-ops 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +Correct content saved for comparison 2024-03-26T07:41:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: +(maybe hexdump "/tmp/tmp.LsIyRsPUXptest/junk" vs "/tmp/tmp.LsIyRsPUXptest/junk.fsxgood") 2024-03-26T07:41:45.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T07:41:45.045 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/263 2024-03-26T07:41:45.045 INFO:teuthology.orchestra.run.smithi063.stdout:Failures: generic/263 2024-03-26T07:41:45.045 INFO:teuthology.orchestra.run.smithi063.stdout:Failed 1 of 1 tests 2024-03-26T07:41:45.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:45.045 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-26T07:41:45.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-26T07:41:45.046 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-03-26T07:41:45.711 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:45.728 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:45.730 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:45.734 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:45.734 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:46.794 INFO:teuthology.orchestra.run.smithi063.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:46.818 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/264 2024-03-26T07:41:46.819 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/264 2024-03-26T07:41:46.820 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:47.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:47.022 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-03-26T07:41:47.558 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:47.569 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:47.570 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:47.573 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:47.573 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:48.694 INFO:teuthology.orchestra.run.smithi063.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:48.712 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/265 2024-03-26T07:41:48.712 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/265 2024-03-26T07:41:48.712 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:48.727 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:48.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:48.958 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-03-26T07:41:49.481 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:49.498 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:49.499 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:49.503 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:49.503 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:50.604 INFO:teuthology.orchestra.run.smithi063.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:50.634 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/266 2024-03-26T07:41:50.635 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/266 2024-03-26T07:41:50.635 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:50.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:50.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:50.850 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-03-26T07:41:51.354 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:51.369 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:51.371 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:51.376 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:51.376 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:52.511 INFO:teuthology.orchestra.run.smithi063.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:52.529 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/267 2024-03-26T07:41:52.529 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/267 2024-03-26T07:41:52.530 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:52.542 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:52.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:52.728 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-03-26T07:41:53.255 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:53.270 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:53.270 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:53.273 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:53.274 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:54.408 INFO:teuthology.orchestra.run.smithi063.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:54.425 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/268 2024-03-26T07:41:54.426 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/268 2024-03-26T07:41:54.426 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:54.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:54.654 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-03-26T07:41:55.189 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:55.203 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:55.205 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:55.209 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:55.210 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:55.889 INFO:teuthology.orchestra.run.smithi063.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:41:55.903 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/269 2024-03-26T07:41:55.903 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/269 2024-03-26T07:41:55.903 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:55.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:55.965 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-03-26T07:41:56.574 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:56.590 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:56.592 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:56.596 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:56.596 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:57.235 INFO:teuthology.orchestra.run.smithi063.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:41:57.251 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/270 2024-03-26T07:41:57.252 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/270 2024-03-26T07:41:57.252 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:57.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:57.306 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-03-26T07:41:57.919 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:57.933 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:57.935 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:57.939 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:57.939 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:59.053 INFO:teuthology.orchestra.run.smithi063.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:41:59.072 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/271 2024-03-26T07:41:59.072 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/271 2024-03-26T07:41:59.072 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:41:59.083 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:41:59.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:41:59.265 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-03-26T07:41:59.795 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:41:59.811 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:41:59.812 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:41:59.816 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:41:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:00.933 INFO:teuthology.orchestra.run.smithi063.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:00.953 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/272 2024-03-26T07:42:00.953 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/272 2024-03-26T07:42:00.954 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:00.973 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:01.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:01.151 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-03-26T07:42:01.679 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:01.691 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:01.692 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:01.695 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:02.356 INFO:teuthology.orchestra.run.smithi063.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:42:02.372 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/273 2024-03-26T07:42:02.372 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/273 2024-03-26T07:42:02.372 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:02.385 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:02.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:02.432 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-03-26T07:42:03.045 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:03.059 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:03.060 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:03.064 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:03.064 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:03.200 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:42:03.206 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:42:03.734 INFO:teuthology.orchestra.run.smithi063.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-26T07:42:03.747 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/274 2024-03-26T07:42:03.747 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/274 2024-03-26T07:42:03.747 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:03.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:03.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:03.815 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-03-26T07:42:04.425 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:04.440 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:04.442 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:04.446 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:04.446 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:05.157 INFO:teuthology.orchestra.run.smithi063.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:42:05.173 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/275 2024-03-26T07:42:05.173 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/275 2024-03-26T07:42:05.173 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:05.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:05.234 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-03-26T07:42:05.867 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:05.881 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:05.882 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:05.886 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:06.978 INFO:teuthology.orchestra.run.smithi063.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:06.998 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/276 2024-03-26T07:42:06.998 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/276 2024-03-26T07:42:06.998 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:07.017 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:07.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:07.179 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-03-26T07:42:07.706 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:07.722 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:07.724 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:07.729 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:07.729 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:08.511 INFO:teuthology.orchestra.run.smithi063.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-03-26T07:42:08.526 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/277 2024-03-26T07:42:08.526 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/277 2024-03-26T07:42:08.527 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:08.539 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:08.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:08.607 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-03-26T07:42:09.238 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:09.252 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:09.254 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:09.258 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:10.296 INFO:teuthology.orchestra.run.smithi063.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:10.313 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/278 2024-03-26T07:42:10.313 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/278 2024-03-26T07:42:10.314 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:10.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:10.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:10.546 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-03-26T07:42:11.080 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:11.096 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:11.097 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:11.101 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:12.185 INFO:teuthology.orchestra.run.smithi063.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:12.201 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/279 2024-03-26T07:42:12.202 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/279 2024-03-26T07:42:12.202 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:12.213 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:12.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:12.459 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-03-26T07:42:12.944 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:12.956 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:12.958 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:12.961 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:12.961 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:13.650 INFO:teuthology.orchestra.run.smithi063.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:42:13.663 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/280 2024-03-26T07:42:13.664 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/280 2024-03-26T07:42:13.664 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:13.675 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:13.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:13.726 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-03-26T07:42:14.358 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:14.372 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:14.373 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:14.376 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:14.377 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:15.486 INFO:teuthology.orchestra.run.smithi063.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:15.506 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/281 2024-03-26T07:42:15.507 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/281 2024-03-26T07:42:15.507 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:15.523 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:15.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:15.737 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-03-26T07:42:16.282 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:16.295 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:16.296 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:16.299 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:16.299 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:17.417 INFO:teuthology.orchestra.run.smithi063.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:17.434 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/282 2024-03-26T07:42:17.434 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/282 2024-03-26T07:42:17.434 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:17.446 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:17.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:17.622 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-03-26T07:42:18.149 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:18.165 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:18.166 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:18.170 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:18.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:19.247 INFO:teuthology.orchestra.run.smithi063.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:19.264 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/283 2024-03-26T07:42:19.264 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/283 2024-03-26T07:42:19.264 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:19.276 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:19.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:19.439 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-03-26T07:42:19.994 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:20.007 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:20.010 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:20.010 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:21.047 INFO:teuthology.orchestra.run.smithi063.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/284 2024-03-26T07:42:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/284 2024-03-26T07:42:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:21.082 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:21.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:21.317 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-03-26T07:42:21.860 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:21.874 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:21.876 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:21.880 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:21.880 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:25.110 INFO:teuthology.orchestra.run.smithi063.stdout:generic/285 3s 2024-03-26T07:42:25.128 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/285 2024-03-26T07:42:25.129 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:25.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:25.634 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-03-26T07:42:26.438 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:26.453 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:26.456 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:26.459 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:27.130 INFO:teuthology.orchestra.run.smithi063.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:42:27.142 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/286 2024-03-26T07:42:27.142 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/286 2024-03-26T07:42:27.142 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:27.151 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:27.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:27.199 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-03-26T07:42:27.792 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:27.806 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:27.807 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:27.810 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:28.786 INFO:teuthology.orchestra.run.smithi063.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:28.806 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/287 2024-03-26T07:42:28.806 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/287 2024-03-26T07:42:28.807 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:28.829 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:29.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:29.051 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-03-26T07:42:29.666 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:29.682 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:29.684 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:29.687 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:29.687 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:30.498 INFO:teuthology.orchestra.run.smithi063.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:30.517 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/288 2024-03-26T07:42:30.518 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/288 2024-03-26T07:42:30.518 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:30.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:30.563 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-03-26T07:42:31.197 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:31.211 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:31.212 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:31.215 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:31.215 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:32.254 INFO:teuthology.orchestra.run.smithi063.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:32.274 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/289 2024-03-26T07:42:32.274 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/289 2024-03-26T07:42:32.274 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:32.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:32.561 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-03-26T07:42:33.060 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:33.072 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:33.074 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:33.077 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:33.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:42:33.332 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:42:34.072 INFO:teuthology.orchestra.run.smithi063.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:34.088 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/290 2024-03-26T07:42:34.088 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/290 2024-03-26T07:42:34.089 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:34.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:34.319 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-03-26T07:42:34.857 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:34.872 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:34.874 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:34.878 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:35.957 INFO:teuthology.orchestra.run.smithi063.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:35.977 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/291 2024-03-26T07:42:35.977 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/291 2024-03-26T07:42:35.977 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:35.993 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:36.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:36.225 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-03-26T07:42:36.777 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:36.791 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:36.793 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:36.797 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:36.797 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:37.867 INFO:teuthology.orchestra.run.smithi063.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:37.883 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/292 2024-03-26T07:42:37.883 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/292 2024-03-26T07:42:37.884 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:38.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:38.107 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-03-26T07:42:38.647 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:38.660 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:38.661 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:38.664 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:38.664 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:39.706 INFO:teuthology.orchestra.run.smithi063.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:39.728 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/293 2024-03-26T07:42:39.729 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/293 2024-03-26T07:42:39.730 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:39.742 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:39.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:39.999 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-03-26T07:42:40.499 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:40.511 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:40.513 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:40.517 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:40.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:41.806 INFO:teuthology.orchestra.run.smithi063.stdout:generic/294 1s 2024-03-26T07:42:41.843 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/294 2024-03-26T07:42:41.843 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:41.862 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:41.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:41.917 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-03-26T07:42:42.456 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:42.469 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:42.471 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:42.474 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:42.474 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:43.633 INFO:teuthology.orchestra.run.smithi063.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:43.649 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/295 2024-03-26T07:42:43.649 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/295 2024-03-26T07:42:43.649 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:43.662 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:43.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:43.863 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-03-26T07:42:44.390 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:44.405 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:44.407 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:44.410 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:44.410 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:45.452 INFO:teuthology.orchestra.run.smithi063.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:45.479 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/296 2024-03-26T07:42:45.479 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/296 2024-03-26T07:42:45.479 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:45.489 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:45.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:45.671 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-03-26T07:42:46.218 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:46.231 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:46.232 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:46.236 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:46.236 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:47.300 INFO:teuthology.orchestra.run.smithi063.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:47.316 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/297 2024-03-26T07:42:47.316 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/297 2024-03-26T07:42:47.320 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:47.336 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:47.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:47.565 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-03-26T07:42:48.064 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:48.077 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:48.078 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:48.081 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:48.081 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:49.128 INFO:teuthology.orchestra.run.smithi063.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:49.146 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/298 2024-03-26T07:42:49.146 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/298 2024-03-26T07:42:49.146 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:49.160 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:49.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:49.378 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-03-26T07:42:49.912 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:49.926 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:49.927 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:49.930 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:49.930 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:50.791 INFO:teuthology.orchestra.run.smithi063.stdout:generic/299 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:42:50.807 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/299 2024-03-26T07:42:50.807 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/299 2024-03-26T07:42:50.808 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:50.820 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:50.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:50.868 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-03-26T07:42:51.505 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:51.521 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:51.526 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:51.526 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:51.526 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:52.345 INFO:teuthology.orchestra.run.smithi063.stdout:generic/300 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:42:52.361 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/300 2024-03-26T07:42:52.361 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/300 2024-03-26T07:42:52.361 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:52.374 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:52.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:52.418 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-03-26T07:42:53.064 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:53.080 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:53.082 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:53.089 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:53.089 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:54.122 INFO:teuthology.orchestra.run.smithi063.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:54.144 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/301 2024-03-26T07:42:54.149 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/301 2024-03-26T07:42:54.149 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:54.165 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:54.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:54.325 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-03-26T07:42:54.873 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:54.886 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:54.888 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:54.891 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:54.892 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:55.896 INFO:teuthology.orchestra.run.smithi063.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:42:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/302 2024-03-26T07:42:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/302 2024-03-26T07:42:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:56.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:56.096 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-03-26T07:42:56.652 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:56.662 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:56.664 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:56.666 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:56.667 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:57.415 INFO:teuthology.orchestra.run.smithi063.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:42:57.428 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/303 2024-03-26T07:42:57.428 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/303 2024-03-26T07:42:57.428 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:57.437 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:57.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:57.537 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-03-26T07:42:58.216 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:58.230 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:58.231 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:58.234 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:59.055 INFO:teuthology.orchestra.run.smithi063.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-26T07:42:59.069 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/304 2024-03-26T07:42:59.069 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/304 2024-03-26T07:42:59.069 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:42:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:42:59.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:42:59.219 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-03-26T07:42:59.868 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:42:59.880 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:42:59.881 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:42:59.884 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:42:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:00.890 INFO:teuthology.orchestra.run.smithi063.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:43:00.911 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/305 2024-03-26T07:43:00.911 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/305 2024-03-26T07:43:00.911 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:43:00.927 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:01.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:43:01.180 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-03-26T07:43:01.700 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:43:01.711 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:43:01.713 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:43:01.716 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:43:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:03.099 INFO:teuthology.orchestra.run.smithi063.stdout:generic/306 2s 2024-03-26T07:43:03.135 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/306 2024-03-26T07:43:03.135 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:43:03.151 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:03.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:43:03.380 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-03-26T07:43:03.459 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:43:03.469 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:43:04.054 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:43:04.069 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:43:04.070 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:43:04.074 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:43:04.074 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:06.431 INFO:teuthology.orchestra.run.smithi063.stdout:generic/307 2s 2024-03-26T07:43:06.454 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/307 2024-03-26T07:43:06.454 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:43:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:06.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:43:06.500 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-03-26T07:43:07.123 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:43:07.138 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:43:07.140 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:43:07.143 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:43:07.143 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:07.883 INFO:teuthology.orchestra.run.smithi063.stdout:generic/308 0s 2024-03-26T07:43:07.901 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/308 2024-03-26T07:43:07.901 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:43:07.911 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:07.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:43:07.960 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-03-26T07:43:08.607 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:43:08.621 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:43:08.623 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:43:08.627 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:43:08.627 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:10.471 INFO:teuthology.orchestra.run.smithi063.stdout:generic/309 2s 2024-03-26T07:43:10.489 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/309 2024-03-26T07:43:10.489 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:43:10.499 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:10.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:43:10.618 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-03-26T07:43:11.289 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:43:11.303 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:43:11.305 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:43:11.308 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:43:11.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:43:33.658 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:43:33.665 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:44:03.893 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:44:03.901 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:44:34.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:44:34.050 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:44:42.026 INFO:teuthology.orchestra.run.smithi063.stdout:generic/310 91s 2024-03-26T07:44:42.045 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/310 2024-03-26T07:44:42.045 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:44:42.053 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:42.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:44:42.321 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-03-26T07:44:42.947 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:44:42.961 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:44:42.963 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:44:42.967 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:44:42.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:43.773 INFO:teuthology.orchestra.run.smithi063.stdout:generic/311 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:44:43.789 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/311 2024-03-26T07:44:43.789 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/311 2024-03-26T07:44:43.789 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:44:43.801 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:43.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:44:43.849 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-03-26T07:44:44.489 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:44:44.503 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:44:44.505 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:44:44.508 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:44:44.508 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:45.163 INFO:teuthology.orchestra.run.smithi063.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:44:45.178 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/312 2024-03-26T07:44:45.178 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/312 2024-03-26T07:44:45.178 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:44:45.191 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:45.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:44:45.249 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-03-26T07:44:45.854 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:44:45.866 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:44:45.867 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:44:45.870 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:44:45.870 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:50.636 INFO:teuthology.orchestra.run.smithi063.stdout:generic/313 4s 2024-03-26T07:44:50.653 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/313 2024-03-26T07:44:50.654 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:44:50.663 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:50.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:44:50.706 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-03-26T07:44:51.347 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:44:51.362 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:44:51.363 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:44:51.367 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:44:51.367 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:53.333 INFO:teuthology.orchestra.run.smithi063.stdout:generic/314 2s 2024-03-26T07:44:53.351 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/314 2024-03-26T07:44:53.352 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:44:53.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:53.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:44:53.414 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-03-26T07:44:54.016 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:44:54.030 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:44:54.032 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:44:54.035 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:44:54.035 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:54.759 INFO:teuthology.orchestra.run.smithi063.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-26T07:44:54.774 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/315 2024-03-26T07:44:54.774 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/315 2024-03-26T07:44:54.774 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:44:54.785 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:54.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:44:54.844 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-03-26T07:44:55.472 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:44:55.488 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:44:55.489 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:44:55.493 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:44:55.493 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:56.544 INFO:teuthology.orchestra.run.smithi063.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-26T07:44:56.560 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/316 2024-03-26T07:44:56.560 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/316 2024-03-26T07:44:56.560 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:44:56.572 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:56.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:44:56.686 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-03-26T07:44:57.374 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:44:57.389 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:44:57.391 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:44:57.394 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:44:57.394 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:generic/317 1s 2024-03-26T07:44:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/317 2024-03-26T07:44:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:44:58.980 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:44:59.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:44:59.016 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-03-26T07:44:59.639 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:44:59.654 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:44:59.656 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:44:59.659 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:44:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:00.965 INFO:teuthology.orchestra.run.smithi063.stdout:generic/318 1s 2024-03-26T07:45:00.981 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/318 2024-03-26T07:45:00.981 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:45:00.990 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:01.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:45:01.025 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-03-26T07:45:01.634 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:45:01.648 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:45:01.651 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:45:01.655 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:45:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:02.722 INFO:teuthology.orchestra.run.smithi063.stdout:generic/319 1s 2024-03-26T07:45:02.740 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/319 2024-03-26T07:45:02.740 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:45:02.749 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:02.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:45:02.777 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-03-26T07:45:03.414 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:45:03.430 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:45:03.431 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:45:03.434 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:45:03.435 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:04.116 INFO:teuthology.orchestra.run.smithi063.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:45:04.292 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:45:04.293 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/320 2024-03-26T07:45:04.294 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/320 2024-03-26T07:45:04.294 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:45:04.294 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:04.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:45:04.294 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-03-26T07:45:04.310 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:45:04.896 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:45:04.910 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:45:04.911 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:45:04.915 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:45:04.916 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:05.498 INFO:teuthology.orchestra.run.smithi063.stdout:generic/321 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:45:05.514 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/321 2024-03-26T07:45:05.514 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/321 2024-03-26T07:45:05.514 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:45:05.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:05.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:45:05.568 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-03-26T07:45:06.126 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:45:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:45:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:45:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:45:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:06.786 INFO:teuthology.orchestra.run.smithi063.stdout:generic/322 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:45:06.801 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/322 2024-03-26T07:45:06.802 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/322 2024-03-26T07:45:06.802 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:45:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:06.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:45:06.863 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-03-26T07:45:07.488 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:45:07.505 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:45:07.507 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:45:07.511 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:45:07.511 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:45:34.452 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:45:34.457 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:46:06.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:46:06.532 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:46:07.243 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T07:46:07.243+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 307175) UID: 0 2024-03-26T07:46:07.243 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T07:46:07.243+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 307175) UID: 0 2024-03-26T07:46:07.243 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T07:46:07.244+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 307175) UID: 0 2024-03-26T07:46:07.244 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T07:46:07.244+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 307175) UID: 0 2024-03-26T07:47:09.245 INFO:teuthology.orchestra.run.smithi063.stdout:generic/323 122s 2024-03-26T07:47:09.295 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/323 2024-03-26T07:47:09.295 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:09.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:09.397 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-03-26T07:47:12.778 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:12.791 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:12.794 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:12.797 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:12.797 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:13.497 INFO:teuthology.orchestra.run.smithi063.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-03-26T07:47:13.515 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/324 2024-03-26T07:47:13.516 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/324 2024-03-26T07:47:13.516 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:13.529 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:13.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:13.577 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-03-26T07:47:14.161 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:14.173 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:14.174 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:14.178 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:14.178 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:14.944 INFO:teuthology.orchestra.run.smithi063.stdout:generic/325 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:47:14.957 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/325 2024-03-26T07:47:14.957 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/325 2024-03-26T07:47:14.957 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:14.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:15.000 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-03-26T07:47:15.547 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:15.559 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:15.561 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:15.564 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:15.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:16.473 INFO:teuthology.orchestra.run.smithi063.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:47:16.497 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/326 2024-03-26T07:47:16.497 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/326 2024-03-26T07:47:16.497 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:16.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:16.803 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-03-26T07:47:17.282 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:17.296 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:17.298 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:17.302 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:17.302 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:18.265 INFO:teuthology.orchestra.run.smithi063.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:47:18.280 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/327 2024-03-26T07:47:18.280 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/327 2024-03-26T07:47:18.281 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:18.296 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:18.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:18.555 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-03-26T07:47:19.060 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:19.074 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:19.075 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:19.079 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:19.079 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:20.049 INFO:teuthology.orchestra.run.smithi063.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:47:20.070 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/328 2024-03-26T07:47:20.070 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/328 2024-03-26T07:47:20.070 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:20.091 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:20.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:20.385 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-03-26T07:47:20.857 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:20.871 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:20.872 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:20.875 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:21.913 INFO:teuthology.orchestra.run.smithi063.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:47:21.929 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/329 2024-03-26T07:47:21.930 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/329 2024-03-26T07:47:21.930 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:22.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:22.176 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-03-26T07:47:22.669 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:22.682 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:22.684 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:22.687 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:22.687 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:23.660 INFO:teuthology.orchestra.run.smithi063.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:47:23.679 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/330 2024-03-26T07:47:23.679 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/330 2024-03-26T07:47:23.679 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:23.691 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:23.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:23.878 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-03-26T07:47:24.418 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:24.431 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:24.433 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:24.436 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:25.487 INFO:teuthology.orchestra.run.smithi063.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:47:25.504 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/331 2024-03-26T07:47:25.505 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/331 2024-03-26T07:47:25.505 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:25.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:25.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:25.755 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-03-26T07:47:26.237 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:26.249 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:26.250 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:26.253 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:26.253 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:27.200 INFO:teuthology.orchestra.run.smithi063.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:47:27.217 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/332 2024-03-26T07:47:27.219 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/332 2024-03-26T07:47:27.219 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:27.230 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:27.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:27.523 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-03-26T07:47:27.989 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:28.002 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:28.004 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:28.007 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:28.007 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:28.949 INFO:teuthology.orchestra.run.smithi063.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:47:28.966 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/333 2024-03-26T07:47:28.966 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/333 2024-03-26T07:47:28.967 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:29.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:29.260 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-03-26T07:47:29.749 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:29.760 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:29.761 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:29.764 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:29.764 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:30.713 INFO:teuthology.orchestra.run.smithi063.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:47:30.736 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/334 2024-03-26T07:47:30.736 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/334 2024-03-26T07:47:30.736 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:30.752 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:31.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:31.050 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-03-26T07:47:31.529 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:31.541 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:31.543 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:31.546 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:31.546 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:32.290 INFO:teuthology.orchestra.run.smithi063.stdout:generic/335 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:47:32.304 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/335 2024-03-26T07:47:32.305 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/335 2024-03-26T07:47:32.305 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:32.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:32.362 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-03-26T07:47:32.949 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:32.962 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:32.964 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:32.968 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:32.968 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:33.632 INFO:teuthology.orchestra.run.smithi063.stdout:generic/336 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:47:33.645 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/336 2024-03-26T07:47:33.645 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/336 2024-03-26T07:47:33.645 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:33.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:33.702 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-03-26T07:47:34.274 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:34.288 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:34.289 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:34.292 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:34.292 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:35.225 INFO:teuthology.orchestra.run.smithi063.stdout:generic/337 1s 2024-03-26T07:47:35.241 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/337 2024-03-26T07:47:35.241 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:35.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:35.277 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-03-26T07:47:35.827 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:35.840 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:35.842 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:35.845 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:35.845 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:36.520 INFO:teuthology.orchestra.run.smithi063.stdout:generic/338 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:47:36.533 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/338 2024-03-26T07:47:36.533 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/338 2024-03-26T07:47:36.533 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:47:36.542 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:47:36.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:47:36.586 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-03-26T07:47:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:47:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:47:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:47:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:47:37.144 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi063.stdout:generic/339 82s 2024-03-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/339 2024-03-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:48:59.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:48:59.450 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-03-26T07:49:00.150 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:00.162 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:00.163 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:00.166 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:00.166 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:generic/340 6s 2024-03-26T07:49:06.304 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/340 2024-03-26T07:49:06.304 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:06.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:06.373 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-03-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:07.764 INFO:teuthology.orchestra.run.smithi063.stdout:generic/341 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:49:07.780 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/341 2024-03-26T07:49:07.780 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/341 2024-03-26T07:49:07.780 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:07.792 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:07.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:07.840 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-03-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi063.stdout:generic/342 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/342 2024-03-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/342 2024-03-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:09.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:09.241 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-03-26T07:49:09.895 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:09.910 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:09.912 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:09.917 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:10.694 INFO:teuthology.orchestra.run.smithi063.stdout:generic/343 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:49:10.709 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/343 2024-03-26T07:49:10.710 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/343 2024-03-26T07:49:10.710 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:10.722 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:10.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:10.781 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-03-26T07:49:11.405 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:11.420 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:11.421 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:11.425 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:11.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:22.801 INFO:teuthology.orchestra.run.smithi063.stdout:generic/344 11s 2024-03-26T07:49:22.835 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/344 2024-03-26T07:49:22.835 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:22.846 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:22.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:22.885 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-03-26T07:49:23.474 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:23.488 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:23.489 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:23.493 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:23.493 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:34.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:49:34.654 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:49:34.860 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T07:49:34.860+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 318012) UID: 0 2024-03-26T07:49:34.860 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T07:49:34.861+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 318012) UID: 0 2024-03-26T07:49:36.042 INFO:teuthology.orchestra.run.smithi063.stdout:generic/345 13s 2024-03-26T07:49:36.073 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/345 2024-03-26T07:49:36.073 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:36.085 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:36.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:36.130 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-03-26T07:49:36.767 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:36.787 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:36.788 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:36.790 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:36.790 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:42.381 INFO:teuthology.orchestra.run.smithi063.stdout:generic/346 5s 2024-03-26T07:49:42.419 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/346 2024-03-26T07:49:42.425 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:42.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:42.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:42.498 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-03-26T07:49:43.278 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:43.288 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:43.290 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:43.292 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:43.292 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:44.055 INFO:teuthology.orchestra.run.smithi063.stdout:generic/347 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:49:44.067 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/347 2024-03-26T07:49:44.067 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/347 2024-03-26T07:49:44.067 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:44.076 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:44.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:44.115 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-03-26T07:49:44.672 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:44.685 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:44.686 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:44.689 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:45.336 INFO:teuthology.orchestra.run.smithi063.stdout:generic/348 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:49:45.347 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/348 2024-03-26T07:49:45.347 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/348 2024-03-26T07:49:45.347 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:45.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:45.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:45.405 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-03-26T07:49:45.977 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:45.989 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:45.991 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:45.994 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:45.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:46.877 INFO:teuthology.orchestra.run.smithi063.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-26T07:49:46.887 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/349 2024-03-26T07:49:46.887 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/349 2024-03-26T07:49:46.887 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:46.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:46.945 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-03-26T07:49:47.500 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:47.513 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:47.514 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:47.517 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:47.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:49.068 INFO:teuthology.orchestra.run.smithi063.stdout:generic/350 2s 2024-03-26T07:49:49.086 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/350 2024-03-26T07:49:49.087 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:49.095 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:49.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:49.123 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-03-26T07:49:49.672 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:49.683 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:49.684 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:49.687 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:49.687 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:50.307 INFO:teuthology.orchestra.run.smithi063.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:49:50.317 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/351 2024-03-26T07:49:50.318 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/351 2024-03-26T07:49:50.318 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:50.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:50.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:50.371 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-03-26T07:49:50.901 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:50.913 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:50.914 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:50.917 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:50.918 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:51.869 INFO:teuthology.orchestra.run.smithi063.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:49:51.887 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/352 2024-03-26T07:49:51.888 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/352 2024-03-26T07:49:51.888 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:51.902 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:52.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:52.181 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-03-26T07:49:52.651 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:52.667 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:52.667 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:53.646 INFO:teuthology.orchestra.run.smithi063.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:49:53.666 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/353 2024-03-26T07:49:53.667 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/353 2024-03-26T07:49:53.668 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:49:53.681 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:49:53.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:49:53.956 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-03-26T07:49:54.450 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:49:54.462 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:49:54.463 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:49:54.466 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:49:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:06.012 INFO:teuthology.orchestra.run.smithi063.stdout:generic/354 11s 2024-03-26T07:50:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/354 2024-03-26T07:50:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:06.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:06.095 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-03-26T07:50:06.720 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:06.736 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:06.738 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:06.743 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:08.582 INFO:teuthology.orchestra.run.smithi063.stdout:generic/355 1s 2024-03-26T07:50:08.599 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/355 2024-03-26T07:50:08.599 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:08.607 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:08.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:08.743 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-03-26T07:50:09.454 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:09.463 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:09.465 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:09.467 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:10.540 INFO:teuthology.orchestra.run.smithi063.stdout:generic/356 [not run] swapfiles are not supported 2024-03-26T07:50:10.554 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/356 2024-03-26T07:50:10.554 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/356 2024-03-26T07:50:10.554 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:10.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:10.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:10.619 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-03-26T07:50:11.204 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:11.218 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:11.219 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:11.222 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:11.223 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:12.072 INFO:teuthology.orchestra.run.smithi063.stdout:generic/357 [not run] swapfiles are not supported 2024-03-26T07:50:12.088 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/357 2024-03-26T07:50:12.088 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/357 2024-03-26T07:50:12.088 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:12.099 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:12.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:12.149 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-03-26T07:50:12.725 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:12.738 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:12.739 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:12.742 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:12.742 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi063.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:50:13.760 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/358 2024-03-26T07:50:13.760 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/358 2024-03-26T07:50:13.761 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:13.782 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:14.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:14.093 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-03-26T07:50:14.576 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:14.589 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:14.590 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:14.593 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:15.504 INFO:teuthology.orchestra.run.smithi063.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:50:15.523 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/359 2024-03-26T07:50:15.523 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/359 2024-03-26T07:50:15.523 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:15.539 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:15.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:15.858 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-03-26T07:50:16.341 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:16.353 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:16.354 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:16.357 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:16.357 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:17.090 INFO:teuthology.orchestra.run.smithi063.stdout:generic/360 1s 2024-03-26T07:50:17.107 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/360 2024-03-26T07:50:17.107 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:17.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:17.159 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-03-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:18.349 INFO:teuthology.orchestra.run.smithi063.stdout:generic/361 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:50:18.361 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/361 2024-03-26T07:50:18.361 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/361 2024-03-26T07:50:18.361 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:18.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:18.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:18.407 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-03-26T07:50:18.951 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:18.964 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:18.965 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:18.968 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:19.561 INFO:teuthology.orchestra.run.smithi063.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-26T07:50:19.572 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/362 2024-03-26T07:50:19.572 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/362 2024-03-26T07:50:19.572 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:19.581 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:19.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:19.618 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-03-26T07:50:20.157 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:20.170 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:20.172 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:20.175 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:20.175 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:20.723 INFO:teuthology.orchestra.run.smithi063.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-26T07:50:20.736 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/363 2024-03-26T07:50:20.736 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/363 2024-03-26T07:50:20.737 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:20.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:20.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:20.790 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-03-26T07:50:21.322 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:21.335 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:21.336 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:21.339 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:21.938 INFO:teuthology.orchestra.run.smithi063.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-26T07:50:21.949 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/364 2024-03-26T07:50:21.949 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/364 2024-03-26T07:50:21.949 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:21.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:21.998 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-03-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-26T07:50:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/365 2024-03-26T07:50:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/365 2024-03-26T07:50:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:23.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:23.212 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-03-26T07:50:23.780 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:23.790 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:23.792 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:23.795 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:24.400 INFO:teuthology.orchestra.run.smithi063.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-26T07:50:24.412 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/366 2024-03-26T07:50:24.412 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/366 2024-03-26T07:50:24.412 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:24.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:24.458 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-03-26T07:50:25.028 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:25.040 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:25.042 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:25.044 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:25.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:25.633 INFO:teuthology.orchestra.run.smithi063.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-26T07:50:25.646 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/367 2024-03-26T07:50:25.646 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/367 2024-03-26T07:50:25.646 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:25.656 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:25.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:25.698 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-03-26T07:50:26.235 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:26.245 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:26.246 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:26.249 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:26.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:26.858 INFO:teuthology.orchestra.run.smithi063.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-26T07:50:26.874 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/368 2024-03-26T07:50:26.874 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/368 2024-03-26T07:50:26.875 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:26.885 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:26.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:26.930 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-03-26T07:50:27.471 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:27.485 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:27.487 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:27.490 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:27.491 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:28.063 INFO:teuthology.orchestra.run.smithi063.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-26T07:50:28.075 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/369 2024-03-26T07:50:28.075 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/369 2024-03-26T07:50:28.075 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:28.085 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:28.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:28.126 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-03-26T07:50:28.651 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:28.662 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:28.664 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:28.666 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:29.239 INFO:teuthology.orchestra.run.smithi063.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-26T07:50:29.250 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/370 2024-03-26T07:50:29.250 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/370 2024-03-26T07:50:29.250 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:29.261 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:29.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:29.300 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-03-26T07:50:29.843 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:29.856 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:29.857 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:29.860 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:29.860 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:30.472 INFO:teuthology.orchestra.run.smithi063.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:50:30.486 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/371 2024-03-26T07:50:30.487 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/371 2024-03-26T07:50:30.487 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:30.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:30.546 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-03-26T07:50:31.064 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:31.078 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:31.079 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:31.082 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:32.020 INFO:teuthology.orchestra.run.smithi063.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:50:32.044 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/372 2024-03-26T07:50:32.044 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/372 2024-03-26T07:50:32.044 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:32.051 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:32.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:32.326 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-03-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:33.834 INFO:teuthology.orchestra.run.smithi063.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:50:33.851 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/373 2024-03-26T07:50:33.851 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/373 2024-03-26T07:50:33.851 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:34.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:34.171 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-03-26T07:50:34.657 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:34.669 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:34.671 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:34.674 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:34.674 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:35.523 INFO:teuthology.orchestra.run.smithi063.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-26T07:50:35.592 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/374 2024-03-26T07:50:35.592 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/374 2024-03-26T07:50:35.592 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:35.609 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:36.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:36.055 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-03-26T07:50:36.515 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:36.527 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:generic/375 1s 2024-03-26T07:50:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/375 2024-03-26T07:50:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:37.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:37.413 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-03-26T07:50:38.098 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:38.108 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:38.109 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:38.112 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:38.112 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:38.710 INFO:teuthology.orchestra.run.smithi063.stdout:generic/376 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:50:38.723 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/376 2024-03-26T07:50:38.723 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/376 2024-03-26T07:50:38.723 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:38.732 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:38.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:38.771 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-03-26T07:50:39.339 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:39.350 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:39.352 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:39.355 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:39.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:40.304 INFO:teuthology.orchestra.run.smithi063.stdout:generic/377 1s 2024-03-26T07:50:40.322 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/377 2024-03-26T07:50:40.322 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:40.331 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:40.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:40.357 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-03-26T07:50:40.906 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:40.918 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:40.920 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:40.922 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:40.922 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:42.082 INFO:teuthology.orchestra.run.smithi063.stdout:generic/378 1s 2024-03-26T07:50:42.501 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/378 2024-03-26T07:50:42.501 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:42.513 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:42.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:42.653 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-03-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:43.373 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:43.374 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:43.376 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:43.998 INFO:teuthology.orchestra.run.smithi063.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:50:44.012 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/379 2024-03-26T07:50:44.012 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/379 2024-03-26T07:50:44.013 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:44.023 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:44.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:44.068 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-03-26T07:50:44.617 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:44.630 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:44.632 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:44.635 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:44.635 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:45.230 INFO:teuthology.orchestra.run.smithi063.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:50:45.242 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/380 2024-03-26T07:50:45.242 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/380 2024-03-26T07:50:45.242 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:45.251 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:45.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:45.292 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-03-26T07:50:45.855 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:45.868 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:45.869 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:45.872 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:45.873 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:46.465 INFO:teuthology.orchestra.run.smithi063.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:50:46.477 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/381 2024-03-26T07:50:46.477 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/381 2024-03-26T07:50:46.478 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:46.488 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:46.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:46.527 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-03-26T07:50:47.082 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:47.094 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:47.095 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:47.098 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:47.098 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:47.694 INFO:teuthology.orchestra.run.smithi063.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:50:47.705 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/382 2024-03-26T07:50:47.706 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/382 2024-03-26T07:50:47.706 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:47.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:47.753 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-03-26T07:50:48.300 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:48.314 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:48.315 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:48.318 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:48.319 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:50:48.945 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/383 2024-03-26T07:50:48.945 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/383 2024-03-26T07:50:48.945 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:48.957 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:48.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:48.999 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-03-26T07:50:49.536 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:49.551 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:49.553 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:49.556 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:49.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:50.186 INFO:teuthology.orchestra.run.smithi063.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:50:50.197 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/384 2024-03-26T07:50:50.198 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/384 2024-03-26T07:50:50.198 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:50.206 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:50.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:50.244 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-03-26T07:50:50.813 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:50.825 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:50.826 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:50.829 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:50.829 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:51.437 INFO:teuthology.orchestra.run.smithi063.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:50:51.452 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/385 2024-03-26T07:50:51.452 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/385 2024-03-26T07:50:51.452 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:51.463 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:51.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:51.509 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-03-26T07:50:52.038 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:52.051 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:52.052 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:52.055 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:52.651 INFO:teuthology.orchestra.run.smithi063.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:50:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/386 2024-03-26T07:50:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/386 2024-03-26T07:50:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:52.676 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:52.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:52.716 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-03-26T07:50:53.287 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:53.301 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:53.302 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:53.306 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:53.306 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:54.272 INFO:teuthology.orchestra.run.smithi063.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:50:54.295 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/387 2024-03-26T07:50:54.295 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/387 2024-03-26T07:50:54.295 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:54.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:54.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:54.579 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-03-26T07:50:55.072 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:55.087 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:55.089 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:55.092 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:55.750 INFO:teuthology.orchestra.run.smithi063.stdout:generic/388 [not run] require 172.21.15.63:6789:/scratch to be local device 2024-03-26T07:50:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/388 2024-03-26T07:50:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/388 2024-03-26T07:50:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:55.774 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:55.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:55.823 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-03-26T07:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:56.378 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:56.379 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:56.382 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:56.383 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi063.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-03-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/389 2024-03-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/389 2024-03-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:57.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:57.047 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-03-26T07:50:57.608 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:57.621 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:57.622 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:57.625 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:57.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:58.304 INFO:teuthology.orchestra.run.smithi063.stdout:generic/390 [not run] ceph does not support freezing 2024-03-26T07:50:58.317 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/390 2024-03-26T07:50:58.317 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/390 2024-03-26T07:50:58.317 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:58.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:58.366 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-03-26T07:50:58.898 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:50:58.909 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:50:58.911 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:50:58.914 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:50:58.914 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:59.566 INFO:teuthology.orchestra.run.smithi063.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:50:59.581 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/391 2024-03-26T07:50:59.581 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/391 2024-03-26T07:50:59.582 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:50:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:50:59.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:50:59.639 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-03-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:00.987 INFO:teuthology.orchestra.run.smithi063.stdout:generic/392 [not run] ceph does not support shutdown 2024-03-26T07:51:01.009 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/392 2024-03-26T07:51:01.009 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/392 2024-03-26T07:51:01.009 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:01.018 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:01.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:01.053 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-03-26T07:51:01.625 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:01.638 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:01.640 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:01.643 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:03.265 INFO:teuthology.orchestra.run.smithi063.stdout:generic/393 - output mismatch (see /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/393.out.bad) 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: --- tests/generic/393.out 2024-03-26 06:18:43.857449657 +0000 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: +++ /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/393.out.bad 2024-03-26 07:51:03.263246997 +0000 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: @@ -27,8 +27,7 @@ 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: * 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: 000030 00 00 >..< 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: 000032 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: -000000 58 58 58 58 00 00 00 00 00 00 00 00 00 00 00 00 >XXXX............< 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: -000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: +000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: * 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: 000030 00 00 >..< 2024-03-26T07:51:03.273 INFO:teuthology.orchestra.run.smithi063.stdout: 000032 2024-03-26T07:51:03.274 INFO:teuthology.orchestra.run.smithi063.stdout: @@ -39,7 +38,6 @@ 2024-03-26T07:51:03.274 INFO:teuthology.orchestra.run.smithi063.stdout: 000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-26T07:51:03.274 INFO:teuthology.orchestra.run.smithi063.stdout: * 2024-03-26T07:51:03.274 INFO:teuthology.orchestra.run.smithi063.stdout: 001000 2024-03-26T07:51:03.274 INFO:teuthology.orchestra.run.smithi063.stdout: -000000 58 58 58 58 00 00 00 00 00 00 00 00 00 00 00 00 >XXXX............< 2024-03-26T07:51:03.274 INFO:teuthology.orchestra.run.smithi063.stdout: -000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-26T07:51:03.274 INFO:teuthology.orchestra.run.smithi063.stdout: +000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-26T07:51:03.274 INFO:teuthology.orchestra.run.smithi063.stdout: * 2024-03-26T07:51:03.274 INFO:teuthology.orchestra.run.smithi063.stdout: 001000 2024-03-26T07:51:03.279 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/393 2024-03-26T07:51:03.279 INFO:teuthology.orchestra.run.smithi063.stdout:Failures: generic/393 2024-03-26T07:51:03.279 INFO:teuthology.orchestra.run.smithi063.stdout:Failed 1 of 1 tests 2024-03-26T07:51:03.286 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:03.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T07:51:03.308 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-26T07:51:03.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-26T07:51:03.309 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-03-26T07:51:03.880 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:03.895 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:03.896 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:03.899 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:03.900 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:04.578 INFO:teuthology.orchestra.run.smithi063.stdout:generic/394 0s 2024-03-26T07:51:04.593 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/394 2024-03-26T07:51:04.593 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:04.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:04.709 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-03-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:05.676 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:07.915 INFO:teuthology.orchestra.run.smithi063.stdout:generic/395 2s 2024-03-26T07:51:07.950 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/395 2024-03-26T07:51:07.950 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:07.963 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:07.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:07.998 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-03-26T07:51:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:08.597 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:08.598 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:08.601 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:08.601 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:09.915 INFO:teuthology.orchestra.run.smithi063.stdout:generic/396 1s 2024-03-26T07:51:09.930 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/396 2024-03-26T07:51:09.930 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:09.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:09.962 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-03-26T07:51:10.525 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:10.535 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:10.537 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:10.539 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:10.540 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:12.835 INFO:teuthology.orchestra.run.smithi063.stdout:generic/397 2s 2024-03-26T07:51:12.848 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/397 2024-03-26T07:51:12.848 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:12.855 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:12.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:12.879 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-03-26T07:51:13.407 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:13.420 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:13.422 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:13.425 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:13.426 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:14.634 INFO:teuthology.orchestra.run.smithi063.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2024-03-26T07:51:14.647 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/398 2024-03-26T07:51:14.647 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/398 2024-03-26T07:51:14.647 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:14.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:14.757 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-03-26T07:51:15.484 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:15.497 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:15.498 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:15.501 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:15.501 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:16.483 INFO:teuthology.orchestra.run.smithi063.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2024-03-26T07:51:16.495 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/399 2024-03-26T07:51:16.495 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/399 2024-03-26T07:51:16.495 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:16.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:16.550 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-03-26T07:51:17.105 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:17.120 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:17.121 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:17.738 INFO:teuthology.orchestra.run.smithi063.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T07:51:17.749 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/400 2024-03-26T07:51:17.749 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/400 2024-03-26T07:51:17.750 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:17.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:17.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:17.800 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-03-26T07:51:18.343 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:18.357 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:18.358 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:18.361 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:18.361 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:generic/401 1s 2024-03-26T07:51:19.493 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/401 2024-03-26T07:51:19.495 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:19.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:19.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:19.570 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-03-26T07:51:20.162 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:20.176 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:20.178 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:20.181 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:20.181 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:21.068 INFO:teuthology.orchestra.run.smithi063.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-03-26T07:51:21.103 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/402 2024-03-26T07:51:21.103 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/402 2024-03-26T07:51:21.103 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:21.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:21.146 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-03-26T07:51:21.712 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:21.726 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:21.727 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:21.731 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:21.731 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:23.062 INFO:teuthology.orchestra.run.smithi063.stdout:generic/403 2s 2024-03-26T07:51:23.078 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/403 2024-03-26T07:51:23.078 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:23.086 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:23.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:23.112 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-03-26T07:51:23.657 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:23.671 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:23.672 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:23.675 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:23.676 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:24.336 INFO:teuthology.orchestra.run.smithi063.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T07:51:24.347 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/404 2024-03-26T07:51:24.347 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/404 2024-03-26T07:51:24.347 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:24.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:24.407 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-03-26T07:51:24.980 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:24.994 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:24.996 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:24.999 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:25.000 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:25.702 INFO:teuthology.orchestra.run.smithi063.stdout:generic/405 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T07:51:25.718 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/405 2024-03-26T07:51:25.718 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/405 2024-03-26T07:51:25.718 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:25.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:25.774 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-03-26T07:51:26.338 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:26.352 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:26.353 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:26.357 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:30.463 INFO:teuthology.orchestra.run.smithi063.stdout:generic/406 4s 2024-03-26T07:51:30.477 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/406 2024-03-26T07:51:30.477 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:30.484 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:30.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:30.507 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-03-26T07:51:31.037 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:31.051 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:31.052 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:31.056 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:31.834 INFO:teuthology.orchestra.run.smithi063.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T07:51:31.847 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/407 2024-03-26T07:51:31.847 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/407 2024-03-26T07:51:31.848 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:31.855 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:31.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:31.943 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-03-26T07:51:32.664 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:32.678 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:32.679 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:32.682 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:32.683 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:33.410 INFO:teuthology.orchestra.run.smithi063.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-26T07:51:33.426 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/408 2024-03-26T07:51:33.426 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/408 2024-03-26T07:51:33.426 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:33.433 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:33.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:33.553 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-03-26T07:51:34.248 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:34.258 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:34.259 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:34.262 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:34.837 INFO:teuthology.orchestra.run.smithi063.stdout:generic/409 [not run] require 172.21.15.63:6789:/scratch to be local device 2024-03-26T07:51:34.848 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/409 2024-03-26T07:51:34.848 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/409 2024-03-26T07:51:34.848 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:34.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:34.896 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-03-26T07:51:35.397 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:35.407 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:35.408 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:35.411 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:35.411 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:35.935 INFO:teuthology.orchestra.run.smithi063.stdout:generic/410 [not run] require 172.21.15.63:6789:/scratch to be local device 2024-03-26T07:51:35.945 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/410 2024-03-26T07:51:35.945 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/410 2024-03-26T07:51:35.945 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:35.953 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:35.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:35.994 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-03-26T07:51:36.515 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:36.528 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:36.532 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:36.532 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:generic/411 [not run] require 172.21.15.63:6789:/scratch to be local device 2024-03-26T07:51:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/411 2024-03-26T07:51:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/411 2024-03-26T07:51:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:37.161 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:37.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:37.202 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-03-26T07:51:37.742 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:37.754 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:37.755 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:37.758 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:37.758 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:38.841 INFO:teuthology.orchestra.run.smithi063.stdout:generic/412 1s 2024-03-26T07:51:38.855 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/412 2024-03-26T07:51:38.855 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:38.862 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:38.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:38.891 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-03-26T07:51:39.456 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:39.469 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:39.471 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:39.474 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:39.474 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:40.216 INFO:teuthology.orchestra.run.smithi063.stdout:generic/413 [not run] mount 172.21.15.63:6789:/scratch with dax failed 2024-03-26T07:51:40.227 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/413 2024-03-26T07:51:40.227 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/413 2024-03-26T07:51:40.228 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:40.235 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:40.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:40.271 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-03-26T07:51:40.790 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:40.802 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:40.803 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:40.806 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:40.806 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:41.740 INFO:teuthology.orchestra.run.smithi063.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:51:41.756 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/414 2024-03-26T07:51:41.756 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/414 2024-03-26T07:51:41.757 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:41.769 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:42.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:42.059 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-03-26T07:51:42.542 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:42.553 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:42.554 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:42.557 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:42.557 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:43.472 INFO:teuthology.orchestra.run.smithi063.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T07:51:43.485 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/415 2024-03-26T07:51:43.485 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/415 2024-03-26T07:51:43.486 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:43.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:43.741 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-03-26T07:51:44.291 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:44.304 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:44.305 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:44.308 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:44.921 INFO:teuthology.orchestra.run.smithi063.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:51:44.934 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/416 2024-03-26T07:51:44.934 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/416 2024-03-26T07:51:44.934 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:44.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:44.983 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-03-26T07:51:45.492 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:45.505 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:45.507 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:45.510 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:45.510 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:46.216 INFO:teuthology.orchestra.run.smithi063.stdout:generic/417 [not run] ceph does not support shutdown 2024-03-26T07:51:46.233 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/417 2024-03-26T07:51:46.233 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/417 2024-03-26T07:51:46.233 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:46.242 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:46.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:46.276 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-03-26T07:51:46.822 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:46.835 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:46.837 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:46.840 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:47.501 INFO:teuthology.orchestra.run.smithi063.stdout:generic/418 [not run] require 172.21.15.63:6789:/test to be valid block disk 2024-03-26T07:51:47.513 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/418 2024-03-26T07:51:47.513 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/418 2024-03-26T07:51:47.513 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:47.522 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:47.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:47.559 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-03-26T07:51:48.117 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:48.130 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:48.132 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:48.135 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:48.135 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:49.105 INFO:teuthology.orchestra.run.smithi063.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2024-03-26T07:51:49.120 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/419 2024-03-26T07:51:49.121 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/419 2024-03-26T07:51:49.121 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:49.131 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:49.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:49.250 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-03-26T07:51:49.926 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:49.939 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:49.941 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:49.943 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:49.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:50.864 INFO:teuthology.orchestra.run.smithi063.stdout:generic/420 0s 2024-03-26T07:51:50.881 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/420 2024-03-26T07:51:50.881 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:51:50.890 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:51:51.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:51:51.014 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-03-26T07:51:51.715 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:51:51.728 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:51:51.730 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:51:51.733 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:51:51.733 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:00.190 INFO:teuthology.orchestra.run.smithi063.stdout:generic/421 9s 2024-03-26T07:52:00.226 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/421 2024-03-26T07:52:00.226 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:52:00.242 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:00.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:52:00.278 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-03-26T07:52:00.898 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:52:00.912 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:52:00.915 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:52:00.918 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:52:00.919 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:01.544 INFO:teuthology.orchestra.run.smithi063.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-26T07:52:01.560 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/422 2024-03-26T07:52:01.560 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/422 2024-03-26T07:52:01.560 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:52:01.571 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:01.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:52:01.621 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-03-26T07:52:02.160 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:52:02.174 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:52:02.176 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:52:02.179 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:52:02.179 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:02.981 INFO:teuthology.orchestra.run.smithi063.stdout:generic/423 0s 2024-03-26T07:52:02.995 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/423 2024-03-26T07:52:02.995 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:52:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:03.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:52:03.111 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-03-26T07:52:03.803 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:52:03.813 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:52:03.814 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:52:03.817 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:52:03.817 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:04.444 INFO:teuthology.orchestra.run.smithi063.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-03-26T07:52:04.454 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/424 2024-03-26T07:52:04.454 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/424 2024-03-26T07:52:04.455 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:52:04.461 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:04.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:52:04.496 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-03-26T07:52:05.027 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:52:05.038 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:52:05.040 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:52:05.042 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:52:05.043 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:05.660 INFO:teuthology.orchestra.run.smithi063.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-03-26T07:52:05.672 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/425 2024-03-26T07:52:05.673 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/425 2024-03-26T07:52:05.673 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:52:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:52:05.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:52:05.785 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-03-26T07:52:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:52:06.564 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:52:06.565 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:52:06.568 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:52:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:18.190 INFO:teuthology.orchestra.run.smithi063.stdout:generic/426 72s 2024-03-26T07:53:18.277 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/426 2024-03-26T07:53:18.277 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:53:18.289 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:18.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:53:18.503 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-03-26T07:53:19.903 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:53:19.911 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:53:20.345 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:53:20.362 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:53:20.364 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:53:20.367 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:53:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:21.283 INFO:teuthology.orchestra.run.smithi063.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T07:53:21.297 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/427 2024-03-26T07:53:21.297 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/427 2024-03-26T07:53:21.297 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:53:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:21.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:53:21.349 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-03-26T07:53:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:53:21.986 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:53:21.988 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:53:21.992 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:53:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:22.768 INFO:teuthology.orchestra.run.smithi063.stdout:generic/428 0s 2024-03-26T07:53:22.787 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/428 2024-03-26T07:53:22.787 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:53:22.797 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:22.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:53:22.860 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-03-26T07:53:23.481 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:53:23.496 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:53:23.497 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:53:23.501 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:53:23.501 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:36.146 INFO:teuthology.orchestra.run.smithi063.stdout:generic/429 13s 2024-03-26T07:53:36.161 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/429 2024-03-26T07:53:36.161 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:53:36.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:36.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:53:36.198 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-03-26T07:53:36.953 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:53:36.963 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:53:36.964 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:53:36.966 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:53:36.966 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:37.870 INFO:teuthology.orchestra.run.smithi063.stdout:generic/430 0s 2024-03-26T07:53:37.887 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/430 2024-03-26T07:53:37.887 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:53:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:38.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:53:38.054 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-03-26T07:53:38.741 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:53:38.753 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:53:38.755 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:53:38.759 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:53:38.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:39.636 INFO:teuthology.orchestra.run.smithi063.stdout:generic/431 1s 2024-03-26T07:53:39.655 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/431 2024-03-26T07:53:39.655 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:53:39.666 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:39.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:53:39.805 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-03-26T07:53:40.474 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:53:40.486 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:53:40.488 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:53:40.490 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:53:40.490 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:41.759 INFO:teuthology.orchestra.run.smithi063.stdout:generic/432 1s 2024-03-26T07:53:41.777 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/432 2024-03-26T07:53:41.777 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:53:41.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:41.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:53:41.885 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-03-26T07:53:42.563 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:53:42.574 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:53:42.576 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:53:42.579 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:53:42.579 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:43.465 INFO:teuthology.orchestra.run.smithi063.stdout:generic/433 1s 2024-03-26T07:53:43.484 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/433 2024-03-26T07:53:43.484 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:53:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:43.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:53:43.623 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-03-26T07:53:44.307 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:53:44.322 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:53:44.323 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:53:44.327 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:53:44.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:45.191 INFO:teuthology.orchestra.run.smithi063.stdout:generic/434 1s 2024-03-26T07:53:45.210 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/434 2024-03-26T07:53:45.210 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T07:53:45.222 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:45.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T07:53:45.357 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-03-26T07:53:46.011 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T07:53:46.023 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T07:53:46.025 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T07:53:46.028 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T07:53:46.028 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T07:53:50.174 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:53:50.181 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:54:20.309 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:54:20.315 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:54:50.911 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:54:50.922 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:54:51.046 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T07:54:51.045+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 362710) UID: 0 2024-03-26T07:54:51.046 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T07:54:51.045+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 362710) UID: 0 2024-03-26T07:54:51.047 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T07:54:51.045+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 362710) UID: 0 2024-03-26T07:54:51.047 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T07:54:51.045+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 362710) UID: 0 2024-03-26T07:58:28.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:58:28.254 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:58:58.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:58:58.631 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:59:28.944 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:59:28.952 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:59:59.069 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T07:59:59.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:00:29.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:00:29.352 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:00:29.529 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T08:00:29.529+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 362851) UID: 0 2024-03-26T08:00:29.535 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T08:00:29.527+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 362851) UID: 0 2024-03-26T08:03:56.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:03:56.588 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:03:56.696 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T08:03:56.695+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48694) UID: 0 2024-03-26T08:03:56.696 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T08:03:56.695+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48694) UID: 0 2024-03-26T08:03:56.697 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T08:03:56.695+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48694) UID: 0 2024-03-26T08:03:56.697 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T08:03:56.695+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48694) UID: 0 2024-03-26T08:07:02.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:07:02.851 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:07:03.046 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T08:07:03.045+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 363080) UID: 0 2024-03-26T08:07:03.047 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T08:07:03.045+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 363080) UID: 0 2024-03-26T08:08:51.500 INFO:teuthology.orchestra.run.smithi063.stdout:generic/435 905s 2024-03-26T08:08:51.515 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/435 2024-03-26T08:08:51.515 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:08:51.523 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:08:51.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:08:51.550 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-03-26T08:08:52.255 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:08:52.289 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:08:52.293 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:08:52.300 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:08:52.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:08:53.702 INFO:teuthology.orchestra.run.smithi063.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T08:08:53.714 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/436 2024-03-26T08:08:53.714 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/436 2024-03-26T08:08:53.714 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:08:53.723 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:08:53.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:08:53.799 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-03-26T08:08:54.511 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:08:54.523 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:08:54.524 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:08:54.527 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:08:54.527 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:08:55.965 INFO:teuthology.orchestra.run.smithi063.stdout:generic/437 1s 2024-03-26T08:08:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/437 2024-03-26T08:08:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:08:55.995 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:08:56.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:08:56.058 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-03-26T08:08:56.597 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:08:56.608 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:08:56.610 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:08:56.612 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:08:56.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:10:39.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:10:39.365 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:10:39.466 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T08:10:39.466+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48741) UID: 0 2024-03-26T08:10:39.467 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T08:10:39.466+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48741) UID: 0 2024-03-26T08:10:39.467 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T08:10:39.466+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48741) UID: 0 2024-03-26T08:10:39.468 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T08:10:39.466+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48741) UID: 0 2024-03-26T08:12:14.906 INFO:teuthology.orchestra.run.smithi063.stdout:generic/438 198s 2024-03-26T08:12:14.967 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/438 2024-03-26T08:12:14.967 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:12:14.980 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:15.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:12:15.041 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-03-26T08:12:15.872 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:12:15.888 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:12:15.890 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:12:15.894 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:12:15.894 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:17.743 INFO:teuthology.orchestra.run.smithi063.stdout:generic/439 1s 2024-03-26T08:12:17.757 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/439 2024-03-26T08:12:17.758 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:12:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:17.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:12:17.794 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-03-26T08:12:18.425 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:12:18.438 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:12:18.439 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:12:18.442 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:12:18.442 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:20.745 INFO:teuthology.orchestra.run.smithi063.stdout:generic/440 2s 2024-03-26T08:12:20.760 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/440 2024-03-26T08:12:20.760 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:12:20.767 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:20.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:12:20.793 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-03-26T08:12:21.409 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:12:21.421 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:12:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:12:21.426 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:12:21.426 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:22.265 INFO:teuthology.orchestra.run.smithi063.stdout:generic/441 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T08:12:22.280 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/441 2024-03-26T08:12:22.280 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/441 2024-03-26T08:12:22.280 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:12:22.290 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:22.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:12:22.333 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-03-26T08:12:22.974 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:12:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:12:22.991 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:12:22.995 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:12:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:23.712 INFO:teuthology.orchestra.run.smithi063.stdout:generic/442 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T08:12:23.725 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/442 2024-03-26T08:12:23.725 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/442 2024-03-26T08:12:23.726 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:12:23.734 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:23.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:12:23.774 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-03-26T08:12:24.415 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:12:24.431 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:12:24.433 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:12:24.437 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:12:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:25.269 INFO:teuthology.orchestra.run.smithi063.stdout:generic/443 1s 2024-03-26T08:12:25.289 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/443 2024-03-26T08:12:25.289 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:12:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:25.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:12:25.358 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-03-26T08:12:26.008 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:12:26.021 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:12:26.022 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:12:26.025 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:12:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:26.909 INFO:teuthology.orchestra.run.smithi063.stdout:generic/444 0s 2024-03-26T08:12:26.928 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/444 2024-03-26T08:12:26.928 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:12:26.937 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:26.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:12:26.990 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-03-26T08:12:27.612 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:12:27.625 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:12:27.627 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:12:27.630 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:12:27.630 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:29.057 INFO:teuthology.orchestra.run.smithi063.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T08:12:29.073 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/445 2024-03-26T08:12:29.073 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/445 2024-03-26T08:12:29.073 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:12:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:12:29.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:12:29.171 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-03-26T08:12:29.858 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:12:29.976 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:12:29.976 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:12:29.976 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:12:29.976 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:02.127 INFO:teuthology.orchestra.run.smithi063.stdout:generic/446 31s 2024-03-26T08:13:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/446 2024-03-26T08:13:02.149 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:02.158 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:02.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:02.187 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-03-26T08:13:02.772 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:02.786 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:02.788 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:02.791 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:02.791 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:03.865 INFO:teuthology.orchestra.run.smithi063.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T08:13:03.890 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/447 2024-03-26T08:13:03.891 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/447 2024-03-26T08:13:03.892 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:03.911 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:04.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:04.038 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-03-26T08:13:04.630 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:04.645 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:04.646 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:04.650 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:06.970 INFO:teuthology.orchestra.run.smithi063.stdout:generic/448 2s 2024-03-26T08:13:06.990 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/448 2024-03-26T08:13:06.990 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:07.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:07.101 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-03-26T08:13:07.819 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:07.834 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:07.836 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:07.840 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:07.840 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:08.649 INFO:teuthology.orchestra.run.smithi063.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T08:13:08.663 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/449 2024-03-26T08:13:08.663 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/449 2024-03-26T08:13:08.664 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:08.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:08.770 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-03-26T08:13:09.474 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:09.487 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:09.489 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:09.492 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:11.800 INFO:teuthology.orchestra.run.smithi063.stdout:generic/450 2s 2024-03-26T08:13:11.819 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/450 2024-03-26T08:13:11.819 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:11.828 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:11.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:11.946 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-03-26T08:13:12.634 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:12.649 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:12.651 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:12.655 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:36.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:13:36.547 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:13:43.586 INFO:teuthology.orchestra.run.smithi063.stdout:generic/451 31s 2024-03-26T08:13:43.602 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/451 2024-03-26T08:13:43.602 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:43.610 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:43.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:43.737 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-03-26T08:13:44.433 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:44.450 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:44.453 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:44.453 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:45.547 INFO:teuthology.orchestra.run.smithi063.stdout:generic/452 1s 2024-03-26T08:13:45.566 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/452 2024-03-26T08:13:45.567 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:45.580 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:45.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:45.616 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-03-26T08:13:46.262 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:46.277 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:46.279 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:46.283 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:46.970 INFO:teuthology.orchestra.run.smithi063.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-03-26T08:13:46.986 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/453 2024-03-26T08:13:46.986 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/453 2024-03-26T08:13:46.987 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:46.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:47.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:47.045 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-03-26T08:13:47.681 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:47.696 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:47.698 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:47.701 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:48.414 INFO:teuthology.orchestra.run.smithi063.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-03-26T08:13:48.430 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/454 2024-03-26T08:13:48.430 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/454 2024-03-26T08:13:48.431 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:48.443 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:48.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:48.504 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-03-26T08:13:49.150 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:49.165 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:49.166 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:49.170 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:49.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:50.036 INFO:teuthology.orchestra.run.smithi063.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-26T08:13:50.053 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/455 2024-03-26T08:13:50.053 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/455 2024-03-26T08:13:50.053 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:50.066 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:50.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:50.126 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-03-26T08:13:50.765 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:50.781 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:50.788 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:50.792 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:50.792 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:51.547 INFO:teuthology.orchestra.run.smithi063.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T08:13:51.564 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/456 2024-03-26T08:13:51.564 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/456 2024-03-26T08:13:51.564 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:51.576 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:51.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:51.635 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-03-26T08:13:52.289 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:52.305 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:52.306 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:52.310 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:52.310 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:53.585 INFO:teuthology.orchestra.run.smithi063.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T08:13:53.610 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/457 2024-03-26T08:13:53.610 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/457 2024-03-26T08:13:53.610 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:53.626 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:53.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:53.686 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-03-26T08:13:54.204 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:54.217 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:54.219 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:54.222 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:54.222 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:55.337 INFO:teuthology.orchestra.run.smithi063.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T08:13:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/458 2024-03-26T08:13:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/458 2024-03-26T08:13:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:55.374 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:55.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:55.489 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-03-26T08:13:56.069 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:56.088 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:57.121 INFO:teuthology.orchestra.run.smithi063.stdout:generic/459 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T08:13:57.135 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/459 2024-03-26T08:13:57.135 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/459 2024-03-26T08:13:57.135 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:13:57.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:13:57.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:13:57.194 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-03-26T08:13:57.818 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:13:57.835 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:13:57.836 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:13:57.841 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:13:57.841 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:14:01.404 INFO:teuthology.orchestra.run.smithi063.stdout:generic/460 3s 2024-03-26T08:14:01.426 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/460 2024-03-26T08:14:01.426 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:14:01.437 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:14:01.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:14:01.472 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-03-26T08:14:02.084 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:14:02.099 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:14:02.101 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:14:02.105 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:14:02.105 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:14:03.028 INFO:teuthology.orchestra.run.smithi063.stdout:generic/461 [not run] ceph does not support shutdown 2024-03-26T08:14:03.042 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/461 2024-03-26T08:14:03.043 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/461 2024-03-26T08:14:03.043 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:14:03.053 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:14:03.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:14:03.100 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-03-26T08:14:03.716 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:14:03.732 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:14:03.734 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:14:03.738 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:14:03.738 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:14:04.599 INFO:teuthology.orchestra.run.smithi063.stdout:generic/462 [not run] mount 172.21.15.63:6789:/scratch with dax failed 2024-03-26T08:14:04.613 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/462 2024-03-26T08:14:04.613 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/462 2024-03-26T08:14:04.613 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:14:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:14:04.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:14:04.667 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-03-26T08:14:05.325 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:14:05.340 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:14:05.341 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:14:05.344 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:14:05.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:14:06.204 INFO:teuthology.orchestra.run.smithi063.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-03-26T08:14:06.221 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/463 2024-03-26T08:14:06.221 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/463 2024-03-26T08:14:06.221 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:14:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:14:06.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:14:06.345 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-03-26T08:14:06.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:14:06.680 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:14:07.078 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:14:07.093 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:14:07.095 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:14:07.098 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:14:07.098 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:14:36.883 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:14:36.897 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:15:06.898 INFO:teuthology.orchestra.run.smithi063.stdout:generic/464 59s 2024-03-26T08:15:06.916 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/464 2024-03-26T08:15:06.916 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:15:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:06.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:15:06.953 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-03-26T08:15:07.082 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:15:07.088 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:15:07.530 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:15:07.542 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:15:07.544 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:15:07.547 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:15:07.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:17.026 INFO:teuthology.orchestra.run.smithi063.stdout:generic/465 8s 2024-03-26T08:15:17.055 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/465 2024-03-26T08:15:17.055 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:15:17.066 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:17.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:15:17.110 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-03-26T08:15:17.726 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:15:17.746 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:15:17.747 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:15:17.752 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:15:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:18.377 INFO:teuthology.orchestra.run.smithi063.stdout:generic/466 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T08:15:18.396 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/466 2024-03-26T08:15:18.396 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/466 2024-03-26T08:15:18.396 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:15:18.406 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:18.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:15:18.453 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-03-26T08:15:19.063 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:15:19.077 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:15:19.079 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:15:19.082 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:15:19.082 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:35.203 INFO:teuthology.orchestra.run.smithi063.stdout:generic/467 16s 2024-03-26T08:15:35.293 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/467 2024-03-26T08:15:35.293 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:15:35.310 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:35.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:15:35.530 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-03-26T08:15:37.211 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:15:37.217 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:15:37.239 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:15:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:15:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:15:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:15:37.256 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:38.254 INFO:teuthology.orchestra.run.smithi063.stdout:generic/468 [not run] ceph does not support shutdown 2024-03-26T08:15:38.282 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/468 2024-03-26T08:15:38.282 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/468 2024-03-26T08:15:38.282 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:15:38.292 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:38.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:15:38.333 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-03-26T08:15:38.976 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:15:38.992 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:15:38.994 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:15:38.999 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:15:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:39.706 INFO:teuthology.orchestra.run.smithi063.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-26T08:15:39.717 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/469 2024-03-26T08:15:39.717 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/469 2024-03-26T08:15:39.717 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:15:39.726 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:39.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:15:39.773 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-03-26T08:15:40.380 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:15:40.402 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:15:40.402 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:41.168 INFO:teuthology.orchestra.run.smithi063.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-26T08:15:41.184 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/470 2024-03-26T08:15:41.184 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/470 2024-03-26T08:15:41.184 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:15:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:15:41.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:15:41.244 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-03-26T08:15:41.859 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:15:41.875 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:15:41.877 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:15:41.882 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:15:41.882 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:07.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:16:07.387 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:16:38.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:16:38.191 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:16:46.567 INFO:teuthology.orchestra.run.smithi063.stdout:generic/471 64s 2024-03-26T08:16:46.583 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/471 2024-03-26T08:16:46.584 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:16:46.592 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:46.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:16:46.666 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-03-26T08:16:47.612 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:16:47.625 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:16:47.626 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:16:47.630 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:16:47.630 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:50.099 INFO:teuthology.orchestra.run.smithi063.stdout:generic/472 [not run] swapfiles are not supported 2024-03-26T08:16:50.116 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/472 2024-03-26T08:16:50.116 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/472 2024-03-26T08:16:50.116 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:16:50.127 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:50.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:16:50.173 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-03-26T08:16:50.772 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:16:50.787 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:16:50.788 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:16:50.792 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:16:50.792 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:51.699 INFO:teuthology.orchestra.run.smithi063.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-26T08:16:51.712 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/473 2024-03-26T08:16:51.712 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/473 2024-03-26T08:16:51.712 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:16:51.722 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:51.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:16:51.768 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-03-26T08:16:52.363 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:16:52.377 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:16:52.378 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:16:52.381 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:16:52.381 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:53.265 INFO:teuthology.orchestra.run.smithi063.stdout:generic/474 [not run] ceph does not support shutdown 2024-03-26T08:16:53.290 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/474 2024-03-26T08:16:53.290 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/474 2024-03-26T08:16:53.290 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:16:53.302 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:53.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:16:53.341 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-03-26T08:16:53.952 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:16:53.968 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:16:53.969 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:16:53.973 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:16:53.973 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:54.751 INFO:teuthology.orchestra.run.smithi063.stdout:generic/475 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T08:16:54.767 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/475 2024-03-26T08:16:54.767 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/475 2024-03-26T08:16:54.767 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T08:16:54.779 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:16:54.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T08:16:54.825 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-03-26T08:16:55.463 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T08:16:55.477 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T08:16:55.479 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T08:16:55.483 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T08:16:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T08:17:08.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:17:08.360 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:17:38.548 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:17:38.559 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:17:38.673 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T08:17:38.676+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487794) UID: 0 2024-03-26T08:17:38.673 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T08:17:38.676+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487794) UID: 0 2024-03-26T08:17:38.673 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T08:17:38.676+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487794) UID: 0 2024-03-26T08:17:38.674 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T08:17:38.676+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487794) UID: 0 2024-03-26T08:23:51.715 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:23:51.725 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:23:52.584 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T08:23:52.589+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 487998) UID: 0 2024-03-26T08:23:52.586 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T08:23:52.591+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 487998) UID: 0 2024-03-26T08:23:52.767 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T08:23:52.772+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49313) UID: 0 2024-03-26T08:23:52.767 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T08:23:52.772+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49313) UID: 0 2024-03-26T08:23:52.768 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T08:23:52.772+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49313) UID: 0 2024-03-26T08:23:52.768 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T08:23:52.772+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49313) UID: 0 2024-03-26T08:29:17.381 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T08:29:17.384+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488070) UID: 0 2024-03-26T08:29:17.383 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T08:29:17.389+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488070) UID: 0 2024-03-26T08:29:17.397 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T08:29:17.386+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488070) UID: 0 2024-03-26T08:29:17.405 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T08:29:17.406+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488070) UID: 0 2024-03-26T08:37:29.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:37:29.287 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:37:29.410 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T08:37:29.418+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49493) UID: 0 2024-03-26T08:37:29.411 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T08:37:29.418+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49493) UID: 0 2024-03-26T08:37:29.411 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T08:37:29.418+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49493) UID: 0 2024-03-26T08:37:29.411 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T08:37:29.418+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49493) UID: 0 2024-03-26T08:37:30.275 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T08:37:30.282+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488160) UID: 0 2024-03-26T08:37:30.278 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T08:37:30.284+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488160) UID: 0 2024-03-26T08:37:30.295 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T08:37:30.303+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488160) UID: 0 2024-03-26T08:37:30.296 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T08:37:30.302+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488160) UID: 0 2024-03-26T08:49:21.215 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:49:21.222 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T08:49:21.347 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T08:49:21.352+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49602) UID: 0 2024-03-26T08:49:21.347 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T08:49:21.352+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49602) UID: 0 2024-03-26T08:49:21.347 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T08:49:21.352+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49602) UID: 0 2024-03-26T08:49:21.348 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T08:49:21.352+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49602) UID: 0 2024-03-26T08:49:22.380 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T08:49:22.386+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 488253) UID: 0 2024-03-26T08:49:22.381 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T08:49:22.386+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 488253) UID: 0 2024-03-26T08:58:31.795 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T08:58:31.796+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488312) UID: 0 2024-03-26T08:58:31.801 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T08:58:31.796+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488312) UID: 0 2024-03-26T08:58:31.808 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T08:58:31.796+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488312) UID: 0 2024-03-26T08:58:31.842 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T08:58:31.841+0000 7fe857200640 -1 Fail to open '/proc/488312/cmdline' error = (2) No such file or directory 2024-03-26T08:58:31.843 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T08:58:31.841+0000 7fe857200640 -1 received signal: Hangup from (PID: 488312) UID: 0 2024-03-26T09:06:02.218 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:06:02.230 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:06:03.006 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T09:06:03.004+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 488417) UID: 0 2024-03-26T09:06:03.008 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T09:06:03.004+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 488417) UID: 0 2024-03-26T09:06:04.365 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T09:06:04.363+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49744) UID: 0 2024-03-26T09:06:04.367 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T09:06:04.367+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49744) UID: 0 2024-03-26T09:06:04.367 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T09:06:04.366+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49744) UID: 0 2024-03-26T09:06:04.372 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T09:06:04.372+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49744) UID: 0 2024-03-26T09:12:58.037 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T09:12:58.036+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488476) UID: 0 2024-03-26T09:12:58.059 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T09:12:58.039+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488476) UID: 0 2024-03-26T09:12:58.059 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T09:12:58.041+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488476) UID: 0 2024-03-26T09:12:58.059 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T09:12:58.043+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488476) UID: 0 2024-03-26T09:23:29.866 INFO:teuthology.orchestra.run.smithi063.stdout:generic/476 3994s 2024-03-26T09:23:29.940 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/476 2024-03-26T09:23:29.940 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:23:29.947 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:23:29.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:23:29.982 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-03-26T09:23:42.181 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:23:42.210 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:23:42.212 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:23:42.216 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:23:42.216 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:27:18.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:27:18.400 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:27:18.736 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T09:27:18.735+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49862) UID: 0 2024-03-26T09:27:18.737 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T09:27:18.735+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49862) UID: 0 2024-03-26T09:27:18.737 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T09:27:18.735+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49862) UID: 0 2024-03-26T09:27:18.737 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T09:27:18.735+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49862) UID: 0 2024-03-26T09:27:20.781 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T09:27:20.779+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 488845) UID: 0 2024-03-26T09:27:20.782 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T09:27:20.780+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 488845) UID: 0 2024-03-26T09:31:46.230 INFO:teuthology.orchestra.run.smithi063.stdout:generic/477 54s 2024-03-26T09:31:46.426 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/477 2024-03-26T09:31:46.426 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:31:46.445 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:31:46.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:31:46.669 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-03-26T09:31:50.056 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:31:50.070 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:31:50.072 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:31:50.076 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:31:50.076 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:02.659 INFO:teuthology.orchestra.run.smithi063.stdout:generic/478 12s 2024-03-26T09:32:02.678 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/478 2024-03-26T09:32:02.679 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:02.692 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:02.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:02.742 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-03-26T09:32:03.393 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:03.409 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:03.411 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:03.415 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:03.415 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:04.418 INFO:teuthology.orchestra.run.smithi063.stdout:generic/479 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:04.428 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/479 2024-03-26T09:32:04.429 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/479 2024-03-26T09:32:04.429 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:04.440 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:04.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:04.516 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-03-26T09:32:05.097 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:05.110 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:05.112 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:05.115 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:05.115 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:generic/480 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/480 2024-03-26T09:32:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/480 2024-03-26T09:32:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:05.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:05.933 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-03-26T09:32:06.581 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:06.595 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:06.596 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:06.602 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:07.342 INFO:teuthology.orchestra.run.smithi063.stdout:generic/481 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:07.354 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/481 2024-03-26T09:32:07.354 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/481 2024-03-26T09:32:07.354 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:07.367 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:07.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:07.403 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-03-26T09:32:08.093 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:08.113 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:08.114 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:08.119 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:08.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:08.975 INFO:teuthology.orchestra.run.smithi063.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-26T09:32:08.984 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/482 2024-03-26T09:32:08.985 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/482 2024-03-26T09:32:08.985 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:09.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:09.048 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-03-26T09:32:09.707 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:09.725 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:09.726 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:09.729 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:10.494 INFO:teuthology.orchestra.run.smithi063.stdout:generic/483 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:10.509 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/483 2024-03-26T09:32:10.509 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/483 2024-03-26T09:32:10.509 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:10.519 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:10.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:10.565 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-03-26T09:32:11.158 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:11.171 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:11.173 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:11.176 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:12.399 INFO:teuthology.orchestra.run.smithi063.stdout:generic/484 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:12.413 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/484 2024-03-26T09:32:12.413 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/484 2024-03-26T09:32:12.413 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:12.423 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:12.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:12.462 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-03-26T09:32:13.511 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:13.523 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:13.525 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:13.528 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:13.528 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:14.292 INFO:teuthology.orchestra.run.smithi063.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-26T09:32:14.305 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/485 2024-03-26T09:32:14.305 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/485 2024-03-26T09:32:14.305 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:14.316 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:14.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:14.371 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-03-26T09:32:15.006 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:15.020 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:15.023 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:15.025 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:15.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:16.219 INFO:teuthology.orchestra.run.smithi063.stdout:generic/486 1s 2024-03-26T09:32:16.237 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/486 2024-03-26T09:32:16.237 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:16.246 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:16.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:16.276 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-03-26T09:32:16.927 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:16.939 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:16.940 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:16.943 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:16.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:17.705 INFO:teuthology.orchestra.run.smithi063.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-03-26T09:32:17.718 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/487 2024-03-26T09:32:17.718 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/487 2024-03-26T09:32:17.718 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:17.726 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:17.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:17.772 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-03-26T09:32:18.432 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:18.448 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:18.450 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:18.455 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:18.455 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:19.110 INFO:teuthology.orchestra.run.smithi063.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-26T09:32:19.124 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/488 2024-03-26T09:32:19.124 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/488 2024-03-26T09:32:19.124 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:19.132 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:19.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:19.182 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-03-26T09:32:19.865 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:19.883 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:19.884 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:19.887 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:19.887 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:generic/489 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:20.649 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/489 2024-03-26T09:32:20.649 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/489 2024-03-26T09:32:20.649 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:20.657 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:20.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:20.706 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-03-26T09:32:21.385 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:21.405 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:21.407 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:21.410 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:21.411 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:23.970 INFO:teuthology.orchestra.run.smithi063.stdout:generic/490 2s 2024-03-26T09:32:23.991 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/490 2024-03-26T09:32:23.992 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:24.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:24.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:24.174 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-03-26T09:32:24.992 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:25.006 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:25.008 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:25.012 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:25.012 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout:generic/491 [not run] ceph does not support freezing 2024-03-26T09:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/491 2024-03-26T09:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/491 2024-03-26T09:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:25.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:25.876 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-03-26T09:32:26.545 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:26.557 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:26.559 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:26.563 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:27.289 INFO:teuthology.orchestra.run.smithi063.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-03-26T09:32:27.303 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/492 2024-03-26T09:32:27.303 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/492 2024-03-26T09:32:27.303 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:27.314 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:27.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:27.359 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-03-26T09:32:28.037 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:28.053 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:28.057 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:28.060 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:28.060 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:29.192 INFO:teuthology.orchestra.run.smithi063.stdout:generic/493 [not run] swapfiles are not supported 2024-03-26T09:32:29.205 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/493 2024-03-26T09:32:29.205 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/493 2024-03-26T09:32:29.205 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:29.214 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:29.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:29.282 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-03-26T09:32:29.923 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:29.939 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:29.940 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:29.943 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:29.943 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:30.992 INFO:teuthology.orchestra.run.smithi063.stdout:generic/494 [not run] swapfiles are not supported 2024-03-26T09:32:31.006 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/494 2024-03-26T09:32:31.006 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/494 2024-03-26T09:32:31.007 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:31.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:31.071 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-03-26T09:32:31.762 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:31.777 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:31.779 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:31.783 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:31.783 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:32.860 INFO:teuthology.orchestra.run.smithi063.stdout:generic/495 [not run] swapfiles are not supported 2024-03-26T09:32:32.877 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/495 2024-03-26T09:32:32.877 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/495 2024-03-26T09:32:32.877 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:32.890 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:32.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:32.948 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-03-26T09:32:33.616 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:33.634 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:33.634 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:33.638 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:34.672 INFO:teuthology.orchestra.run.smithi063.stdout:generic/496 [not run] swapfiles are not supported 2024-03-26T09:32:34.683 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/496 2024-03-26T09:32:34.683 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/496 2024-03-26T09:32:34.683 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:34.694 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:34.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:34.740 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-03-26T09:32:35.383 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:35.403 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:35.405 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:35.409 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:35.409 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:36.417 INFO:teuthology.orchestra.run.smithi063.stdout:generic/497 [not run] swapfiles are not supported 2024-03-26T09:32:36.434 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/497 2024-03-26T09:32:36.434 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/497 2024-03-26T09:32:36.434 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:36.442 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:36.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:36.489 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-03-26T09:32:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:37.177 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:37.960 INFO:teuthology.orchestra.run.smithi063.stdout:generic/498 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:37.972 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/498 2024-03-26T09:32:37.973 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/498 2024-03-26T09:32:37.973 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:38.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:38.052 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-03-26T09:32:38.729 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:38.742 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:38.744 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:38.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:39.456 INFO:teuthology.orchestra.run.smithi063.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-26T09:32:39.470 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/499 2024-03-26T09:32:39.470 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/499 2024-03-26T09:32:39.470 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:39.481 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:39.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:39.535 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-03-26T09:32:40.173 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:40.189 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:40.192 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:40.197 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:40.197 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:41.003 INFO:teuthology.orchestra.run.smithi063.stdout:generic/500 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:41.020 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/500 2024-03-26T09:32:41.020 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/500 2024-03-26T09:32:41.020 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:41.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:41.079 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-03-26T09:32:41.727 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:41.741 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:41.746 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:41.747 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:41.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:42.920 INFO:teuthology.orchestra.run.smithi063.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T09:32:42.944 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/501 2024-03-26T09:32:42.944 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/501 2024-03-26T09:32:42.944 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:42.970 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:43.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:43.148 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-03-26T09:32:43.857 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:43.873 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:43.874 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:43.878 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:43.878 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:44.645 INFO:teuthology.orchestra.run.smithi063.stdout:generic/502 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:44.656 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/502 2024-03-26T09:32:44.656 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/502 2024-03-26T09:32:44.656 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:44.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:44.722 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-03-26T09:32:45.259 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:45.271 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:45.273 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:45.276 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:45.276 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:46.218 INFO:teuthology.orchestra.run.smithi063.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T09:32:46.232 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/503 2024-03-26T09:32:46.232 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/503 2024-03-26T09:32:46.232 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:46.241 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:46.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:46.298 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-03-26T09:32:46.922 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:46.936 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:46.938 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:46.941 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:46.941 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:48.271 INFO:teuthology.orchestra.run.smithi063.stdout:generic/504 1s 2024-03-26T09:32:48.292 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/504 2024-03-26T09:32:48.292 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:48.302 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:48.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:48.366 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-03-26T09:32:49.015 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:49.031 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:49.033 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:49.037 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:49.037 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:49.992 INFO:teuthology.orchestra.run.smithi063.stdout:generic/505 [not run] ceph does not support shutdown 2024-03-26T09:32:50.015 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/505 2024-03-26T09:32:50.015 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/505 2024-03-26T09:32:50.015 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:50.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:50.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:50.076 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-03-26T09:32:50.681 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:50.697 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:50.699 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:50.702 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:50.702 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:51.432 INFO:teuthology.orchestra.run.smithi063.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-26T09:32:51.443 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/506 2024-03-26T09:32:51.443 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/506 2024-03-26T09:32:51.444 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:51.454 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:51.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:51.500 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-03-26T09:32:52.143 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:52.161 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:52.162 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:52.165 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:52.165 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:52.935 INFO:teuthology.orchestra.run.smithi063.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-03-26T09:32:52.951 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/507 2024-03-26T09:32:52.951 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/507 2024-03-26T09:32:52.951 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:52.960 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:53.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:53.022 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-03-26T09:32:53.651 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:53.665 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:53.667 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:53.669 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:53.669 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:54.474 INFO:teuthology.orchestra.run.smithi063.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-03-26T09:32:54.485 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/508 2024-03-26T09:32:54.486 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/508 2024-03-26T09:32:54.486 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:54.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:54.535 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-03-26T09:32:55.209 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:55.224 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:55.226 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:55.229 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:55.229 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:55.972 INFO:teuthology.orchestra.run.smithi063.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-03-26T09:32:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/509 2024-03-26T09:32:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/509 2024-03-26T09:32:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:55.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:56.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:56.043 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-03-26T09:32:56.675 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:56.691 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:56.694 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:56.699 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:56.699 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:57.420 INFO:teuthology.orchestra.run.smithi063.stdout:generic/510 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:32:57.433 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/510 2024-03-26T09:32:57.433 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/510 2024-03-26T09:32:57.433 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:57.445 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:57.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:57.491 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-03-26T09:32:58.180 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:58.201 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:58.202 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:58.207 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:58.207 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-26T09:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/511 2024-03-26T09:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/511 2024-03-26T09:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:32:59.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:32:59.041 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-03-26T09:32:59.711 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:32:59.726 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T09:33:00.502 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/512 2024-03-26T09:33:00.502 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/512 2024-03-26T09:33:00.503 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:33:00.511 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:00.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:33:00.568 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-03-26T09:33:01.155 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:01.168 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:01.170 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:01.172 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:02.288 INFO:teuthology.orchestra.run.smithi063.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T09:33:02.304 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/513 2024-03-26T09:33:02.304 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/513 2024-03-26T09:33:02.305 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:33:02.315 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:02.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:33:02.609 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-03-26T09:33:03.325 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:03.339 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:03.341 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:03.345 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:03.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:04.458 INFO:teuthology.orchestra.run.smithi063.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T09:33:04.480 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/514 2024-03-26T09:33:04.480 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/514 2024-03-26T09:33:04.480 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:33:04.496 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:04.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:33:04.711 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-03-26T09:33:05.400 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:05.416 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:05.418 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:05.422 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:05.422 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:06.550 INFO:teuthology.orchestra.run.smithi063.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T09:33:06.574 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/515 2024-03-26T09:33:06.577 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/515 2024-03-26T09:33:06.578 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:33:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:06.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:33:06.835 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-03-26T09:33:07.568 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:07.587 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:07.589 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:07.593 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:07.593 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:08.484 INFO:teuthology.orchestra.run.smithi063.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-26T09:33:08.499 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/516 2024-03-26T09:33:08.499 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/516 2024-03-26T09:33:08.499 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:33:08.511 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:08.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:33:08.630 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-03-26T09:33:09.533 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:09.548 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:09.549 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:09.552 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:10.580 INFO:teuthology.orchestra.run.smithi063.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-26T09:33:10.688 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/517 2024-03-26T09:33:10.688 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/517 2024-03-26T09:33:10.688 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:33:10.706 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:11.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:33:11.001 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-03-26T09:33:11.728 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:11.745 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:11.747 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:11.751 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:11.751 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:12.843 INFO:teuthology.orchestra.run.smithi063.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T09:33:12.862 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/518 2024-03-26T09:33:12.863 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/518 2024-03-26T09:33:12.863 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:33:12.874 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:13.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:33:13.178 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-03-26T09:33:13.901 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:13.913 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:13.915 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:13.918 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:14.678 INFO:teuthology.orchestra.run.smithi063.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-03-26T09:33:14.689 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/519 2024-03-26T09:33:14.689 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/519 2024-03-26T09:33:14.689 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:33:14.700 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:14.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:33:14.835 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-03-26T09:33:15.686 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:15.704 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:15.709 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:15.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:16.448 INFO:teuthology.orchestra.run.smithi063.stdout:generic/520 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T09:33:16.464 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/520 2024-03-26T09:33:16.465 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/520 2024-03-26T09:33:16.465 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T09:33:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:16.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T09:33:16.520 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-03-26T09:33:17.163 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:17.181 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:17.182 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:17.186 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:23.771 INFO:teuthology.orchestra.run.smithi063.stdout:generic/521 - output mismatch (see /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/521.out.bad) 2024-03-26T09:33:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: --- tests/generic/521.out 2024-03-26 06:18:43.879449436 +0000 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +++ /tmp/tmp.W8GLtFOA0Cxfstests-dev/results//generic/521.out.bad 2024-03-26 09:33:23.477374501 +0000 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: @@ -1,2 +1,870 @@ 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: QA output created by 521 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +READ BAD DATA: offset = 0x20000, size = 0x1763d, fname = /tmp/tmp.LsIyRsPUXptest/junk 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +OFFSET GOOD BAD RANGE 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25000 0x2e79 0x0000 0x0 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25001 0x792e 0x0000 0x1 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25002 0x2ec6 0x0000 0x2 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25003 0xc62e 0x0000 0x3 2024-03-26T09:33:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25004 0x2ecb 0x0000 0x4 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25005 0xcb2e 0x0000 0x5 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25006 0x2ec1 0x0000 0x6 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25007 0xc12e 0x0000 0x7 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25008 0x2e1b 0x0000 0x8 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +0x25009 0x1b2e 0x0000 0x9 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2500a 0x2eba 0x0000 0xa 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2500b 0xba2e 0x0000 0xb 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2500c 0x2e35 0x0000 0xc 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2500d 0x352e 0x0000 0xd 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2500e 0x2e22 0x0000 0xe 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +0x2500f 0x222e 0x0000 0xf 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +LOG DUMP (830 total operations): 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +1( 1 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +2( 2 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +3( 3 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: +4( 4 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +5( 5 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +6( 6 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +7( 7 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +8( 8 mod 256): WRITE 0x22000 thru 0x30fff (0xf000 bytes) HOLE 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +9( 9 mod 256): COPY 0x10000 thru 0x13fff (0x4000 bytes) to 0x1d000 thru 0x20fff 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +10( 10 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +11( 11 mod 256): MAPREAD 0x24000 thru 0x3003e (0xc03f bytes) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +12( 12 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +13( 13 mod 256): PUNCH 0x2d45e thru 0x30fff (0x3ba2 bytes) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +14( 14 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +15( 15 mod 256): MAPWRITE 0x36000 thru 0x4560b (0xf60c bytes) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +16( 16 mod 256): READ 0x33000 thru 0x3dfff (0xb000 bytes) 2024-03-26T09:33:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: +17( 17 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +18( 18 mod 256): MAPWRITE 0x19000 thru 0x193f3 (0x3f4 bytes) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +19( 19 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +20( 20 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +21( 21 mod 256): PUNCH 0x1ae7 thru 0x1a63d (0x18b57 bytes) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +22( 22 mod 256): MAPREAD 0x3a000 thru 0x44a15 (0xaa16 bytes) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +23( 23 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +24( 24 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +25( 25 mod 256): TRUNCATE DOWN from 0x4560c to 0x7000 ******WWWW 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +26( 26 mod 256): MAPWRITE 0x4c000 thru 0x55149 (0x914a bytes) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +27( 27 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +28( 28 mod 256): MAPREAD 0x47000 thru 0x54d16 (0xdd17 bytes) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +29( 29 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +30( 30 mod 256): MAPWRITE 0x3c000 thru 0x49a1b (0xda1c bytes) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +31( 31 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +32( 32 mod 256): MAPWRITE 0x10000 thru 0x150aa (0x50ab bytes) 2024-03-26T09:33:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: +33( 33 mod 256): WRITE 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +34( 34 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +35( 35 mod 256): MAPWRITE 0x48000 thru 0x6508e (0x1d08f bytes) 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +36( 36 mod 256): WRITE 0x5c000 thru 0x65fff (0xa000 bytes) EXTEND 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +37( 37 mod 256): MAPREAD 0x27000 thru 0x3b048 (0x14049 bytes) ***RRRR*** 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +38( 38 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +39( 39 mod 256): READ 0x46000 thru 0x51fff (0xc000 bytes) 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +40( 40 mod 256): COPY 0x4e000 thru 0x56fff (0x9000 bytes) to 0x7c000 thru 0x84fff 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +41( 41 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +42( 42 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +43( 43 mod 256): MAPREAD 0x5e000 thru 0x64a50 (0x6a51 bytes) 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +44( 44 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +45( 45 mod 256): COPY 0xe000 thru 0x27fff (0x1a000 bytes) to 0x66000 thru 0x7ffff 2024-03-26T09:33:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: +46( 46 mod 256): READ 0x65000 thru 0x77fff (0x13000 bytes) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +47( 47 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +48( 48 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +49( 49 mod 256): PUNCH 0x596d1 thru 0x6b80b (0x1213b bytes) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +50( 50 mod 256): TRUNCATE DOWN from 0x85000 to 0x5b000 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +51( 51 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +52( 52 mod 256): COPY 0x3e000 thru 0x54fff (0x17000 bytes) to 0x1000 thru 0x17fff 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +53( 53 mod 256): PUNCH 0x577b5 thru 0x5afff (0x384b bytes) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +54( 54 mod 256): WRITE 0x23000 thru 0x2efff (0xc000 bytes) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +55( 55 mod 256): MAPWRITE 0x76000 thru 0x8c071 (0x16072 bytes) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +56( 56 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +57( 57 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +58( 58 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: +59( 59 mod 256): TRUNCATE DOWN from 0x8c072 to 0x60000 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +60( 60 mod 256): WRITE 0x6000 thru 0x20fff (0x1b000 bytes) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +61( 61 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +62( 62 mod 256): MAPREAD 0x38000 thru 0x45d49 (0xdd4a bytes) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +63( 63 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +64( 64 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +65( 65 mod 256): MAPWRITE 0x11000 thru 0x269d8 (0x159d9 bytes) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +66( 66 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +67( 67 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +68( 68 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +69( 69 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +70( 70 mod 256): WRITE 0x13000 thru 0x16fff (0x4000 bytes) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +71( 71 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: +72( 72 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +73( 73 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +74( 74 mod 256): READ 0x1b000 thru 0x35fff (0x1b000 bytes) ***RRRR*** 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +75( 75 mod 256): TRUNCATE DOWN from 0x60000 to 0x25000 ******WWWW 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +76( 76 mod 256): WRITE 0x7c000 thru 0x90fff (0x15000 bytes) HOLE ***WWWW 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +77( 77 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +78( 78 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +79( 79 mod 256): MAPWRITE 0x69000 thru 0x71243 (0x8244 bytes) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +80( 80 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +81( 81 mod 256): PUNCH 0x69b2d thru 0x7afb8 (0x1148c bytes) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +82( 82 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +83( 83 mod 256): WRITE 0x22000 thru 0x28fff (0x7000 bytes) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +84( 84 mod 256): PUNCH 0x8a709 thru 0x90fff (0x68f7 bytes) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +85( 85 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: +86( 86 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +87( 87 mod 256): READ 0x6d000 thru 0x82fff (0x16000 bytes) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +88( 88 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +89( 89 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +90( 90 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +91( 91 mod 256): READ 0x77000 thru 0x8ffff (0x19000 bytes) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +92( 92 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +93( 93 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +94( 94 mod 256): PUNCH 0x63b87 thru 0x7b27d (0x176f7 bytes) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +95( 95 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +96( 96 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +97( 97 mod 256): TRUNCATE DOWN from 0x91000 to 0x65000 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +98( 98 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: +99( 99 mod 256): WRITE 0x45000 thru 0x58fff (0x14000 bytes) 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +100(100 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +101(101 mod 256): COPY 0x63000 thru 0x63fff (0x1000 bytes) to 0x8c000 thru 0x8cfff 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +102(102 mod 256): PUNCH 0x18832 thru 0x1bf75 (0x3744 bytes) 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +103(103 mod 256): MAPREAD 0x9000 thru 0x21b25 (0x18b26 bytes) 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +104(104 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +105(105 mod 256): COPY 0x7f000 thru 0x86fff (0x8000 bytes) to 0x4c000 thru 0x53fff 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +106(106 mod 256): READ 0x40000 thru 0x5bfff (0x1c000 bytes) 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +107(107 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +108(108 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +109(109 mod 256): MAPWRITE 0x4c000 thru 0x6687c (0x1a87d bytes) 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +110(110 mod 256): COPY 0x4e000 thru 0x60fff (0x13000 bytes) to 0x31000 thru 0x43fff ******EEEE 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +111(111 mod 256): READ 0x28000 thru 0x3ffff (0x18000 bytes) ***RRRR*** 2024-03-26T09:33:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: +112(112 mod 256): COPY 0x7e000 thru 0x88fff (0xb000 bytes) to 0x54000 thru 0x5efff 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +113(113 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +114(114 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +115(115 mod 256): MAPREAD 0x72000 thru 0x734d9 (0x14da bytes) 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +116(116 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +117(117 mod 256): TRUNCATE DOWN from 0x8d000 to 0x45000 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +118(118 mod 256): MAPWRITE 0x63000 thru 0x7e96c (0x1b96d bytes) 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +119(119 mod 256): MAPREAD 0xa000 thru 0x159f1 (0xb9f2 bytes) 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +120(120 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +121(121 mod 256): PUNCH 0x526ef thru 0x704e6 (0x1ddf8 bytes) 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +122(122 mod 256): READ 0x1b000 thru 0x39fff (0x1f000 bytes) ***RRRR*** 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +123(123 mod 256): MAPWRITE 0x3d000 thru 0x43244 (0x6245 bytes) 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +124(124 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: +125(125 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +126(126 mod 256): COPY 0x1000 thru 0x9fff (0x9000 bytes) to 0x29000 thru 0x31fff ******EEEE 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +127(127 mod 256): MAPREAD 0x4000 thru 0x20757 (0x1c758 bytes) 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +128(128 mod 256): MAPWRITE 0x4b000 thru 0x5509f (0xa0a0 bytes) 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +129(129 mod 256): READ 0x2e000 thru 0x3afff (0xd000 bytes) ***RRRR*** 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +130(130 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +131(131 mod 256): COPY 0x0 thru 0x19fff (0x1a000 bytes) to 0x3d000 thru 0x56fff 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +132(132 mod 256): TRUNCATE DOWN from 0x7e96d to 0x43000 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +133(133 mod 256): TRUNCATE UP from 0x43000 to 0x4d000 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +134(134 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +135(135 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +136(136 mod 256): PUNCH 0x1a9 thru 0x1e771 (0x1e5c9 bytes) 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +137(137 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: +138(138 mod 256): TRUNCATE DOWN from 0x4d000 to 0x29000 ******WWWW 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +139(139 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +140(140 mod 256): WRITE 0x2b000 thru 0x47fff (0x1d000 bytes) HOLE ***WWWW 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +141(141 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +142(142 mod 256): WRITE 0x48000 thru 0x5cfff (0x15000 bytes) EXTEND 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +143(143 mod 256): TRUNCATE DOWN from 0x5d000 to 0x4e000 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +144(144 mod 256): WRITE 0x29000 thru 0x31fff (0x9000 bytes) ***WWWW 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +145(145 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +146(146 mod 256): MAPWRITE 0x4f000 thru 0x6b9ce (0x1c9cf bytes) 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +147(147 mod 256): MAPREAD 0xd000 thru 0x28c40 (0x1bc41 bytes) 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +148(148 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +149(149 mod 256): COPY 0x10000 thru 0x1bfff (0xc000 bytes) to 0x4e000 thru 0x59fff 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +150(150 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +151(151 mod 256): TRUNCATE DOWN from 0x6b9cf to 0x32000 2024-03-26T09:33:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: +152(152 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +153(153 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +154(154 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +155(155 mod 256): MAPWRITE 0x16000 thru 0x1aba0 (0x4ba1 bytes) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +156(156 mod 256): MAPWRITE 0xd000 thru 0x1aab1 (0xdab2 bytes) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +157(157 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +158(158 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +159(159 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +160(160 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +161(161 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +162(162 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +163(163 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: +164(164 mod 256): MAPWRITE 0x7c000 thru 0x869ce (0xa9cf bytes) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +165(165 mod 256): MAPWRITE 0x81000 thru 0x92686 (0x11687 bytes) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +166(166 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +167(167 mod 256): MAPWRITE 0x14000 thru 0x22c4c (0xec4d bytes) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +168(168 mod 256): COPY 0x66000 thru 0x73fff (0xe000 bytes) to 0x2c000 thru 0x39fff ******EEEE 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +169(169 mod 256): MAPREAD 0x0 thru 0xe22d (0xe22e bytes) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +170(170 mod 256): READ 0x6000 thru 0x13fff (0xe000 bytes) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +171(171 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +172(172 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +173(173 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +174(174 mod 256): PUNCH 0x687b4 thru 0x7bfbb (0x13808 bytes) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +175(175 mod 256): MAPWRITE 0x42000 thru 0x45834 (0x3835 bytes) 2024-03-26T09:33:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: +176(176 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +177(177 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +178(178 mod 256): WRITE 0x4c000 thru 0x59fff (0xe000 bytes) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +179(179 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +180(180 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +181(181 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +182(182 mod 256): MAPWRITE 0x82000 thru 0x91e43 (0xfe44 bytes) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +183(183 mod 256): MAPWRITE 0x3000 thru 0x1c423 (0x19424 bytes) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +184(184 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +185(185 mod 256): READ 0x47000 thru 0x54fff (0xe000 bytes) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +186(186 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +187(187 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +188(188 mod 256): PUNCH 0x79b5b thru 0x92686 (0x18b2c bytes) 2024-03-26T09:33:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: +189(189 mod 256): MAPREAD 0x8f000 thru 0x9191d (0x291e bytes) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +190(190 mod 256): READ 0x30000 thru 0x4dfff (0x1e000 bytes) ***RRRR*** 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +191(191 mod 256): PUNCH 0x3ca80 thru 0x4c976 (0xfef7 bytes) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +192(192 mod 256): PUNCH 0x2efdf thru 0x4b682 (0x1c6a4 bytes) ******PPPP 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +193(193 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +194(194 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +195(195 mod 256): TRUNCATE DOWN from 0x92687 to 0x0 ******WWWW 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +196(196 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +197(197 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +198(198 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +199(199 mod 256): MAPWRITE 0x27000 thru 0x2e9e2 (0x79e3 bytes) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +200(200 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +201(201 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +202(202 mod 256): TRUNCATE UP from 0x2e9e3 to 0x49000 ******WWWW 2024-03-26T09:33:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: +203(203 mod 256): PUNCH 0x22734 thru 0x22e7f (0x74c bytes) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +204(204 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +205(205 mod 256): READ 0x23000 thru 0x3cfff (0x1a000 bytes) ***RRRR*** 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +206(206 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +207(207 mod 256): MAPWRITE 0x38000 thru 0x41796 (0x9797 bytes) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +208(208 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +209(209 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +210(210 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +211(211 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +212(212 mod 256): READ 0x35000 thru 0x47fff (0x13000 bytes) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +213(213 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +214(214 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +215(215 mod 256): READ 0x7000 thru 0x12fff (0xc000 bytes) 2024-03-26T09:33:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: +216(216 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +217(217 mod 256): MAPWRITE 0x7c000 thru 0x8b2b7 (0xf2b8 bytes) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +218(218 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +219(219 mod 256): READ 0x2b000 thru 0x31fff (0x7000 bytes) ***RRRR*** 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +220(220 mod 256): PUNCH 0x35e03 thru 0x434cf (0xd6cd bytes) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +221(221 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +222(222 mod 256): MAPREAD 0x57000 thru 0x5ad8a (0x3d8b bytes) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +223(223 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +224(224 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +225(225 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +226(226 mod 256): PUNCH 0x10ace thru 0x21f5e (0x11491 bytes) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +227(227 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +228(228 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +229(229 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: +230(230 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +231(231 mod 256): READ 0x33000 thru 0x3ffff (0xd000 bytes) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +232(232 mod 256): MAPREAD 0x74000 thru 0x78243 (0x4244 bytes) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +233(233 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +234(234 mod 256): TRUNCATE DOWN from 0x8b2b8 to 0x9000 ******WWWW 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +235(235 mod 256): READ 0x3000 thru 0x3fff (0x1000 bytes) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +236(236 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +237(237 mod 256): TRUNCATE UP from 0x9000 to 0x3d000 ******WWWW 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +238(238 mod 256): TRUNCATE DOWN from 0x3d000 to 0x9000 ******WWWW 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +239(239 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +240(240 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +241(241 mod 256): PUNCH 0x78 thru 0x8fff (0x8f88 bytes) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +242(242 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: +243(243 mod 256): READ 0x1000 thru 0x7fff (0x7000 bytes) 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +244(244 mod 256): MAPREAD 0x3000 thru 0x807f (0x5080 bytes) 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +245(245 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +246(246 mod 256): MAPREAD 0x2000 thru 0x86e1 (0x66e2 bytes) 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +247(247 mod 256): TRUNCATE UP from 0x9000 to 0x70000 ******WWWW 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +248(248 mod 256): READ 0x24000 thru 0x3efff (0x1b000 bytes) ***RRRR*** 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +249(249 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +250(250 mod 256): TRUNCATE DOWN from 0x70000 to 0x16000 ******WWWW 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +251(251 mod 256): WRITE 0x52000 thru 0x62fff (0x11000 bytes) HOLE ***WWWW 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +252(252 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +253(253 mod 256): READ 0x1e000 thru 0x29fff (0xc000 bytes) 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +254(254 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: +255(255 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +256( 0 mod 256): COPY 0x2000 thru 0x1efff (0x1d000 bytes) to 0x20000 thru 0x3cfff ******EEEE 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +257( 1 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +258( 2 mod 256): READ 0x2c000 thru 0x45fff (0x1a000 bytes) ***RRRR*** 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +259( 3 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +260( 4 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +261( 5 mod 256): MAPREAD 0x61000 thru 0x6137d (0x37e bytes) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +262( 6 mod 256): MAPWRITE 0x87000 thru 0x92405 (0xb406 bytes) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +263( 7 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +264( 8 mod 256): MAPWRITE 0x2a000 thru 0x3ded3 (0x13ed4 bytes) ******WWWW 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +265( 9 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +266( 10 mod 256): PUNCH 0x19b78 thru 0x336f8 (0x19b81 bytes) ******PPPP 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +267( 11 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +268( 12 mod 256): WRITE 0x53000 thru 0x5cfff (0xa000 bytes) 2024-03-26T09:33:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: +269( 13 mod 256): MAPWRITE 0x12000 thru 0x13f19 (0x1f1a bytes) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +270( 14 mod 256): WRITE 0x61000 thru 0x76fff (0x16000 bytes) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +271( 15 mod 256): COPY 0x49000 thru 0x57fff (0xf000 bytes) to 0x3000 thru 0x11fff 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +272( 16 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +273( 17 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +274( 18 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +275( 19 mod 256): MAPWRITE 0x1e000 thru 0x308b2 (0x128b3 bytes) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +276( 20 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +277( 21 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +278( 22 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +279( 23 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +280( 24 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +281( 25 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: +282( 26 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +283( 27 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +284( 28 mod 256): MAPREAD 0x65000 thru 0x79535 (0x14536 bytes) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +285( 29 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +286( 30 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +287( 31 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +288( 32 mod 256): MAPREAD 0x21000 thru 0x26f69 (0x5f6a bytes) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +289( 33 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +290( 34 mod 256): READ 0x8000 thru 0x1efff (0x17000 bytes) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +291( 35 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +292( 36 mod 256): PUNCH 0x3f05c thru 0x4ee10 (0xfdb5 bytes) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +293( 37 mod 256): WRITE 0x10000 thru 0x16fff (0x7000 bytes) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +294( 38 mod 256): WRITE 0x1f000 thru 0x2bfff (0xd000 bytes) 2024-03-26T09:33:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: +295( 39 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +296( 40 mod 256): PUNCH 0x72109 thru 0x7d0b2 (0xafaa bytes) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +297( 41 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +298( 42 mod 256): PUNCH 0x76ee6 thru 0x92405 (0x1b520 bytes) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +299( 43 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +300( 44 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +301( 45 mod 256): TRUNCATE DOWN from 0x92406 to 0x6e000 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +302( 46 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +303( 47 mod 256): PUNCH 0x2971f thru 0x3df33 (0x14815 bytes) ******PPPP 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +304( 48 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +305( 49 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +306( 50 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +307( 51 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +308( 52 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.808 INFO:teuthology.orchestra.run.smithi063.stdout: +309( 53 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +310( 54 mod 256): MAPREAD 0x5c000 thru 0x6d3e3 (0x113e4 bytes) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +311( 55 mod 256): TRUNCATE DOWN from 0x6e000 to 0x2a000 ******WWWW 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +312( 56 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +313( 57 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +314( 58 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +315( 59 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +316( 60 mod 256): WRITE 0x77000 thru 0x8ffff (0x19000 bytes) HOLE ***WWWW 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +317( 61 mod 256): PUNCH 0x5e7c3 thru 0x76756 (0x17f94 bytes) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +318( 62 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +319( 63 mod 256): WRITE 0x27000 thru 0x41fff (0x1b000 bytes) ***WWWW 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +320( 64 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +321( 65 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: +322( 66 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +323( 67 mod 256): COPY 0x5000 thru 0x18fff (0x14000 bytes) to 0x2c000 thru 0x3ffff ******EEEE 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +324( 68 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +325( 69 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +326( 70 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +327( 71 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +328( 72 mod 256): MAPREAD 0x17000 thru 0x1a4b1 (0x34b2 bytes) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +329( 73 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +330( 74 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +331( 75 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +332( 76 mod 256): MAPREAD 0x36000 thru 0x4cd42 (0x16d43 bytes) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +333( 77 mod 256): MAPREAD 0x4b000 thru 0x4e81d (0x381e bytes) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +334( 78 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: +335( 79 mod 256): TRUNCATE DOWN from 0x90000 to 0x10000 ******WWWW 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +336( 80 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +337( 81 mod 256): TRUNCATE UP from 0x10000 to 0x4e000 ******WWWW 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +338( 82 mod 256): PUNCH 0x3f6d7 thru 0x4dfff (0xe929 bytes) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +339( 83 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +340( 84 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +341( 85 mod 256): MAPWRITE 0x8000 thru 0x1c360 (0x14361 bytes) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +342( 86 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +343( 87 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +344( 88 mod 256): TRUNCATE DOWN from 0x4e000 to 0x34000 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +345( 89 mod 256): MAPREAD 0x6000 thru 0x1ef1b (0x18f1c bytes) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +346( 90 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +347( 91 mod 256): READ 0x2a000 thru 0x2dfff (0x4000 bytes) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +348( 92 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: +349( 93 mod 256): COPY 0xb000 thru 0xffff (0x5000 bytes) to 0x15000 thru 0x19fff 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +350( 94 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +351( 95 mod 256): READ 0x19000 thru 0x21fff (0x9000 bytes) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +352( 96 mod 256): TRUNCATE UP from 0x34000 to 0x46000 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +353( 97 mod 256): WRITE 0x59000 thru 0x69fff (0x11000 bytes) HOLE 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +354( 98 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +355( 99 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +356(100 mod 256): MAPWRITE 0x1e000 thru 0x322fe (0x142ff bytes) ******WWWW 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +357(101 mod 256): READ 0x18000 thru 0x2efff (0x17000 bytes) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +358(102 mod 256): MAPWRITE 0xc000 thru 0x2964d (0x1d64e bytes) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +359(103 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +360(104 mod 256): TRUNCATE DOWN from 0x6a000 to 0x17000 ******WWWW 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +361(105 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +362(106 mod 256): MAPWRITE 0x7b000 thru 0x88d75 (0xdd76 bytes) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +363(107 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: +364(108 mod 256): READ 0x6e000 thru 0x82fff (0x15000 bytes) 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +365(109 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +366(110 mod 256): TRUNCATE DOWN from 0x88d76 to 0x1c000 ******WWWW 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +367(111 mod 256): MAPWRITE 0x53000 thru 0x61b1c (0xeb1d bytes) 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +368(112 mod 256): WRITE 0x28000 thru 0x44fff (0x1d000 bytes) ***WWWW 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +369(113 mod 256): MAPREAD 0x4a000 thru 0x5fc64 (0x15c65 bytes) 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +370(114 mod 256): WRITE 0x12000 thru 0x1afff (0x9000 bytes) 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +371(115 mod 256): READ 0x49000 thru 0x51fff (0x9000 bytes) 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +372(116 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +373(117 mod 256): PUNCH 0x3c666 thru 0x465a7 (0x9f42 bytes) 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +374(118 mod 256): COPY 0x32000 thru 0x46fff (0x15000 bytes) to 0x70000 thru 0x84fff 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +375(119 mod 256): COPY 0x76000 thru 0x82fff (0xd000 bytes) to 0x35000 thru 0x41fff 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +376(120 mod 256): PUNCH 0x2a81b thru 0x36fff (0xc7e5 bytes) ******PPPP 2024-03-26T09:33:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: +377(121 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +378(122 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +379(123 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +380(124 mod 256): PUNCH 0x2b911 thru 0x34b0d (0x91fd bytes) ******PPPP 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +381(125 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +382(126 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +383(127 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +384(128 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +385(129 mod 256): READ 0x5a000 thru 0x72fff (0x19000 bytes) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +386(130 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +387(131 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +388(132 mod 256): PUNCH 0x25629 thru 0x3133e (0xbd16 bytes) ******PPPP 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +389(133 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +390(134 mod 256): TRUNCATE DOWN from 0x85000 to 0x7c000 2024-03-26T09:33:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: +391(135 mod 256): READ 0x1a000 thru 0x22fff (0x9000 bytes) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +392(136 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +393(137 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +394(138 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +395(139 mod 256): COPY 0x73000 thru 0x78fff (0x6000 bytes) to 0x86000 thru 0x8bfff 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +396(140 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +397(141 mod 256): MAPWRITE 0x5b000 thru 0x79e8e (0x1ee8f bytes) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +398(142 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +399(143 mod 256): COPY 0x3e000 thru 0x4dfff (0x10000 bytes) to 0x76000 thru 0x85fff 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +400(144 mod 256): MAPREAD 0x40000 thru 0x54a6b (0x14a6c bytes) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +401(145 mod 256): MAPREAD 0x46000 thru 0x5ccd8 (0x16cd9 bytes) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +402(146 mod 256): COPY 0x38000 thru 0x4cfff (0x15000 bytes) to 0x68000 thru 0x7cfff 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +403(147 mod 256): WRITE 0x7c000 thru 0x80fff (0x5000 bytes) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +404(148 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +405(149 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: +406(150 mod 256): COPY 0x55000 thru 0x5ffff (0xb000 bytes) to 0x3e000 thru 0x48fff 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +407(151 mod 256): PUNCH 0x7d82d thru 0x7f863 (0x2037 bytes) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +408(152 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +409(153 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +410(154 mod 256): MAPREAD 0x2f000 thru 0x3e621 (0xf622 bytes) ***RRRR*** 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +411(155 mod 256): TRUNCATE DOWN from 0x8c000 to 0x62000 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +412(156 mod 256): MAPREAD 0x24000 thru 0x24f4f (0xf50 bytes) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +413(157 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +414(158 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +415(159 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +416(160 mod 256): COPY 0x5b000 thru 0x5dfff (0x3000 bytes) to 0x7b000 thru 0x7dfff 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +417(161 mod 256): PUNCH 0x76e6e thru 0x7dfff (0x7192 bytes) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +418(162 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +419(163 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: +420(164 mod 256): TRUNCATE DOWN from 0x7e000 to 0x51000 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +421(165 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +422(166 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +423(167 mod 256): WRITE 0x2d000 thru 0x37fff (0xb000 bytes) ***WWWW 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +424(168 mod 256): READ 0x21000 thru 0x3dfff (0x1d000 bytes) ***RRRR*** 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +425(169 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +426(170 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +427(171 mod 256): PUNCH 0x47a87 thru 0x50fff (0x9579 bytes) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +428(172 mod 256): MAPREAD 0x7000 thru 0x10074 (0x9075 bytes) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +429(173 mod 256): READ 0x12000 thru 0x29fff (0x18000 bytes) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +430(174 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +431(175 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +432(176 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +433(177 mod 256): PUNCH 0x4e7ae thru 0x50fff (0x2852 bytes) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +434(178 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: +435(179 mod 256): TRUNCATE DOWN from 0x51000 to 0x3a000 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +436(180 mod 256): TRUNCATE DOWN from 0x3a000 to 0x25000 ******WWWW 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +437(181 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +438(182 mod 256): WRITE 0x23000 thru 0x32fff (0x10000 bytes) EXTEND ***WWWW 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +439(183 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +440(184 mod 256): MAPWRITE 0x86000 thru 0x91a0c (0xba0d bytes) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +441(185 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +442(186 mod 256): MAPREAD 0x3d000 thru 0x3e7ba (0x17bb bytes) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +443(187 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +444(188 mod 256): MAPWRITE 0x6000 thru 0x23f60 (0x1df61 bytes) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +445(189 mod 256): PUNCH 0x80a2a thru 0x91a0c (0x10fe3 bytes) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +446(190 mod 256): PUNCH 0x853c1 thru 0x91a0c (0xc64c bytes) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +447(191 mod 256): PUNCH 0xde62 thru 0x29c0d (0x1bdac bytes) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +448(192 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +449(193 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: +450(194 mod 256): READ 0x16000 thru 0x1efff (0x9000 bytes) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +451(195 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +452(196 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +453(197 mod 256): READ 0x8d000 thru 0x90fff (0x4000 bytes) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +454(198 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +455(199 mod 256): PUNCH 0x1fc73 thru 0x22521 (0x28af bytes) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +456(200 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +457(201 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +458(202 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +459(203 mod 256): MAPREAD 0x47000 thru 0x5ff18 (0x18f19 bytes) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +460(204 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +461(205 mod 256): READ 0x35000 thru 0x51fff (0x1d000 bytes) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +462(206 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +463(207 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +464(208 mod 256): MAPREAD 0x4000 thru 0xc069 (0x806a bytes) 2024-03-26T09:33:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: +465(209 mod 256): WRITE 0x90000 thru 0x90fff (0x1000 bytes) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +466(210 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +467(211 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +468(212 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +469(213 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +470(214 mod 256): MAPWRITE 0x5d000 thru 0x76508 (0x19509 bytes) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +471(215 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +472(216 mod 256): TRUNCATE DOWN from 0x91a0d to 0x71000 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +473(217 mod 256): PUNCH 0x9757 thru 0x19864 (0x1010e bytes) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +474(218 mod 256): PUNCH 0x319e2 thru 0x47ceb (0x1630a bytes) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +475(219 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +476(220 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +477(221 mod 256): READ 0x58000 thru 0x6afff (0x13000 bytes) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +478(222 mod 256): MAPREAD 0x55000 thru 0x70dcc (0x1bdcd bytes) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +479(223 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +480(224 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: +481(225 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +482(226 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +483(227 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +484(228 mod 256): MAPWRITE 0x23000 thru 0x3edfb (0x1bdfc bytes) ******WWWW 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +485(229 mod 256): COPY 0x61000 thru 0x6afff (0xa000 bytes) to 0x1e000 thru 0x27fff 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +486(230 mod 256): MAPREAD 0x6a000 thru 0x70f87 (0x6f88 bytes) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +487(231 mod 256): READ 0x56000 thru 0x58fff (0x3000 bytes) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +488(232 mod 256): PUNCH 0x3f839 thru 0x57c5e (0x18426 bytes) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +489(233 mod 256): COPY 0x2d000 thru 0x49fff (0x1d000 bytes) to 0x5f000 thru 0x7bfff EEEE****** 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +490(234 mod 256): WRITE 0x46000 thru 0x5bfff (0x16000 bytes) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +491(235 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +492(236 mod 256): PUNCH 0x6ab7b thru 0x7bfff (0x11485 bytes) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +493(237 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: +494(238 mod 256): PUNCH 0x6be94 thru 0x744c0 (0x862d bytes) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +495(239 mod 256): READ 0x4d000 thru 0x50fff (0x4000 bytes) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +496(240 mod 256): PUNCH 0x744d4 thru 0x7bfff (0x7b2c bytes) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +497(241 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +498(242 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +499(243 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +500(244 mod 256): MAPWRITE 0x82000 thru 0x83bdc (0x1bdd bytes) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +501(245 mod 256): MAPWRITE 0x57000 thru 0x64485 (0xd486 bytes) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +502(246 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +503(247 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +504(248 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +505(249 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +506(250 mod 256): PUNCH 0x4ecb2 thru 0x5b5da (0xc929 bytes) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +507(251 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +508(252 mod 256): PUNCH 0x704b thru 0x9da7 (0x2d5d bytes) 2024-03-26T09:33:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: +509(253 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +510(254 mod 256): WRITE 0x8f000 thru 0x91fff (0x3000 bytes) HOLE 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +511(255 mod 256): MAPWRITE 0x31000 thru 0x3285b (0x185c bytes) ******WWWW 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +512( 0 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +513( 1 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +514( 2 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +515( 3 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +516( 4 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +517( 5 mod 256): MAPWRITE 0x5e000 thru 0x6c6b5 (0xe6b6 bytes) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +518( 6 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +519( 7 mod 256): MAPWRITE 0x39000 thru 0x3e7b0 (0x57b1 bytes) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +520( 8 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +521( 9 mod 256): TRUNCATE DOWN from 0x92000 to 0x57000 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +522( 10 mod 256): MAPWRITE 0x71000 thru 0x76e34 (0x5e35 bytes) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +523( 11 mod 256): MAPREAD 0x37000 thru 0x53938 (0x1c939 bytes) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +524( 12 mod 256): MAPREAD 0x53000 thru 0x630f9 (0x100fa bytes) 2024-03-26T09:33:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: +525( 13 mod 256): READ 0x2000 thru 0x1dfff (0x1c000 bytes) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +526( 14 mod 256): PUNCH 0x630f6 thru 0x76e34 (0x13d3f bytes) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +527( 15 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +528( 16 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +529( 17 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +530( 18 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +531( 19 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +532( 20 mod 256): PUNCH 0x74907 thru 0x76e34 (0x252e bytes) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +533( 21 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +534( 22 mod 256): MAPWRITE 0x1000 thru 0x7536 (0x6537 bytes) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +535( 23 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +536( 24 mod 256): MAPWRITE 0x36000 thru 0x37a89 (0x1a8a bytes) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +537( 25 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +538( 26 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +539( 27 mod 256): READ 0xe000 thru 0x2afff (0x1d000 bytes) 2024-03-26T09:33:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: +540( 28 mod 256): READ 0x12000 thru 0x2ffff (0x1e000 bytes) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +541( 29 mod 256): MAPWRITE 0x2f000 thru 0x46867 (0x17868 bytes) ******WWWW 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +542( 30 mod 256): COPY 0x54000 thru 0x6dfff (0x1a000 bytes) to 0x25000 thru 0x3efff ******EEEE 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +543( 31 mod 256): PUNCH 0x4d8ff thru 0x6104b (0x1374d bytes) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +544( 32 mod 256): TRUNCATE DOWN from 0x76e35 to 0xd000 ******WWWW 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +545( 33 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +546( 34 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +547( 35 mod 256): MAPREAD 0xc000 thru 0xc729 (0x72a bytes) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +548( 36 mod 256): MAPWRITE 0x3000 thru 0x1f73d (0x1c73e bytes) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +549( 37 mod 256): MAPREAD 0xf000 thru 0x1f418 (0x10419 bytes) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +550( 38 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +551( 39 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +552( 40 mod 256): MAPREAD 0x2000 thru 0x1eb07 (0x1cb08 bytes) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +553( 41 mod 256): WRITE 0x6000 thru 0xbfff (0x6000 bytes) 2024-03-26T09:33:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: +554( 42 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +555( 43 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +556( 44 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +557( 45 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +558( 46 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +559( 47 mod 256): MAPWRITE 0x5000 thru 0x1d211 (0x18212 bytes) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +560( 48 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +561( 49 mod 256): COPY 0x6000 thru 0x10fff (0xb000 bytes) to 0x32000 thru 0x3cfff 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +562( 50 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +563( 51 mod 256): TRUNCATE DOWN from 0x3d000 to 0x15000 ******WWWW 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +564( 52 mod 256): COPY 0x12000 thru 0x13fff (0x2000 bytes) to 0x7e000 thru 0x7ffff 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +565( 53 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +566( 54 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +567( 55 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +568( 56 mod 256): COPY 0x2f000 thru 0x41fff (0x13000 bytes) to 0x75000 thru 0x87fff EEEE****** 2024-03-26T09:33:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: +569( 57 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +570( 58 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +571( 59 mod 256): PUNCH 0x75c7 thru 0x1bfca (0x14a04 bytes) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +572( 60 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +573( 61 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +574( 62 mod 256): COPY 0x14000 thru 0x2bfff (0x18000 bytes) to 0x4e000 thru 0x65fff 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +575( 63 mod 256): PUNCH 0x4c37d thru 0x5b1ce (0xee52 bytes) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +576( 64 mod 256): MAPREAD 0x2e000 thru 0x3bad5 (0xdad6 bytes) ***RRRR*** 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +577( 65 mod 256): TRUNCATE DOWN from 0x88000 to 0x16000 ******WWWW 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +578( 66 mod 256): READ 0x3000 thru 0x5fff (0x3000 bytes) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +579( 67 mod 256): MAPWRITE 0x74000 thru 0x88b65 (0x14b66 bytes) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +580( 68 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +581( 69 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +582( 70 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +583( 71 mod 256): MAPWRITE 0x7a000 thru 0x86fc5 (0xcfc6 bytes) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +584( 72 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: +585( 73 mod 256): MAPREAD 0x28000 thru 0x33e2c (0xbe2d bytes) ***RRRR*** 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +586( 74 mod 256): PUNCH 0x27f21 thru 0x3d3bc (0x1549c bytes) ******PPPP 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +587( 75 mod 256): WRITE 0x14000 thru 0x1efff (0xb000 bytes) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +588( 76 mod 256): WRITE 0x36000 thru 0x38fff (0x3000 bytes) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +589( 77 mod 256): MAPREAD 0x6e000 thru 0x82d07 (0x14d08 bytes) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +590( 78 mod 256): COPY 0x72000 thru 0x77fff (0x6000 bytes) to 0x4b000 thru 0x50fff 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +591( 79 mod 256): PUNCH 0x868b0 thru 0x88b65 (0x22b6 bytes) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +592( 80 mod 256): PUNCH 0x5b35c thru 0x79e86 (0x1eb2b bytes) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +593( 81 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +594( 82 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +595( 83 mod 256): READ 0x8000 thru 0x1afff (0x13000 bytes) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +596( 84 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +597( 85 mod 256): PUNCH 0x2dd7f thru 0x396ea (0xb96c bytes) ******PPPP 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +598( 86 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: +599( 87 mod 256): MAPREAD 0x41000 thru 0x502bd (0xf2be bytes) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +600( 88 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +601( 89 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +602( 90 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +603( 91 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +604( 92 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +605( 93 mod 256): WRITE 0x40000 thru 0x5bfff (0x1c000 bytes) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +606( 94 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +607( 95 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +608( 96 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +609( 97 mod 256): TRUNCATE DOWN from 0x88b66 to 0x32000 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +610( 98 mod 256): COPY 0x9000 thru 0x11fff (0x9000 bytes) to 0x59000 thru 0x61fff 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +611( 99 mod 256): COPY 0x28000 thru 0x32fff (0xb000 bytes) to 0x52000 thru 0x5cfff EEEE****** 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +612(100 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +613(101 mod 256): TRUNCATE UP from 0x62000 to 0x6a000 2024-03-26T09:33:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: +614(102 mod 256): TRUNCATE DOWN from 0x6a000 to 0x37000 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +615(103 mod 256): PUNCH 0x12bf7 thru 0x13be1 (0xfeb bytes) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +616(104 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +617(105 mod 256): MAPWRITE 0x2e000 thru 0x4adf7 (0x1cdf8 bytes) ******WWWW 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +618(106 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +619(107 mod 256): MAPREAD 0x3000 thru 0xaccf (0x7cd0 bytes) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +620(108 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +621(109 mod 256): TRUNCATE DOWN from 0x4adf8 to 0x1d000 ******WWWW 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +622(110 mod 256): MAPWRITE 0x6f000 thru 0x7cd26 (0xdd27 bytes) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +623(111 mod 256): WRITE 0x2000 thru 0x11fff (0x10000 bytes) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +624(112 mod 256): TRUNCATE DOWN from 0x7cd27 to 0x6000 ******WWWW 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +625(113 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +626(114 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +627(115 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: +628(116 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +629(117 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +630(118 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +631(119 mod 256): WRITE 0x0 thru 0x6fff (0x7000 bytes) EXTEND 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +632(120 mod 256): COPY 0x2000 thru 0x5fff (0x4000 bytes) to 0x69000 thru 0x6cfff 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +633(121 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +634(122 mod 256): TRUNCATE DOWN from 0x6d000 to 0x2c000 ******WWWW 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +635(123 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +636(124 mod 256): COPY 0x17000 thru 0x2afff (0x14000 bytes) to 0x6b000 thru 0x7efff 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +637(125 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +638(126 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +639(127 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +640(128 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +641(129 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +642(130 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +643(131 mod 256): COPY 0x18000 thru 0x2dfff (0x16000 bytes) to 0x63000 thru 0x78fff 2024-03-26T09:33:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: +644(132 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +645(133 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +646(134 mod 256): MAPREAD 0x28000 thru 0x3f7c8 (0x177c9 bytes) ***RRRR*** 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +647(135 mod 256): PUNCH 0x7e7d thru 0x1458d (0xc711 bytes) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +648(136 mod 256): MAPREAD 0x40000 thru 0x41799 (0x179a bytes) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +649(137 mod 256): READ 0x3e000 thru 0x3ffff (0x2000 bytes) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +650(138 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +651(139 mod 256): WRITE 0x74000 thru 0x8bfff (0x18000 bytes) EXTEND 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +652(140 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +653(141 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +654(142 mod 256): COPY 0x40000 thru 0x54fff (0x15000 bytes) to 0x55000 thru 0x69fff 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +655(143 mod 256): MAPWRITE 0x28000 thru 0x292f8 (0x12f9 bytes) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +656(144 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +657(145 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +658(146 mod 256): MAPWRITE 0x5b000 thru 0x66f4e (0xbf4f bytes) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +659(147 mod 256): WRITE 0x59000 thru 0x5cfff (0x4000 bytes) 2024-03-26T09:33:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: +660(148 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +661(149 mod 256): MAPWRITE 0x5f000 thru 0x6bfc1 (0xcfc2 bytes) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +662(150 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +663(151 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +664(152 mod 256): MAPWRITE 0x38000 thru 0x4130c (0x930d bytes) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +665(153 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +666(154 mod 256): COPY 0x84000 thru 0x8afff (0x7000 bytes) to 0x51000 thru 0x57fff 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +667(155 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +668(156 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +669(157 mod 256): PUNCH 0x54aa thru 0x1cd89 (0x178e0 bytes) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +670(158 mod 256): WRITE 0x5c000 thru 0x77fff (0x1c000 bytes) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +671(159 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +672(160 mod 256): READ 0x31000 thru 0x35fff (0x5000 bytes) ***RRRR*** 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +673(161 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: +674(162 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +675(163 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +676(164 mod 256): TRUNCATE DOWN from 0x8c000 to 0x20000 ******WWWW 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +677(165 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +678(166 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +679(167 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +680(168 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +681(169 mod 256): WRITE 0x71000 thru 0x83fff (0x13000 bytes) HOLE ***WWWW 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +682(170 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +683(171 mod 256): COPY 0x76000 thru 0x81fff (0xc000 bytes) to 0x28000 thru 0x33fff ******EEEE 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +684(172 mod 256): TRUNCATE DOWN from 0x84000 to 0x4e000 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +685(173 mod 256): WRITE 0xd000 thru 0x24fff (0x18000 bytes) 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +686(174 mod 256): TRUNCATE DOWN from 0x4e000 to 0x28000 ******WWWW 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +687(175 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: +688(176 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +689(177 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +690(178 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +691(179 mod 256): MAPREAD 0x1a000 thru 0x277bc (0xd7bd bytes) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +692(180 mod 256): MAPREAD 0x9000 thru 0xcb68 (0x3b69 bytes) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +693(181 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +694(182 mod 256): READ 0xb000 thru 0x14fff (0xa000 bytes) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +695(183 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +696(184 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +697(185 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +698(186 mod 256): READ 0x21000 thru 0x26fff (0x6000 bytes) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +699(187 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +700(188 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +701(189 mod 256): MAPWRITE 0x8b000 thru 0x8b298 (0x299 bytes) 2024-03-26T09:33:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: +702(190 mod 256): COPY 0x88000 thru 0x89fff (0x2000 bytes) to 0x4f000 thru 0x50fff 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +703(191 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +704(192 mod 256): WRITE 0x8b000 thru 0x90fff (0x6000 bytes) EXTEND 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +705(193 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +706(194 mod 256): PUNCH 0x7c0d2 thru 0x90fff (0x14f2e bytes) 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +707(195 mod 256): MAPWRITE 0x6a000 thru 0x800a6 (0x160a7 bytes) 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +708(196 mod 256): COPY 0x87000 thru 0x8ffff (0x9000 bytes) to 0x78000 thru 0x80fff 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +709(197 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +710(198 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +711(199 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +712(200 mod 256): TRUNCATE DOWN from 0x91000 to 0x8f000 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +713(201 mod 256): WRITE 0x1c000 thru 0x2ffff (0x14000 bytes) 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +714(202 mod 256): WRITE 0x15000 thru 0x1bfff (0x7000 bytes) 2024-03-26T09:33:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: +715(203 mod 256): PUNCH 0x65e48 thru 0x70f3b (0xb0f4 bytes) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +716(204 mod 256): WRITE 0x8c000 thru 0x91fff (0x6000 bytes) EXTEND 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +717(205 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +718(206 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +719(207 mod 256): READ 0x44000 thru 0x44fff (0x1000 bytes) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +720(208 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +721(209 mod 256): PUNCH 0x38f7e thru 0x535ef (0x1a672 bytes) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +722(210 mod 256): COPY 0x5f000 thru 0x7cfff (0x1e000 bytes) to 0x7000 thru 0x24fff 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +723(211 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +724(212 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +725(213 mod 256): READ 0x49000 thru 0x56fff (0xe000 bytes) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +726(214 mod 256): MAPREAD 0x54000 thru 0x6cc57 (0x18c58 bytes) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +727(215 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +728(216 mod 256): TRUNCATE DOWN from 0x92000 to 0x6c000 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +729(217 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +730(218 mod 256): READ 0x4d000 thru 0x4dfff (0x1000 bytes) 2024-03-26T09:33:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: +731(219 mod 256): MAPWRITE 0x3a000 thru 0x3ac91 (0xc92 bytes) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +732(220 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +733(221 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +734(222 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +735(223 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +736(224 mod 256): WRITE 0x40000 thru 0x5bfff (0x1c000 bytes) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +737(225 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +738(226 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +739(227 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +740(228 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +741(229 mod 256): MAPREAD 0x47000 thru 0x51512 (0xa513 bytes) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +742(230 mod 256): MAPREAD 0x64000 thru 0x692c6 (0x52c7 bytes) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +743(231 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: +744(232 mod 256): COPY 0x50000 thru 0x67fff (0x18000 bytes) to 0x34000 thru 0x4bfff 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +745(233 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +746(234 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +747(235 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +748(236 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +749(237 mod 256): COPY 0x22000 thru 0x2ffff (0xe000 bytes) to 0x41000 thru 0x4efff 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +750(238 mod 256): TRUNCATE UP from 0x6c000 to 0x8d000 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +751(239 mod 256): TRUNCATE DOWN from 0x8d000 to 0x2c000 ******WWWW 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +752(240 mod 256): READ 0x1d000 thru 0x21fff (0x5000 bytes) 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +753(241 mod 256): TRUNCATE UP from 0x2c000 to 0x59000 ******WWWW 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +754(242 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +755(243 mod 256): MAPWRITE 0x25000 thru 0x381d3 (0x131d4 bytes) ******WWWW 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +756(244 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: +757(245 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +758(246 mod 256): MAPREAD 0x2000 thru 0x1b877 (0x19878 bytes) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +759(247 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +760(248 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +761(249 mod 256): MAPREAD 0x4b000 thru 0x58134 (0xd135 bytes) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +762(250 mod 256): PUNCH 0x3bedb thru 0x53a9a (0x17bc0 bytes) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +763(251 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +764(252 mod 256): TRUNCATE UP from 0x59000 to 0x77000 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +765(253 mod 256): MAPWRITE 0x33000 thru 0x4e768 (0x1b769 bytes) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +766(254 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +767(255 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +768( 0 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +769( 1 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +770( 2 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +771( 3 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: +772( 4 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +773( 5 mod 256): PUNCH 0xd883 thru 0x2c47e (0x1ebfc bytes) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +774( 6 mod 256): MAPWRITE 0x53000 thru 0x67a76 (0x14a77 bytes) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +775( 7 mod 256): MAPREAD 0x11000 thru 0x11f5b (0xf5c bytes) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +776( 8 mod 256): TRUNCATE DOWN from 0x77000 to 0x65000 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +777( 9 mod 256): MAPREAD 0x10000 thru 0x28136 (0x18137 bytes) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +778( 10 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +779( 11 mod 256): READ 0x22000 thru 0x30fff (0xf000 bytes) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +780( 12 mod 256): WRITE 0x87000 thru 0x90fff (0xa000 bytes) HOLE 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +781( 13 mod 256): READ 0x4b000 thru 0x69fff (0x1f000 bytes) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +782( 14 mod 256): WRITE 0x77000 thru 0x7afff (0x4000 bytes) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +783( 15 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +784( 16 mod 256): TRUNCATE DOWN from 0x91000 to 0x24000 ******WWWW 2024-03-26T09:33:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: +785( 17 mod 256): PUNCH 0x1ace4 thru 0x23fff (0x931c bytes) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +786( 18 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +787( 19 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +788( 20 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +789( 21 mod 256): READ 0x20000 thru 0x22fff (0x3000 bytes) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +790( 22 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +791( 23 mod 256): MAPWRITE 0x79000 thru 0x920ad (0x190ae bytes) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +792( 24 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +793( 25 mod 256): READ 0x1e000 thru 0x22fff (0x5000 bytes) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +794( 26 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +795( 27 mod 256): WRITE 0x2000 thru 0x4fff (0x3000 bytes) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +796( 28 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +797( 29 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +798( 30 mod 256): COPY 0x47000 thru 0x5bfff (0x15000 bytes) to 0x6e000 thru 0x82fff 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +799( 31 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +800( 32 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: +801( 33 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +802( 34 mod 256): COPY 0x4f000 thru 0x5afff (0xc000 bytes) to 0x7c000 thru 0x87fff 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +803( 35 mod 256): PUNCH 0x7471 thru 0xf07d (0x7c0d bytes) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +804( 36 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +805( 37 mod 256): MAPWRITE 0x8d000 thru 0x92500 (0x5501 bytes) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +806( 38 mod 256): MAPWRITE 0x7a000 thru 0x8ac5b (0x10c5c bytes) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +807( 39 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +808( 40 mod 256): MAPREAD 0x58000 thru 0x76fc2 (0x1efc3 bytes) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +809( 41 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +810( 42 mod 256): TRUNCATE DOWN from 0x92501 to 0x2d000 ******WWWW 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +811( 43 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +812( 44 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +813( 45 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +814( 46 mod 256): WRITE 0x25000 thru 0x32fff (0xe000 bytes) EXTEND ***WWWW 2024-03-26T09:33:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: +815( 47 mod 256): READ 0x15000 thru 0x31fff (0x1d000 bytes) ***RRRR*** 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +816( 48 mod 256): MAPWRITE 0x35000 thru 0x504c1 (0x1b4c2 bytes) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +817( 49 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +818( 50 mod 256): MAPREAD 0x19000 thru 0x220e5 (0x90e6 bytes) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +819( 51 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +820( 52 mod 256): PUNCH 0x31008 thru 0x3af70 (0x9f69 bytes) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +821( 53 mod 256): MAPWRITE 0x44000 thru 0x463cc (0x23cd bytes) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +822( 54 mod 256): MAPREAD 0x4b000 thru 0x50246 (0x5247 bytes) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +823( 55 mod 256): COPY 0x3000 thru 0xffff (0xd000 bytes) to 0x66000 thru 0x72fff 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +824( 56 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +825( 57 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +826( 58 mod 256): READ 0x1a000 thru 0x29fff (0x10000 bytes) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +827( 59 mod 256): PUNCH 0x129d thru 0x1d0a5 (0x1be09 bytes) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +828( 60 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: +829( 61 mod 256): SKIPPED (no operation) 2024-03-26T09:33:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: +830( 62 mod 256): MAPREAD 0x20000 thru 0x3763c (0x1763d bytes) ***RRRR*** 2024-03-26T09:33:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: +Log of operations saved to "/tmp/tmp.LsIyRsPUXptest/junk.fsxops"; replay with --replay-ops 2024-03-26T09:33:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: +Correct content saved for comparison 2024-03-26T09:33:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: +(maybe hexdump "/tmp/tmp.LsIyRsPUXptest/junk" vs "/tmp/tmp.LsIyRsPUXptest/junk.fsxgood") 2024-03-26T09:33:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: Silence is golden 2024-03-26T09:33:23.845 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/521 2024-03-26T09:33:23.845 INFO:teuthology.orchestra.run.smithi063.stdout:Failures: generic/521 2024-03-26T09:33:23.846 INFO:teuthology.orchestra.run.smithi063.stdout:Failed 1 of 1 tests 2024-03-26T09:33:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:33:23.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T09:33:23.965 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-26T09:33:23.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-26T09:33:23.965 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-03-26T09:33:24.753 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T09:33:24.766 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T09:33:24.767 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T09:33:24.771 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T09:33:24.771 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T09:36:09.335 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T09:36:09.333+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510826) UID: 0 2024-03-26T09:36:09.336 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T09:36:09.333+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510826) UID: 0 2024-03-26T09:36:09.336 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T09:36:09.333+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510826) UID: 0 2024-03-26T09:36:09.336 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T09:36:09.334+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510826) UID: 0 2024-03-26T09:45:34.958 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:45:34.964 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:45:35.262 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T09:45:35.260+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49903) UID: 0 2024-03-26T09:45:35.262 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T09:45:35.260+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49903) UID: 0 2024-03-26T09:45:35.263 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T09:45:35.261+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49903) UID: 0 2024-03-26T09:45:35.263 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T09:45:35.261+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49903) UID: 0 2024-03-26T09:45:37.797 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T09:45:37.796+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510854) UID: 0 2024-03-26T09:45:37.797 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T09:45:37.796+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510854) UID: 0 2024-03-26T09:45:37.798 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T09:45:37.797+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510854) UID: 0 2024-03-26T09:45:37.798 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T09:45:37.797+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510854) UID: 0 2024-03-26T09:51:29.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:51:29.755 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:51:29.865 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T09:51:29.863+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49932) UID: 0 2024-03-26T09:51:29.865 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T09:51:29.863+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49932) UID: 0 2024-03-26T09:51:29.865 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T09:51:29.863+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49932) UID: 0 2024-03-26T09:51:29.866 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T09:51:29.863+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49932) UID: 0 2024-03-26T09:51:29.880 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T09:51:29.879+0000 7fdb1c600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 510882) UID: 0 2024-03-26T09:51:29.881 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T09:51:29.879+0000 7f4916600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 510882) UID: 0 2024-03-26T09:54:36.939 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T09:54:36.936+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510885) UID: 0 2024-03-26T09:54:36.939 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T09:54:36.936+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510885) UID: 0 2024-03-26T09:54:36.940 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T09:54:36.936+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510885) UID: 0 2024-03-26T09:54:36.940 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T09:54:36.936+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510885) UID: 0 2024-03-26T09:58:48.834 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:58:48.863 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T09:58:48.984 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T09:58:48.986+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49954) UID: 0 2024-03-26T09:58:48.985 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T09:58:48.986+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49954) UID: 0 2024-03-26T09:58:48.985 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T09:58:48.986+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49954) UID: 0 2024-03-26T09:58:48.985 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T09:58:48.986+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49954) UID: 0 2024-03-26T10:03:46.525 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:03:46.531 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:04:16.775 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:04:16.781 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:04:46.930 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:04:46.935 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:05:17.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:05:17.668 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:05:47.803 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:05:47.809 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:06:18.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:06:18.076 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:06:49.131 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:06:49.138 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:07:19.273 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:07:19.278 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:07:49.412 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:07:49.420 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:08:19.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:08:19.560 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:08:49.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:08:49.710 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:09:19.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:09:19.849 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:09:49.999 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:09:50.006 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:10:20.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:10:20.146 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:10:50.306 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:10:50.316 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:11:22.013 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:11:22.019 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:11:52.177 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:11:52.184 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:11:52.299 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T10:11:52.306+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50289) UID: 0 2024-03-26T10:11:52.300 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T10:11:52.306+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50289) UID: 0 2024-03-26T10:11:52.300 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T10:11:52.306+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50289) UID: 0 2024-03-26T10:11:52.301 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T10:11:52.306+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50289) UID: 0 2024-03-26T10:15:59.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:15:59.034 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:15:59.266 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T10:15:59.274+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50312) UID: 0 2024-03-26T10:15:59.266 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T10:15:59.274+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50312) UID: 0 2024-03-26T10:15:59.267 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T10:15:59.275+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50312) UID: 0 2024-03-26T10:15:59.267 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T10:15:59.275+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50312) UID: 0 2024-03-26T10:20:37.454 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:20:37.461 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:20:37.911 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T10:20:37.920+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511284) UID: 0 2024-03-26T10:20:37.912 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T10:20:37.920+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511284) UID: 0 2024-03-26T10:20:37.912 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T10:20:37.920+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511284) UID: 0 2024-03-26T10:20:37.912 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T10:20:37.920+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511284) UID: 0 2024-03-26T10:28:34.235 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:28:34.245 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:28:34.326 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T10:28:34.337+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511312) UID: 0 2024-03-26T10:28:34.327 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T10:28:34.337+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511312) UID: 0 2024-03-26T10:28:34.327 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T10:28:34.338+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50365) UID: 0 2024-03-26T10:28:34.327 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T10:28:34.338+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50365) UID: 0 2024-03-26T10:28:34.328 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T10:28:34.338+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50365) UID: 0 2024-03-26T10:28:34.328 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T10:28:34.338+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50365) UID: 0 2024-03-26T10:28:34.346 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T10:28:34.337+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511312) UID: 0 2024-03-26T10:28:34.350 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T10:28:34.337+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511312) UID: 0 2024-03-26T10:33:36.991 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:33:36.998 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:33:42.418 INFO:teuthology.orchestra.run.smithi063.stdout:generic/522 3617s 2024-03-26T10:33:42.474 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/522 2024-03-26T10:33:42.474 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:33:42.483 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:42.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:33:42.553 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-03-26T10:33:43.391 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:33:43.404 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:33:43.406 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:33:43.409 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:33:43.409 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi063.stdout:generic/523 1s 2024-03-26T10:33:44.511 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/523 2024-03-26T10:33:44.512 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:33:44.520 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:44.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:33:44.547 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-03-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:52.940 INFO:teuthology.orchestra.run.smithi063.stdout:generic/524 7s 2024-03-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/524 2024-03-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:53.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:33:53.623 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-03-26T10:33:54.254 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:33:54.273 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:33:54.275 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:33:54.277 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:33:54.278 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:55.194 INFO:teuthology.orchestra.run.smithi063.stdout:generic/525 [not run] filesystem does not support huge file size 2024-03-26T10:33:55.223 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/525 2024-03-26T10:33:55.223 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/525 2024-03-26T10:33:55.223 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:33:55.234 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:55.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:33:55.282 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-03-26T10:33:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:33:55.894 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:33:55.896 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:33:55.899 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:33:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:56.705 INFO:teuthology.orchestra.run.smithi063.stdout:generic/526 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T10:33:56.719 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/526 2024-03-26T10:33:56.719 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/526 2024-03-26T10:33:56.719 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:33:56.729 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:56.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:33:56.787 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-03-26T10:33:57.380 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:33:57.396 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:33:57.398 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:33:57.400 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:33:57.400 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:58.111 INFO:teuthology.orchestra.run.smithi063.stdout:generic/527 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T10:33:58.124 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/527 2024-03-26T10:33:58.124 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/527 2024-03-26T10:33:58.124 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:33:58.133 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:58.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:33:58.180 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-03-26T10:33:58.769 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:33:58.781 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:33:58.783 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:33:58.787 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:33:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:59.636 INFO:teuthology.orchestra.run.smithi063.stdout:generic/528 0s 2024-03-26T10:33:59.655 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/528 2024-03-26T10:33:59.655 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:33:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:33:59.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:33:59.782 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-03-26T10:34:00.583 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:00.596 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:00.598 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:00.600 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:01.614 INFO:teuthology.orchestra.run.smithi063.stdout:generic/529 1s 2024-03-26T10:34:01.636 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/529 2024-03-26T10:34:01.637 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:34:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:01.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:34:01.674 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-03-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:03.159 INFO:teuthology.orchestra.run.smithi063.stdout:generic/530 [not run] ceph does not support shutdown 2024-03-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/530 2024-03-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/530 2024-03-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:03.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:34:03.240 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-03-26T10:34:03.860 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:03.876 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:03.878 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:03.881 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:03.881 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:04.544 INFO:teuthology.orchestra.run.smithi063.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-03-26T10:34:04.557 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/531 2024-03-26T10:34:04.557 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/531 2024-03-26T10:34:04.558 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:34:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:04.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:34:04.611 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-03-26T10:34:05.205 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:05.223 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:05.225 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:05.229 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:05.972 INFO:teuthology.orchestra.run.smithi063.stdout:generic/532 0s 2024-03-26T10:34:05.989 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/532 2024-03-26T10:34:05.989 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:34:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:06.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:34:06.042 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-03-26T10:34:06.642 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:06.656 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:06.657 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:06.660 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:08.170 INFO:teuthology.orchestra.run.smithi063.stdout:generic/533 2s 2024-03-26T10:34:08.190 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/533 2024-03-26T10:34:08.190 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:34:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:08.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:34:08.247 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-03-26T10:34:08.849 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:08.863 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:08.865 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:08.868 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:09.140 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:34:09.147 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:34:09.551 INFO:teuthology.orchestra.run.smithi063.stdout:generic/534 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T10:34:09.564 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/534 2024-03-26T10:34:09.564 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/534 2024-03-26T10:34:09.564 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:34:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:09.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:34:09.613 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-03-26T10:34:10.215 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:10.228 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:10.230 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:10.234 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:10.891 INFO:teuthology.orchestra.run.smithi063.stdout:generic/535 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T10:34:10.904 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/535 2024-03-26T10:34:10.904 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/535 2024-03-26T10:34:10.905 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:34:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:10.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:34:10.963 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-03-26T10:34:11.574 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:11.588 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:11.589 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:11.592 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:12.427 INFO:teuthology.orchestra.run.smithi063.stdout:generic/536 [not run] ceph does not support shutdown 2024-03-26T10:34:12.451 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/536 2024-03-26T10:34:12.452 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/536 2024-03-26T10:34:12.452 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:34:12.459 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:12.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:34:12.499 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-03-26T10:34:13.093 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:13.105 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:13.107 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:13.110 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:13.110 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:13.953 INFO:teuthology.orchestra.run.smithi063.stdout:generic/537 [not run] FSTRIM not supported 2024-03-26T10:34:13.979 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/537 2024-03-26T10:34:13.979 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/537 2024-03-26T10:34:13.980 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:34:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:14.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:34:14.032 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-03-26T10:34:14.635 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:34:14.651 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:34:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:34:14.656 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:34:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:34:39.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:34:39.283 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:35:09.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:35:09.979 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:35:40.109 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:35:40.116 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:36:10.269 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:36:10.276 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:36:10.384 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T10:36:10.389+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50898) UID: 0 2024-03-26T10:36:10.384 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T10:36:10.389+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50898) UID: 0 2024-03-26T10:36:10.385 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T10:36:10.389+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50898) UID: 0 2024-03-26T10:36:10.388 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T10:36:10.393+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50898) UID: 0 2024-03-26T10:36:10.395 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T10:36:10.399+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520698) UID: 0 2024-03-26T10:36:10.396 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T10:36:10.399+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520698) UID: 0 2024-03-26T10:36:10.396 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T10:36:10.399+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520698) UID: 0 2024-03-26T10:36:10.396 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T10:36:10.400+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520698) UID: 0 2024-03-26T10:40:04.649 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:40:04.656 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:40:35.707 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:40:35.712 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:41:05.829 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:41:05.835 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:41:35.978 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:41:35.984 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:42:06.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:42:06.129 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:42:06.233 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T10:42:06.234+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51048) UID: 0 2024-03-26T10:42:06.233 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T10:42:06.234+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51048) UID: 0 2024-03-26T10:42:06.233 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T10:42:06.234+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51048) UID: 0 2024-03-26T10:42:06.233 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T10:42:06.234+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51048) UID: 0 2024-03-26T10:46:02.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:46:02.931 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:46:34.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:46:34.626 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:47:04.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:47:04.768 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:47:08.352 INFO:teuthology.orchestra.run.smithi063.stdout:generic/538 774s 2024-03-26T10:47:08.372 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/538 2024-03-26T10:47:08.372 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:08.379 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:08.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:08.487 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-03-26T10:47:09.240 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:09.253 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:09.255 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:09.257 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:12.232 INFO:teuthology.orchestra.run.smithi063.stdout:generic/539 2s 2024-03-26T10:47:12.249 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/539 2024-03-26T10:47:12.249 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:12.257 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:12.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:12.349 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-03-26T10:47:13.115 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:13.134 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:13.138 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:13.140 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:13.140 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:14.160 INFO:teuthology.orchestra.run.smithi063.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T10:47:14.175 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/540 2024-03-26T10:47:14.175 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/540 2024-03-26T10:47:14.175 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:14.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:14.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:14.456 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-03-26T10:47:15.079 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:15.091 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:15.093 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:15.096 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:15.096 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:16.125 INFO:teuthology.orchestra.run.smithi063.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T10:47:16.141 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/541 2024-03-26T10:47:16.142 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/541 2024-03-26T10:47:16.142 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:16.153 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:16.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:16.414 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-03-26T10:47:17.071 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:17.085 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:17.087 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:17.092 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:17.092 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:18.138 INFO:teuthology.orchestra.run.smithi063.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T10:47:18.156 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/542 2024-03-26T10:47:18.156 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/542 2024-03-26T10:47:18.156 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:18.859 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:18.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:18.922 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-03-26T10:47:19.531 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:19.548 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:19.550 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:19.555 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:19.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:20.946 INFO:teuthology.orchestra.run.smithi063.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T10:47:20.963 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/543 2024-03-26T10:47:20.964 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/543 2024-03-26T10:47:20.964 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:21.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:21.243 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-03-26T10:47:21.856 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:21.871 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:21.872 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:21.875 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:21.875 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:22.892 INFO:teuthology.orchestra.run.smithi063.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-26T10:47:22.927 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/544 2024-03-26T10:47:22.927 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/544 2024-03-26T10:47:22.927 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:22.942 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:23.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:23.212 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-03-26T10:47:23.824 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:23.839 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:23.841 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:23.845 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:24.642 INFO:teuthology.orchestra.run.smithi063.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-03-26T10:47:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/545 2024-03-26T10:47:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/545 2024-03-26T10:47:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:24.667 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:24.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:24.730 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-03-26T10:47:25.332 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:25.346 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:25.348 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:25.352 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:26.121 INFO:teuthology.orchestra.run.smithi063.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-26T10:47:26.134 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/546 2024-03-26T10:47:26.134 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/546 2024-03-26T10:47:26.134 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:26.141 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:26.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:26.200 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-03-26T10:47:26.817 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:26.832 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:26.834 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:26.837 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:26.837 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:27.535 INFO:teuthology.orchestra.run.smithi063.stdout:generic/547 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2024-03-26T10:47:27.547 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/547 2024-03-26T10:47:27.547 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/547 2024-03-26T10:47:27.548 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:27.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:27.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:27.594 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-03-26T10:47:28.218 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:28.231 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:28.234 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:28.236 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:28.236 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:29.990 INFO:teuthology.orchestra.run.smithi063.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-26T10:47:30.007 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/548 2024-03-26T10:47:30.008 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/548 2024-03-26T10:47:30.008 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:30.021 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:30.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:30.095 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-03-26T10:47:30.700 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:30.713 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:30.715 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:30.717 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:30.717 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:32.597 INFO:teuthology.orchestra.run.smithi063.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-26T10:47:32.610 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/549 2024-03-26T10:47:32.610 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/549 2024-03-26T10:47:32.610 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:32.621 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:32.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:32.680 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-03-26T10:47:33.298 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:33.312 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:33.314 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:33.316 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:33.316 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:34.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:47:34.915 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:47:35.047 INFO:teuthology.orchestra.run.smithi063.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2024-03-26T10:47:35.086 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/550 2024-03-26T10:47:35.086 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/550 2024-03-26T10:47:35.086 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-03-26T10:47:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:47:35.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-26T10:47:35.137 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-03-26T10:47:35.755 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-03-26T10:47:35.770 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-26T10:47:35.772 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-03-26T10:47:35.775 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAWaAJmYTyXHRAAN5yGzltL4Pa+SwICrs5ZMg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch 2024-03-26T10:47:35.775 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T10:48:05.190 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:48:05.196 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:48:35.322 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:48:35.327 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:49:05.731 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:49:05.740 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:49:35.869 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:49:35.875 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:50:05.999 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:50:06.004 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:50:37.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:50:37.081 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:50:37.356 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T10:50:37.355+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533506) UID: 0 2024-03-26T10:50:37.357 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T10:50:37.355+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533506) UID: 0 2024-03-26T10:50:37.357 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T10:50:37.356+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533506) UID: 0 2024-03-26T10:50:37.357 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T10:50:37.356+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533506) UID: 0 2024-03-26T10:54:44.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:54:44.126 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:54:44.375 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T10:54:44.373+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51902) UID: 0 2024-03-26T10:54:44.375 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T10:54:44.373+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51902) UID: 0 2024-03-26T10:54:44.376 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T10:54:44.374+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51902) UID: 0 2024-03-26T10:54:44.376 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T10:54:44.374+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51902) UID: 0 2024-03-26T10:59:03.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:59:03.443 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T10:59:03.588 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T10:59:03.586+0000 7fe5dd800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52045) UID: 0 2024-03-26T10:59:03.588 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T10:59:03.586+0000 7f7a19800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52045) UID: 0 2024-03-26T10:59:03.588 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T10:59:03.587+0000 7fadfe000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52045) UID: 0 2024-03-26T10:59:03.589 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T10:59:03.587+0000 7f7b93200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52045) UID: 0 2024-03-26T11:02:21.392 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T11:02:21.388+0000 7fe5d1a00640 -1 bdev(0x5556a29c6e00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-03-26T11:02:21.421 INFO:tasks.ceph.osd.5.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1964-g7e98f5f6/rpm/el9/BUILD/ceph-19.0.0-1964-g7e98f5f6/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fe5d1a00640 time 2024-03-26T11:02:21.389357+0000 2024-03-26T11:02:21.421 INFO:tasks.ceph.osd.5.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1964-g7e98f5f6/rpm/el9/BUILD/ceph-19.0.0-1964-g7e98f5f6/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-26T11:02:21.425 INFO:tasks.ceph.osd.5.smithi204.stderr: ceph version 19.0.0-1964-g7e98f5f6 (7e98f5f6b535defc7fa715b456904ffc0500aa9f) squid (dev) 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5556a08db4ab] 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x5556a12ac3f0] 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: 3: ceph-osd(+0xdc6561) [0x5556a12ac561] 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fe5e189f802] 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fe5e183f450] 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr:*** Caught signal (Aborted) ** 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: in thread 7fe5d1a00640 thread_name:bstore_aio 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T11:02:21.424+0000 7fe5d1a00640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1964-g7e98f5f6/rpm/el9/BUILD/ceph-19.0.0-1964-g7e98f5f6/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fe5d1a00640 time 2024-03-26T11:02:21.389357+0000 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1964-g7e98f5f6/rpm/el9/BUILD/ceph-19.0.0-1964-g7e98f5f6/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: ceph version 19.0.0-1964-g7e98f5f6 (7e98f5f6b535defc7fa715b456904ffc0500aa9f) squid (dev) 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5556a08db4ab] 2024-03-26T11:02:21.426 INFO:tasks.ceph.osd.5.smithi204.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x5556a12ac3f0] 2024-03-26T11:02:21.427 INFO:tasks.ceph.osd.5.smithi204.stderr: 3: ceph-osd(+0xdc6561) [0x5556a12ac561] 2024-03-26T11:02:21.427 INFO:tasks.ceph.osd.5.smithi204.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fe5e189f802] 2024-03-26T11:02:21.427 INFO:tasks.ceph.osd.5.smithi204.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fe5e183f450] 2024-03-26T11:02:21.427 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.428 INFO:tasks.ceph.osd.5.smithi204.stderr: ceph version 19.0.0-1964-g7e98f5f6 (7e98f5f6b535defc7fa715b456904ffc0500aa9f) squid (dev) 2024-03-26T11:02:21.429 INFO:tasks.ceph.osd.5.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe5e1854db0] 2024-03-26T11:02:21.429 INFO:tasks.ceph.osd.5.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe5e18a154c] 2024-03-26T11:02:21.429 INFO:tasks.ceph.osd.5.smithi204.stderr: 3: raise() 2024-03-26T11:02:21.429 INFO:tasks.ceph.osd.5.smithi204.stderr: 4: abort() 2024-03-26T11:02:21.429 INFO:tasks.ceph.osd.5.smithi204.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5556a08db56c] 2024-03-26T11:02:21.429 INFO:tasks.ceph.osd.5.smithi204.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x5556a12ac3f0] 2024-03-26T11:02:21.429 INFO:tasks.ceph.osd.5.smithi204.stderr: 7: ceph-osd(+0xdc6561) [0x5556a12ac561] 2024-03-26T11:02:21.429 INFO:tasks.ceph.osd.5.smithi204.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fe5e189f802] 2024-03-26T11:02:21.429 INFO:tasks.ceph.osd.5.smithi204.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fe5e183f450] 2024-03-26T11:02:21.430 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-26T11:02:21.428+0000 7fe5d1a00640 -1 *** Caught signal (Aborted) ** 2024-03-26T11:02:21.430 INFO:tasks.ceph.osd.5.smithi204.stderr: in thread 7fe5d1a00640 thread_name:bstore_aio 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: ceph version 19.0.0-1964-g7e98f5f6 (7e98f5f6b535defc7fa715b456904ffc0500aa9f) squid (dev) 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe5e1854db0] 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe5e18a154c] 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 3: raise() 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 4: abort() 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5556a08db56c] 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x5556a12ac3f0] 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 7: ceph-osd(+0xdc6561) [0x5556a12ac561] 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fe5e189f802] 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fe5e183f450] 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T11:02:21.431 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.455 INFO:tasks.ceph.osd.5.smithi204.stderr: -3918> 2024-03-26T11:02:21.388+0000 7fe5d1a00640 -1 bdev(0x5556a29c6e00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-03-26T11:02:21.458 INFO:tasks.ceph.osd.5.smithi204.stderr: -1142> 2024-03-26T11:02:21.424+0000 7fe5d1a00640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1964-g7e98f5f6/rpm/el9/BUILD/ceph-19.0.0-1964-g7e98f5f6/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fe5d1a00640 time 2024-03-26T11:02:21.389357+0000 2024-03-26T11:02:21.458 INFO:tasks.ceph.osd.5.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1964-g7e98f5f6/rpm/el9/BUILD/ceph-19.0.0-1964-g7e98f5f6/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-26T11:02:21.458 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: ceph version 19.0.0-1964-g7e98f5f6 (7e98f5f6b535defc7fa715b456904ffc0500aa9f) squid (dev) 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5556a08db4ab] 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x5556a12ac3f0] 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: 3: ceph-osd(+0xdc6561) [0x5556a12ac561] 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fe5e189f802] 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fe5e183f450] 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: -537> 2024-03-26T11:02:21.428+0000 7fe5d1a00640 -1 *** Caught signal (Aborted) ** 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: in thread 7fe5d1a00640 thread_name:bstore_aio 2024-03-26T11:02:21.459 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: ceph version 19.0.0-1964-g7e98f5f6 (7e98f5f6b535defc7fa715b456904ffc0500aa9f) squid (dev) 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe5e1854db0] 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe5e18a154c] 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 3: raise() 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 4: abort() 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5556a08db56c] 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x5556a12ac3f0] 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 7: ceph-osd(+0xdc6561) [0x5556a12ac561] 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fe5e189f802] 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fe5e183f450] 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T11:02:21.460 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.466 INFO:tasks.ceph.osd.5.smithi204.stderr: -4919> 2024-03-26T11:02:21.388+0000 7fe5d1a00640 -1 bdev(0x5556a29c6e00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-03-26T11:02:21.469 INFO:tasks.ceph.osd.5.smithi204.stderr: -2143> 2024-03-26T11:02:21.424+0000 7fe5d1a00640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1964-g7e98f5f6/rpm/el9/BUILD/ceph-19.0.0-1964-g7e98f5f6/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fe5d1a00640 time 2024-03-26T11:02:21.389357+0000 2024-03-26T11:02:21.469 INFO:tasks.ceph.osd.5.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1964-g7e98f5f6/rpm/el9/BUILD/ceph-19.0.0-1964-g7e98f5f6/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-26T11:02:21.469 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.469 INFO:tasks.ceph.osd.5.smithi204.stderr: ceph version 19.0.0-1964-g7e98f5f6 (7e98f5f6b535defc7fa715b456904ffc0500aa9f) squid (dev) 2024-03-26T11:02:21.469 INFO:tasks.ceph.osd.5.smithi204.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5556a08db4ab] 2024-03-26T11:02:21.469 INFO:tasks.ceph.osd.5.smithi204.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x5556a12ac3f0] 2024-03-26T11:02:21.469 INFO:tasks.ceph.osd.5.smithi204.stderr: 3: ceph-osd(+0xdc6561) [0x5556a12ac561] 2024-03-26T11:02:21.469 INFO:tasks.ceph.osd.5.smithi204.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fe5e189f802] 2024-03-26T11:02:21.469 INFO:tasks.ceph.osd.5.smithi204.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fe5e183f450] 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: -1538> 2024-03-26T11:02:21.428+0000 7fe5d1a00640 -1 *** Caught signal (Aborted) ** 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: in thread 7fe5d1a00640 thread_name:bstore_aio 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: ceph version 19.0.0-1964-g7e98f5f6 (7e98f5f6b535defc7fa715b456904ffc0500aa9f) squid (dev) 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe5e1854db0] 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe5e18a154c] 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: 3: raise() 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: 4: abort() 2024-03-26T11:02:21.470 INFO:tasks.ceph.osd.5.smithi204.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5556a08db56c] 2024-03-26T11:02:21.471 INFO:tasks.ceph.osd.5.smithi204.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x5556a12ac3f0] 2024-03-26T11:02:21.471 INFO:tasks.ceph.osd.5.smithi204.stderr: 7: ceph-osd(+0xdc6561) [0x5556a12ac561] 2024-03-26T11:02:21.471 INFO:tasks.ceph.osd.5.smithi204.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fe5e189f802] 2024-03-26T11:02:21.471 INFO:tasks.ceph.osd.5.smithi204.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fe5e183f450] 2024-03-26T11:02:21.471 INFO:tasks.ceph.osd.5.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T11:02:21.471 INFO:tasks.ceph.osd.5.smithi204.stderr: 2024-03-26T11:02:21.870 INFO:tasks.ceph.osd.5.smithi204.stderr:daemon-helper: command failed with exit status 5 2024-03-26T11:02:28.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-26T11:02:35.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2024-03-26T11:02:42.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2024-03-26T11:02:48.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2024-03-26T11:02:55.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~26s 2024-03-26T11:03:01.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2024-03-26T11:03:07.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:03:07.344 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:03:07.499 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T11:03:07.497+0000 7f7600800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 534537) UID: 0 2024-03-26T11:03:07.499 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T11:03:07.497+0000 7f55b2400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 534537) UID: 0 2024-03-26T11:03:07.500 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T11:03:07.497+0000 7f2851400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 534537) UID: 0 2024-03-26T11:03:07.500 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T11:03:07.497+0000 7fe857200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 534537) UID: 0 2024-03-26T11:03:08.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2024-03-26T11:03:15.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2024-03-26T11:03:21.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2024-03-26T11:03:28.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2024-03-26T11:03:34.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2024-03-26T11:03:41.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2024-03-26T11:03:48.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2024-03-26T11:03:54.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2024-03-26T11:04:01.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~93s 2024-03-26T11:04:08.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2024-03-26T11:04:14.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~106s 2024-03-26T11:04:21.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~112s 2024-03-26T11:04:27.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~119s 2024-03-26T11:04:34.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~126s 2024-03-26T11:04:41.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2024-03-26T11:04:47.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~139s 2024-03-26T11:04:54.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2024-03-26T11:05:00.916 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~152s 2024-03-26T11:05:07.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~159s 2024-03-26T11:05:14.142 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2024-03-26T11:05:20.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~172s 2024-03-26T11:05:27.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~179s 2024-03-26T11:05:33.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2024-03-26T11:05:40.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~192s 2024-03-26T11:05:47.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~198s 2024-03-26T11:05:53.814 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2024-03-26T11:06:00.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~212s 2024-03-26T11:06:07.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~218s 2024-03-26T11:06:13.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2024-03-26T11:06:20.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~231s 2024-03-26T11:06:26.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~238s 2024-03-26T11:06:33.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2024-03-26T11:06:40.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~251s 2024-03-26T11:06:46.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~258s 2024-03-26T11:06:53.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~264s 2024-03-26T11:06:59.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~271s 2024-03-26T11:07:06.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~278s 2024-03-26T11:07:13.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~284s 2024-03-26T11:07:19.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~291s 2024-03-26T11:07:26.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~298s 2024-03-26T11:07:32.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~304s 2024-03-26T11:07:32.998 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-03-26T11:07:32.999 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T11:07:32.999 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T11:07:33.165 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T11:07:33.165 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T11:07:33.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-26T11:07:34.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.702+0000 7f795bc00640 1 Processor -- start 2024-03-26T11:07:34.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.703+0000 7f795bc00640 1 -- start start 2024-03-26T11:07:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.704+0000 7f795bc00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f795415dc30 0x7f79540ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.704+0000 7f795bc00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7954161810 0x7f79540d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.705+0000 7f795bc00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79540d0a20 0x7f795406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.705+0000 7f795bc00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540d1ed0 con 0x7f79540d0a20 2024-03-26T11:07:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.705+0000 7f795bc00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540d38f0 con 0x7f795415dc30 2024-03-26T11:07:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.705+0000 7f795bc00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540cf3b0 con 0x7f7954161810 2024-03-26T11:07:34.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.705+0000 7f7959200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f795415dc30 0x7f79540ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:34.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.705+0000 7f7953e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7954161810 0x7f79540d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:34.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.705+0000 7f7953e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7954161810 0x7f79540d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:44640/0 (socket says 172.21.15.63:44640) 2024-03-26T11:07:34.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.705+0000 7f7953e00640 1 -- 172.21.15.63:0/608018883 learned_addr learned my addr 172.21.15.63:0/608018883 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T11:07:34.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.705+0000 7f7959c00640 1 --2- 172.21.15.63:0/608018883 >> v2:172.21.15.63:3300/0 conn(0x7f79540d0a20 0x7f795406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:34.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.706+0000 7f7959200640 1 -- 172.21.15.63:0/608018883 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7954161810 msgr2=0x7f79540d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T11:07:34.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.706+0000 7f7959200640 1 --2- 172.21.15.63:0/608018883 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7954161810 0x7f79540d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:34.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.706+0000 7f7959200640 1 -- 172.21.15.63:0/608018883 >> v2:172.21.15.63:3300/0 conn(0x7f79540d0a20 msgr2=0x7f795406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T11:07:34.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.706+0000 7f7959200640 1 --2- 172.21.15.63:0/608018883 >> v2:172.21.15.63:3300/0 conn(0x7f79540d0a20 0x7f795406c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:34.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.706+0000 7f7959200640 1 -- 172.21.15.63:0/608018883 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79540ceb10 con 0x7f795415dc30 2024-03-26T11:07:34.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.708+0000 7f7959200640 1 --2- 172.21.15.63:0/608018883 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f795415dc30 0x7f79540ce450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f79540d1190 tx=0x7f794802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=859ff01e781d58ed server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:34.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.708+0000 7f7953400640 1 -- 172.21.15.63:0/608018883 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480317c0 con 0x7f795415dc30 2024-03-26T11:07:34.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.708+0000 7f7953400640 1 -- 172.21.15.63:0/608018883 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948037070 con 0x7f795415dc30 2024-03-26T11:07:34.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.709+0000 7f7953400640 1 -- 172.21.15.63:0/608018883 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948031bc0 con 0x7f795415dc30 2024-03-26T11:07:34.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.710+0000 7f795bc00640 1 -- 172.21.15.63:0/608018883 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f795415dc30 msgr2=0x7f79540ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:34.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.710+0000 7f795bc00640 1 --2- 172.21.15.63:0/608018883 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f795415dc30 0x7f79540ce450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f79540d1190 tx=0x7f794802b860 comp rx=0 tx=0).stop 2024-03-26T11:07:34.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.711+0000 7f795bc00640 1 -- 172.21.15.63:0/608018883 shutdown_connections 2024-03-26T11:07:34.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.711+0000 7f795bc00640 1 --2- 172.21.15.63:0/608018883 >> v2:172.21.15.63:3300/0 conn(0x7f79540d0a20 0x7f795406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:34.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.711+0000 7f795bc00640 1 --2- 172.21.15.63:0/608018883 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7954161810 0x7f79540d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:34.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.711+0000 7f795bc00640 1 --2- 172.21.15.63:0/608018883 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f795415dc30 0x7f79540ce450 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:34.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.711+0000 7f795bc00640 1 -- 172.21.15.63:0/608018883 >> 172.21.15.63:0/608018883 conn(0x7f79540729f0 msgr2=0x7f79540b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:34.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.717+0000 7f795bc00640 1 -- 172.21.15.63:0/608018883 shutdown_connections 2024-03-26T11:07:34.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.717+0000 7f795bc00640 1 -- 172.21.15.63:0/608018883 wait complete. 2024-03-26T11:07:34.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.720+0000 7f795bc00640 1 Processor -- start 2024-03-26T11:07:34.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.721+0000 7f795bc00640 1 -- start start 2024-03-26T11:07:34.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.722+0000 7f795bc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79540d0a20 0x7f79541f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:34.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.723+0000 7f795bc00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f795415dc30 0x7f79540b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:34.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.723+0000 7f795bc00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7954161810 0x7f795414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:34.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.723+0000 7f795bc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795415e010 con 0x7f79540d0a20 2024-03-26T11:07:34.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.724+0000 7f7953e00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f795415dc30 0x7f79540b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:34.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.724+0000 7f7959c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7954161810 0x7f795414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:34.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.724+0000 7f7959c00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7954161810 0x7f795414a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:46578/0 (socket says 172.21.15.63:46578) 2024-03-26T11:07:34.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.724+0000 7f7959c00640 1 -- 172.21.15.63:0/1027932929 learned_addr learned my addr 172.21.15.63:0/1027932929 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T11:07:34.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.724+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79540cf0d0 con 0x7f7954161810 2024-03-26T11:07:34.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.724+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795415e190 con 0x7f795415dc30 2024-03-26T11:07:34.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.724+0000 7f7959200640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79540d0a20 0x7f79541f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:34.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.727+0000 7f7959200640 1 -- 172.21.15.63:0/1027932929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f795415dc30 msgr2=0x7f79540b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.727+0000 7f7959200640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f795415dc30 0x7f79540b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.727+0000 7f7959200640 1 -- 172.21.15.63:0/1027932929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7954161810 msgr2=0x7f795414a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.727+0000 7f7959200640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7954161810 0x7f795414a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.727+0000 7f7959200640 1 -- 172.21.15.63:0/1027932929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79541f74b0 con 0x7f79540d0a20 2024-03-26T11:07:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.728+0000 7f7959200640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79540d0a20 0x7f79541f44f0 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 crypto rx=0x7f7948033000 tx=0x7f79480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:34.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.729+0000 7f7950c00640 1 -- 172.21.15.63:0/1027932929 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794804a070 con 0x7f79540d0a20 2024-03-26T11:07:34.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.729+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79541f7790 con 0x7f79540d0a20 2024-03-26T11:07:34.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.729+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79541f7d50 con 0x7f79540d0a20 2024-03-26T11:07:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.729+0000 7f7950c00640 1 -- 172.21.15.63:0/1027932929 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948032450 con 0x7f79540d0a20 2024-03-26T11:07:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.729+0000 7f7950c00640 1 -- 172.21.15.63:0/1027932929 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948032840 con 0x7f79540d0a20 2024-03-26T11:07:34.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.732+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7930005290 con 0x7f79540d0a20 2024-03-26T11:07:34.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.734+0000 7f7950c00640 1 -- 172.21.15.63:0/1027932929 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f79480329e0 con 0x7f79540d0a20 2024-03-26T11:07:34.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.735+0000 7f7950c00640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f793406bca0 0x7f793406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:34.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.736+0000 7f7950c00640 1 -- 172.21.15.63:0/1027932929 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f79480ac690 con 0x7f79540d0a20 2024-03-26T11:07:34.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.736+0000 7f7953e00640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f793406bca0 0x7f793406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:34.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.737+0000 7f7953e00640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f793406bca0 0x7f793406e160 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f79540cdf40 tx=0x7f7940008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:34.747+0000 7f7950c00640 1 -- 172.21.15.63:0/1027932929 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7948040070 con 0x7f79540d0a20 2024-03-26T11:07:35.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.080+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7930005580 con 0x7f79540d0a20 2024-03-26T11:07:35.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.087+0000 7f7950c00640 1 -- 172.21.15.63:0/1027932929 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f794807ab10 con 0x7f79540d0a20 2024-03-26T11:07:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-26T11:07:35.090 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":43,"fsid":"82863fce-9065-4f8e-a61f-944fd870ef74","created":"2024-03-26T06:16:32.712711+0000","modified":"2024-03-26T11:02:22.935736+0000","last_up_change":"2024-03-26T11:02:21.921757+0000","last_in_change":"2024-03-26T06:16:37.026603+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T06:16:47.949162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-26T06:18:31.934065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-26T06:18:32.820259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee724377-1725-4ddc-bb43-6497ac83ea3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6801","nonce":2347448899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6803","nonce":2347448899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6807","nonce":2347448899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2347448899},{"type":"v1","addr":"172.21.15.63:6805","nonce":2347448899}]},"public_addr":"172.21.15.63:6801/2347448899","cluster_addr":"172.21.15.63:6803/2347448899","heartbeat_back_addr":"172.21.15.63:6807/2347448899","heartbeat_front_addr":"172.21.15.63:6805/2347448899","state":["exists","up"]},{"osd":1,"uuid":"7c935270-094c-4017-ab5b-f04af6dba01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6817","nonce":2715082202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6820","nonce":2715082202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6828","nonce":2715082202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2715082202},{"type":"v1","addr":"172.21.15.63:6824","nonce":2715082202}]},"public_addr":"172.21.15.63:6817/2715082202","cluster_addr":"172.21.15.63:6820/2715082202","heartbeat_back_addr":"172.21.15.63:6828/2715082202","heartbeat_front_addr":"172.21.15.63:6824/2715082202","state":["exists","up"]},{"osd":2,"uuid":"5f2eaad7-6734-45ed-a8e6-4ba714d0b8d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6809","nonce":3026376468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6811","nonce":3026376468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6815","nonce":3026376468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":3026376468},{"type":"v1","addr":"172.21.15.63:6813","nonce":3026376468}]},"public_addr":"172.21.15.63:6809/3026376468","cluster_addr":"172.21.15.63:6811/3026376468","heartbeat_back_addr":"172.21.15.63:6815/3026376468","heartbeat_front_addr":"172.21.15.63:6813/3026376468","state":["exists","up"]},{"osd":3,"uuid":"d804cf57-87a1-44a4-b1c1-80b0a5421d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6821","nonce":1727607660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6825","nonce":1727607660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6831","nonce":1727607660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":1727607660},{"type":"v1","addr":"172.21.15.63:6829","nonce":1727607660}]},"public_addr":"172.21.15.63:6821/1727607660","cluster_addr":"172.21.15.63:6825/1727607660","heartbeat_back_addr":"172.21.15.63:6831/1727607660","heartbeat_front_addr":"172.21.15.63:6829/1727607660","state":["exists","up"]},{"osd":4,"uuid":"2ec7998e-1364-4e70-8a32-1a368816f9da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6823","nonce":2165493882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6825","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6827","nonce":2165493882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6831","nonce":2165493882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2165493882},{"type":"v1","addr":"172.21.15.204:6829","nonce":2165493882}]},"public_addr":"172.21.15.204:6823/2165493882","cluster_addr":"172.21.15.204:6827/2165493882","heartbeat_back_addr":"172.21.15.204:6831/2165493882","heartbeat_front_addr":"172.21.15.204:6829/2165493882","state":["exists","up"]},{"osd":5,"uuid":"eea399b9-e45d-4732-8bd9-2cbe78af67de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6801","nonce":2623219727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6803","nonce":2623219727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6807","nonce":2623219727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2623219727},{"type":"v1","addr":"172.21.15.204:6805","nonce":2623219727}]},"public_addr":"172.21.15.204:6801/2623219727","cluster_addr":"172.21.15.204:6803/2623219727","heartbeat_back_addr":"172.21.15.204:6807/2623219727","heartbeat_front_addr":"172.21.15.204:6805/2623219727","state":["exists"]},{"osd":6,"uuid":"13347eed-7d02-417f-867f-7d14821c54a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6809","nonce":2062532645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6811","nonce":2062532645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6815","nonce":2062532645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2062532645},{"type":"v1","addr":"172.21.15.204:6813","nonce":2062532645}]},"public_addr":"172.21.15.204:6809/2062532645","cluster_addr":"172.21.15.204:6811/2062532645","heartbeat_back_addr":"172.21.15.204:6815/2062532645","heartbeat_front_addr":"172.21.15.204:6813/2062532645","state":["exists","up"]},{"osd":7,"uuid":"2276830e-0c03-4198-b387-d76e439721ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6817","nonce":3622865395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6819","nonce":3622865395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6826","nonce":3622865395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6821","nonce":3622865395},{"type":"v1","addr":"172.21.15.204:6822","nonce":3622865395}]},"public_addr":"172.21.15.204:6817/3622865395","cluster_addr":"172.21.15.204:6819/3622865395","heartbeat_back_addr":"172.21.15.204:6826/3622865395","heartbeat_front_addr":"172.21.15.204:6822/3622865395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.546342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.388312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.629029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.406988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.370031+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.619028+0000","dead_epoch":42},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.332438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T06:16:42.387040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T11:07:35.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.091+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f793406bca0 msgr2=0x7f793406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:35.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.091+0000 7f795bc00640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f793406bca0 0x7f793406e160 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f79540cdf40 tx=0x7f7940008040 comp rx=0 tx=0).stop 2024-03-26T11:07:35.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.092+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79540d0a20 msgr2=0x7f79541f44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:35.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.092+0000 7f795bc00640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79540d0a20 0x7f79541f44f0 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 crypto rx=0x7f7948033000 tx=0x7f79480046c0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.094+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 shutdown_connections 2024-03-26T11:07:35.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.094+0000 7f795bc00640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f793406bca0 0x7f793406e160 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.094+0000 7f795bc00640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7954161810 0x7f795414a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.094+0000 7f795bc00640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f795415dc30 0x7f79540b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.094+0000 7f795bc00640 1 --2- 172.21.15.63:0/1027932929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79540d0a20 0x7f79541f44f0 unknown :-1 s=CLOSED pgs=2674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.094+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 >> 172.21.15.63:0/1027932929 conn(0x7f79540729f0 msgr2=0x7f79541560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:35.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.094+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 shutdown_connections 2024-03-26T11:07:35.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.094+0000 7f795bc00640 1 -- 172.21.15.63:0/1027932929 wait complete. 2024-03-26T11:07:35.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T06:16:47.949162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-26T06:18:31.934065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-03-26T06:18:32.820259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-26T11:07:35.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-26T11:07:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.392+0000 7facc6a00640 1 Processor -- start 2024-03-26T11:07:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.392+0000 7facc6a00640 1 -- start start 2024-03-26T11:07:35.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.394+0000 7facc6a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc015bbc0 0x7facc00b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:35.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.394+0000 7facc6a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7facc00b7620 0x7facc00cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:35.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.394+0000 7facc6a00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc015f9a0 con 0x7facc015f510 2024-03-26T11:07:35.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.394+0000 7facc6a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc00cf8c0 con 0x7facc00b7620 2024-03-26T11:07:35.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.394+0000 7facc6a00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc015fc80 con 0x7facc015bbc0 2024-03-26T11:07:35.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.395+0000 7facc4a00640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7facc015f510 0x7facc00ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.63:55704/0 (socket says 172.21.15.63:55704) 2024-03-26T11:07:35.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.395+0000 7facc4a00640 1 -- 172.21.15.63:0/1092442679 learned_addr learned my addr 172.21.15.63:0/1092442679 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T11:07:35.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.395+0000 7facbfe00640 1 --2- 172.21.15.63:0/1092442679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc015bbc0 0x7facc00b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:35.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.395+0000 7facbf400640 1 --2- 172.21.15.63:0/1092442679 >> v2:172.21.15.63:3300/0 conn(0x7facc00b7620 0x7facc00cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.396+0000 7facbf400640 1 -- 172.21.15.63:0/1092442679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc015bbc0 msgr2=0x7facc00b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T11:07:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.396+0000 7facbf400640 1 --2- 172.21.15.63:0/1092442679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc015bbc0 0x7facc00b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.396+0000 7facbf400640 1 -- 172.21.15.63:0/1092442679 >> v1:172.21.15.204:6789/0 conn(0x7facc015f510 legacy=0x7facc00ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.396+0000 7facbf400640 1 -- 172.21.15.63:0/1092442679 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc015ff60 con 0x7facc00b7620 2024-03-26T11:07:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.398+0000 7facbf400640 1 --2- 172.21.15.63:0/1092442679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facc00b7620 0x7facc00cbfe0 secure :-1 s=READY pgs=2675 cs=0 l=1 rev1=1 crypto rx=0x7facac0097a0 tx=0x7facac02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8770f9cdf964d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.399+0000 7facbea00640 1 -- 172.21.15.63:0/1092442679 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac037070 con 0x7facc00b7620 2024-03-26T11:07:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.399+0000 7facbea00640 1 -- 172.21.15.63:0/1092442679 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac030710 con 0x7facc00b7620 2024-03-26T11:07:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.399+0000 7facbea00640 1 -- 172.21.15.63:0/1092442679 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac030ae0 con 0x7facc00b7620 2024-03-26T11:07:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.400+0000 7facc6a00640 1 -- 172.21.15.63:0/1092442679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facc00b7620 msgr2=0x7facc00cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.400+0000 7facc6a00640 1 --2- 172.21.15.63:0/1092442679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facc00b7620 0x7facc00cbfe0 secure :-1 s=READY pgs=2675 cs=0 l=1 rev1=1 crypto rx=0x7facac0097a0 tx=0x7facac02b710 comp rx=0 tx=0).stop 2024-03-26T11:07:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.400+0000 7facc6a00640 1 -- 172.21.15.63:0/1092442679 shutdown_connections 2024-03-26T11:07:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.401+0000 7facc6a00640 1 --2- 172.21.15.63:0/1092442679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facc00b7620 0x7facc00cbfe0 unknown :-1 s=CLOSED pgs=2675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.401+0000 7facc6a00640 1 --2- 172.21.15.63:0/1092442679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc015bbc0 0x7facc00b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.401+0000 7facc6a00640 1 -- 172.21.15.63:0/1092442679 >> 172.21.15.63:0/1092442679 conn(0x7facc0071000 msgr2=0x7facc00713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.401+0000 7facc6a00640 1 -- 172.21.15.63:0/1092442679 shutdown_connections 2024-03-26T11:07:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.401+0000 7facc6a00640 1 -- 172.21.15.63:0/1092442679 wait complete. 2024-03-26T11:07:35.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.403+0000 7facc6a00640 1 Processor -- start 2024-03-26T11:07:35.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.404+0000 7facc6a00640 1 -- start start 2024-03-26T11:07:35.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.405+0000 7facc6a00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc00b7620 0x7facc00b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:35.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.405+0000 7facc6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facc015bbc0 0x7facc015d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:35.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.406+0000 7facbfe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc00b7620 0x7facc00b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:35.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.406+0000 7facbfe00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc00b7620 0x7facc00b6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:44678/0 (socket says 172.21.15.63:44678) 2024-03-26T11:07:35.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.406+0000 7facc6a00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc015d7c0 0x7facc014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:35.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.406+0000 7facbfe00640 1 -- 172.21.15.63:0/1124588785 learned_addr learned my addr 172.21.15.63:0/1124588785 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T11:07:35.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.406+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc00d0ee0 con 0x7facc015bbc0 2024-03-26T11:07:35.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.406+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc00d0d60 con 0x7facc015d7c0 2024-03-26T11:07:35.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.406+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc00d1060 con 0x7facc00b7620 2024-03-26T11:07:35.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.406+0000 7facbf400640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facc015bbc0 0x7facc015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:35.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.406+0000 7facc4a00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc015d7c0 0x7facc014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:35.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.407+0000 7facbfe00640 1 -- 172.21.15.63:0/1124588785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc015d7c0 msgr2=0x7facc014ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:35.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.407+0000 7facbfe00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc015d7c0 0x7facc014ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.407+0000 7facbfe00640 1 -- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facc015bbc0 msgr2=0x7facc015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:35.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.407+0000 7facbfe00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facc015bbc0 0x7facc015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:35.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.407+0000 7facbfe00640 1 -- 172.21.15.63:0/1124588785 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc00c9c30 con 0x7facc00b7620 2024-03-26T11:07:35.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.408+0000 7facbfe00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc00b7620 0x7facc00b6830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7facb000d800 tx=0x7facb000dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:35.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.408+0000 7facb7e00640 1 -- 172.21.15.63:0/1124588785 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb000b6c0 con 0x7facc00b7620 2024-03-26T11:07:35.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.409+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc00c9670 con 0x7facc00b7620 2024-03-26T11:07:35.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.409+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc014e440 con 0x7facc00b7620 2024-03-26T11:07:35.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.409+0000 7facb7e00640 1 -- 172.21.15.63:0/1124588785 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb0019070 con 0x7facc00b7620 2024-03-26T11:07:35.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.409+0000 7facb7e00640 1 -- 172.21.15.63:0/1124588785 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb000b6c0 con 0x7facc00b7620 2024-03-26T11:07:35.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.410+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac98005290 con 0x7facc00b7620 2024-03-26T11:07:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.414+0000 7facb7e00640 1 -- 172.21.15.63:0/1124588785 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7facb000b860 con 0x7facc00b7620 2024-03-26T11:07:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.416+0000 7facb7e00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faca006be00 0x7faca006e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.416+0000 7facb7e00640 1 -- 172.21.15.63:0/1124588785 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6130+0+0 (secure 0 0 0) 0x7facb008b660 con 0x7facc00b7620 2024-03-26T11:07:35.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.417+0000 7facbf400640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faca006be00 0x7faca006e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:35.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.419+0000 7facbf400640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faca006be00 0x7faca006e2c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7facac034000 tx=0x7facac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:35.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:35.818+0000 7facb7e00640 1 -- 172.21.15.63:0/1124588785 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7facb005a010 con 0x7facc00b7620 2024-03-26T11:07:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.144+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac98005850 con 0x7facc00b7620 2024-03-26T11:07:36.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.339+0000 7facb7e00640 1 -- 172.21.15.63:0/1124588785 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7facb0059910 con 0x7facc00b7620 2024-03-26T11:07:36.339 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-03-26T11:07:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faca006be00 msgr2=0x7faca006e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faca006be00 0x7faca006e2c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7facac034000 tx=0x7facac008030 comp rx=0 tx=0).stop 2024-03-26T11:07:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc00b7620 msgr2=0x7facc00b6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc00b7620 0x7facc00b6830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7facb000d800 tx=0x7facb000dcc0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 shutdown_connections 2024-03-26T11:07:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7faca006be00 0x7faca006e2c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc015d7c0 0x7facc014ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facc015bbc0 0x7facc015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 --2- 172.21.15.63:0/1124588785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc00b7620 0x7facc00b6830 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.341+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 >> 172.21.15.63:0/1124588785 conn(0x7facc0071000 msgr2=0x7facc00ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:36.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.342+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 shutdown_connections 2024-03-26T11:07:36.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.342+0000 7facc6a00640 1 -- 172.21.15.63:0/1124588785 wait complete. 2024-03-26T11:07:36.368 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-26T11:07:36.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.640+0000 7f3d8c400640 1 Processor -- start 2024-03-26T11:07:36.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.641+0000 7f3d8c400640 1 -- start start 2024-03-26T11:07:36.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.643+0000 7f3d8c400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d840cf550 0x7f3d84159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:36.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.643+0000 7f3d8c400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b31b0 0x7f3d840712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:36.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.643+0000 7f3d8c400640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d84160790 con 0x7f3d840b3640 2024-03-26T11:07:36.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.643+0000 7f3d8c400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d840ccac0 con 0x7f3d840cf550 2024-03-26T11:07:36.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.643+0000 7f3d8c400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d84159fd0 con 0x7f3d840b31b0 2024-03-26T11:07:36.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.644+0000 7f3d89000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b31b0 0x7f3d840712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:36.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.644+0000 7f3d89a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d840cf550 0x7f3d84159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:36.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.644+0000 7f3d89000640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b31b0 0x7f3d840712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.63:44688/0 (socket says 172.21.15.63:44688) 2024-03-26T11:07:36.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.644+0000 7f3d89000640 1 -- 172.21.15.63:0/538693607 learned_addr learned my addr 172.21.15.63:0/538693607 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T11:07:36.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.645+0000 7f3d89000640 1 -- 172.21.15.63:0/538693607 >> v2:172.21.15.63:3300/0 conn(0x7f3d840cf550 msgr2=0x7f3d84159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T11:07:36.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.645+0000 7f3d89000640 1 --2- 172.21.15.63:0/538693607 >> v2:172.21.15.63:3300/0 conn(0x7f3d840cf550 0x7f3d84159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.645+0000 7f3d89000640 1 -- 172.21.15.63:0/538693607 >> v1:172.21.15.204:6789/0 conn(0x7f3d840b3640 legacy=0x7f3d8406d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:36.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.645+0000 7f3d89000640 1 -- 172.21.15.63:0/538693607 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8406eb60 con 0x7f3d840b31b0 2024-03-26T11:07:36.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.646+0000 7f3d89a00640 1 --2- 172.21.15.63:0/538693607 >> v2:172.21.15.63:3300/0 conn(0x7f3d840cf550 0x7f3d84159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-26T11:07:36.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.647+0000 7f3d89000640 1 --2- 172.21.15.63:0/538693607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b31b0 0x7f3d840712f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009870 tx=0x7f3d7002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6a7902f0b3a8322 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:36.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.648+0000 7f3d83e00640 1 -- 172.21.15.63:0/538693607 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70034070 con 0x7f3d840b31b0 2024-03-26T11:07:36.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.648+0000 7f3d83e00640 1 -- 172.21.15.63:0/538693607 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d70030840 con 0x7f3d840b31b0 2024-03-26T11:07:36.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.648+0000 7f3d83e00640 1 -- 172.21.15.63:0/538693607 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70030c10 con 0x7f3d840b31b0 2024-03-26T11:07:36.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.649+0000 7f3d8c400640 1 -- 172.21.15.63:0/538693607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b31b0 msgr2=0x7f3d840712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:36.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.649+0000 7f3d8c400640 1 --2- 172.21.15.63:0/538693607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b31b0 0x7f3d840712f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009870 tx=0x7f3d7002b980 comp rx=0 tx=0).stop 2024-03-26T11:07:36.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.649+0000 7f3d8c400640 1 -- 172.21.15.63:0/538693607 shutdown_connections 2024-03-26T11:07:36.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.649+0000 7f3d8c400640 1 --2- 172.21.15.63:0/538693607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b31b0 0x7f3d840712f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.649+0000 7f3d8c400640 1 --2- 172.21.15.63:0/538693607 >> v2:172.21.15.63:3300/0 conn(0x7f3d840cf550 0x7f3d84159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.649+0000 7f3d8c400640 1 -- 172.21.15.63:0/538693607 >> 172.21.15.63:0/538693607 conn(0x7f3d8406b0b0 msgr2=0x7f3d8406b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:36.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.649+0000 7f3d8c400640 1 -- 172.21.15.63:0/538693607 shutdown_connections 2024-03-26T11:07:36.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.650+0000 7f3d8c400640 1 -- 172.21.15.63:0/538693607 wait complete. 2024-03-26T11:07:36.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.651+0000 7f3d8c400640 1 Processor -- start 2024-03-26T11:07:36.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.651+0000 7f3d8c400640 1 -- start start 2024-03-26T11:07:36.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.652+0000 7f3d8c400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d840b31b0 0x7f3d84140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:36.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.652+0000 7f3d8c400640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b3640 0x7f3d8413c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:36.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.652+0000 7f3d8c400640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d840cf550 0x7f3d8413c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:36.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.652+0000 7f3d8c400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8406f120 con 0x7f3d840b31b0 2024-03-26T11:07:36.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.652+0000 7f3d8c400640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8406e510 con 0x7f3d840cf550 2024-03-26T11:07:36.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.652+0000 7f3d8c400640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8406f2a0 con 0x7f3d840b3640 2024-03-26T11:07:36.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.653+0000 7f3d89a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d840b31b0 0x7f3d84140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:36.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.653+0000 7f3d89a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d840b31b0 0x7f3d84140550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35302/0 (socket says 172.21.15.63:35302) 2024-03-26T11:07:36.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.653+0000 7f3d89a00640 1 -- 172.21.15.63:0/4183314638 learned_addr learned my addr 172.21.15.63:0/4183314638 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T11:07:36.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.653+0000 7f3d89a00640 1 -- 172.21.15.63:0/4183314638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b3640 msgr2=0x7f3d8413c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:36.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.653+0000 7f3d89a00640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b3640 0x7f3d8413c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.653+0000 7f3d89a00640 1 -- 172.21.15.63:0/4183314638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d840cf550 msgr2=0x7f3d8413c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:36.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.653+0000 7f3d89a00640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d840cf550 0x7f3d8413c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:36.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.653+0000 7f3d89a00640 1 -- 172.21.15.63:0/4183314638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8415c610 con 0x7f3d840b31b0 2024-03-26T11:07:36.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.654+0000 7f3d89a00640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d840b31b0 0x7f3d84140550 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800e960 tx=0x7f3d7800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:36.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.654+0000 7f3d81600640 1 -- 172.21.15.63:0/4183314638 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78017070 con 0x7f3d840b31b0 2024-03-26T11:07:36.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.654+0000 7f3d81600640 1 -- 172.21.15.63:0/4183314638 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800ca00 con 0x7f3d840b31b0 2024-03-26T11:07:36.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.654+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8414ba40 con 0x7f3d840b31b0 2024-03-26T11:07:36.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.654+0000 7f3d81600640 1 -- 172.21.15.63:0/4183314638 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800cdd0 con 0x7f3d840b31b0 2024-03-26T11:07:36.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.654+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8414c000 con 0x7f3d840b31b0 2024-03-26T11:07:36.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.656+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d84074730 con 0x7f3d840b31b0 2024-03-26T11:07:36.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.657+0000 7f3d81600640 1 -- 172.21.15.63:0/4183314638 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3d7801a070 con 0x7f3d840b31b0 2024-03-26T11:07:36.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.657+0000 7f3d81600640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d6406bc00 0x7f3d6406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:36.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.658+0000 7f3d81600640 1 -- 172.21.15.63:0/4183314638 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f3d7808ae50 con 0x7f3d840b31b0 2024-03-26T11:07:36.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.658+0000 7f3d89000640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d6406bc00 0x7f3d6406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:36.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.659+0000 7f3d89000640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d6406bc00 0x7f3d6406e0c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3d70036000 tx=0x7f3d7003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:36.684+0000 7f3d81600640 1 -- 172.21.15.63:0/4183314638 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f3d78059780 con 0x7f3d840b31b0 2024-03-26T11:07:37.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.008+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d840cd320 con 0x7f3d840b31b0 2024-03-26T11:07:37.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.021+0000 7f3d81600640 1 -- 172.21.15.63:0/4183314638 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d78059080 con 0x7f3d840b31b0 2024-03-26T11:07:37.022 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-03-26T11:07:37.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.024+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d6406bc00 msgr2=0x7f3d6406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.024+0000 7f3d8c400640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d6406bc00 0x7f3d6406e0c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3d70036000 tx=0x7f3d7003b040 comp rx=0 tx=0).stop 2024-03-26T11:07:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.024+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d840b31b0 msgr2=0x7f3d84140550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.024+0000 7f3d8c400640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d840b31b0 0x7f3d84140550 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800e960 tx=0x7f3d7800ee20 comp rx=0 tx=0).stop 2024-03-26T11:07:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.025+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 shutdown_connections 2024-03-26T11:07:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.025+0000 7f3d8c400640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f3d6406bc00 0x7f3d6406e0c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.025+0000 7f3d8c400640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d840cf550 0x7f3d8413c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.025+0000 7f3d8c400640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d840b3640 0x7f3d8413c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.025+0000 7f3d8c400640 1 --2- 172.21.15.63:0/4183314638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d840b31b0 0x7f3d84140550 secure :-1 s=CLOSED pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800e960 tx=0x7f3d7800ee20 comp rx=0 tx=0).stop 2024-03-26T11:07:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.025+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 >> 172.21.15.63:0/4183314638 conn(0x7f3d8406b0b0 msgr2=0x7f3d840cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.025+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 shutdown_connections 2024-03-26T11:07:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.026+0000 7f3d8c400640 1 -- 172.21.15.63:0/4183314638 wait complete. 2024-03-26T11:07:37.050 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-26T11:07:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.310+0000 7f7e19600640 1 Processor -- start 2024-03-26T11:07:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.311+0000 7f7e19600640 1 -- start start 2024-03-26T11:07:37.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.313+0000 7f7e19600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140cfb40 0x7f7e140b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:37.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.313+0000 7f7e19600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e141633c0 con 0x7f7e140b3630 2024-03-26T11:07:37.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.313+0000 7f7e19600640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140cffa0 con 0x7f7e140aeb80 2024-03-26T11:07:37.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.313+0000 7f7e19600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b3aa0 con 0x7f7e140cfb40 2024-03-26T11:07:37.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.313+0000 7f7e13400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7e140b3630 0x7f7e14165dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37022/0 (socket says 172.21.15.63:37022) 2024-03-26T11:07:37.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.313+0000 7f7e13400640 1 -- 172.21.15.63:0/745232031 learned_addr learned my addr 172.21.15.63:0/745232031 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-26T11:07:37.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.314+0000 7f7e12000640 1 --2- 172.21.15.63:0/745232031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140cfb40 0x7f7e140b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.314+0000 7f7e11600640 1 -- 172.21.15.63:0/745232031 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321154713 0 0) 0x7f7e141633c0 con 0x7f7e140b3630 2024-03-26T11:07:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.314+0000 7f7e11600640 1 -- 172.21.15.63:0/745232031 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df8003520 con 0x7f7e140b3630 2024-03-26T11:07:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.315+0000 7f7e12000640 1 -- 172.21.15.63:0/745232031 >> v1:172.21.15.204:6789/0 conn(0x7f7e140aeb80 legacy=0x7f7e1406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.315+0000 7f7e12000640 1 -- 172.21.15.63:0/745232031 >> v1:172.21.15.63:6789/0 conn(0x7f7e140b3630 legacy=0x7f7e14165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.315+0000 7f7e12000640 1 -- 172.21.15.63:0/745232031 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14162840 con 0x7f7e140cfb40 2024-03-26T11:07:37.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.317+0000 7f7e12000640 1 --2- 172.21.15.63:0/745232031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140cfb40 0x7f7e140b30f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e000097d0 tx=0x7f7e0002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afffa270b00747bd server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:37.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.317+0000 7f7e11600640 1 -- 172.21.15.63:0/745232031 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00031780 con 0x7f7e140cfb40 2024-03-26T11:07:37.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.317+0000 7f7e11600640 1 -- 172.21.15.63:0/745232031 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00037070 con 0x7f7e140cfb40 2024-03-26T11:07:37.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.317+0000 7f7e11600640 1 -- 172.21.15.63:0/745232031 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00031b40 con 0x7f7e140cfb40 2024-03-26T11:07:37.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.318+0000 7f7e19600640 1 -- 172.21.15.63:0/745232031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140cfb40 msgr2=0x7f7e140b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:37.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.318+0000 7f7e19600640 1 --2- 172.21.15.63:0/745232031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140cfb40 0x7f7e140b30f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e000097d0 tx=0x7f7e0002b820 comp rx=0 tx=0).stop 2024-03-26T11:07:37.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.319+0000 7f7e19600640 1 -- 172.21.15.63:0/745232031 shutdown_connections 2024-03-26T11:07:37.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.319+0000 7f7e19600640 1 --2- 172.21.15.63:0/745232031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140cfb40 0x7f7e140b30f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.319+0000 7f7e19600640 1 -- 172.21.15.63:0/745232031 >> 172.21.15.63:0/745232031 conn(0x7f7e1406ac90 msgr2=0x7f7e1406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:37.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.319+0000 7f7e19600640 1 -- 172.21.15.63:0/745232031 shutdown_connections 2024-03-26T11:07:37.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.319+0000 7f7e19600640 1 -- 172.21.15.63:0/745232031 wait complete. 2024-03-26T11:07:37.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.321+0000 7f7e19600640 1 Processor -- start 2024-03-26T11:07:37.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.321+0000 7f7e19600640 1 -- start start 2024-03-26T11:07:37.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e19600640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e140aeb80 0x7f7e141612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:37.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e19600640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140b3630 0x7f7e141595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:37.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e19600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e140cfb40 0x7f7e14157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:37.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e19600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141630e0 con 0x7f7e140cfb40 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e19600640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14162e00 con 0x7f7e140aeb80 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e19600640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140aef60 con 0x7f7e140b3630 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e13400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e140cfb40 0x7f7e14157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e13400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e140cfb40 0x7f7e14157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35316/0 (socket says 172.21.15.63:35316) 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e13400640 1 -- 172.21.15.63:0/2920968731 learned_addr learned my addr 172.21.15.63:0/2920968731 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e12000640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140b3630 0x7f7e141595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.323+0000 7f7e12a00640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e140aeb80 0x7f7e141612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.324+0000 7f7e13400640 1 -- 172.21.15.63:0/2920968731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140b3630 msgr2=0x7f7e141595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.324+0000 7f7e13400640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140b3630 0x7f7e141595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.324+0000 7f7e13400640 1 -- 172.21.15.63:0/2920968731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e140aeb80 msgr2=0x7f7e141612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.324+0000 7f7e13400640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e140aeb80 0x7f7e141612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.324+0000 7f7e13400640 1 -- 172.21.15.63:0/2920968731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14159250 con 0x7f7e140cfb40 2024-03-26T11:07:37.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.324+0000 7f7e13400640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e140cfb40 0x7f7e14157bf0 secure :-1 s=READY pgs=2678 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00cad0 tx=0x7f7e0c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:37.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.325+0000 7f7e0aa00640 1 -- 172.21.15.63:0/2920968731 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c017070 con 0x7f7e140cfb40 2024-03-26T11:07:37.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.325+0000 7f7e0aa00640 1 -- 172.21.15.63:0/2920968731 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c00ac30 con 0x7f7e140cfb40 2024-03-26T11:07:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.325+0000 7f7e0aa00640 1 -- 172.21.15.63:0/2920968731 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c012400 con 0x7f7e140cfb40 2024-03-26T11:07:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.325+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e14160800 con 0x7f7e140cfb40 2024-03-26T11:07:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.325+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e14160aa0 con 0x7f7e140cfb40 2024-03-26T11:07:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.326+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e140b2b20 con 0x7f7e140cfb40 2024-03-26T11:07:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.329+0000 7f7e0aa00640 1 -- 172.21.15.63:0/2920968731 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7e0c01a070 con 0x7f7e140cfb40 2024-03-26T11:07:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.330+0000 7f7e0aa00640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7df406bca0 0x7f7df406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.330+0000 7f7e0aa00640 1 -- 172.21.15.63:0/2920968731 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f7e0c08a9d0 con 0x7f7e140cfb40 2024-03-26T11:07:37.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.333+0000 7f7e12a00640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7df406bca0 0x7f7df406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:37.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.335+0000 7f7e12a00640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7df406bca0 0x7f7df406e160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7e04000f60 tx=0x7f7e04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:37.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.340+0000 7f7e0aa00640 1 -- 172.21.15.63:0/2920968731 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7e140b2b20 con 0x7f7e140cfb40 2024-03-26T11:07:37.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.686+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e14073eb0 con 0x7f7e140cfb40 2024-03-26T11:07:37.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.687+0000 7f7e0aa00640 1 -- 172.21.15.63:0/2920968731 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e0c058ca0 con 0x7f7e140cfb40 2024-03-26T11:07:37.687 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-03-26T11:07:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.691+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7df406bca0 msgr2=0x7f7df406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.691+0000 7f7e19600640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7df406bca0 0x7f7df406e160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7e04000f60 tx=0x7f7e04009040 comp rx=0 tx=0).stop 2024-03-26T11:07:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.691+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e140cfb40 msgr2=0x7f7e14157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.691+0000 7f7e19600640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e140cfb40 0x7f7e14157bf0 secure :-1 s=READY pgs=2678 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00cad0 tx=0x7f7e0c00cf90 comp rx=0 tx=0).stop 2024-03-26T11:07:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.692+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 shutdown_connections 2024-03-26T11:07:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.692+0000 7f7e19600640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7f7df406bca0 0x7f7df406e160 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.692+0000 7f7e19600640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e140cfb40 0x7f7e14157bf0 unknown :-1 s=CLOSED pgs=2678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.692+0000 7f7e19600640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e140b3630 0x7f7e141595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.692+0000 7f7e19600640 1 --2- 172.21.15.63:0/2920968731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e140aeb80 0x7f7e141612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.692+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 >> 172.21.15.63:0/2920968731 conn(0x7f7e1406ac90 msgr2=0x7f7e140afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.692+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 shutdown_connections 2024-03-26T11:07:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:37.693+0000 7f7e19600640 1 -- 172.21.15.63:0/2920968731 wait complete. 2024-03-26T11:07:37.719 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-26T11:07:38.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.118+0000 7fcbf3200640 1 Processor -- start 2024-03-26T11:07:38.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.118+0000 7fcbf3200640 1 -- start start 2024-03-26T11:07:38.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.120+0000 7fcbf3200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbec0e3160 0x7fcbec0e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:38.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.120+0000 7fcbf3200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcbec03c0a0 0x7fcbec058050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:38.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.120+0000 7fcbf3200640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec058590 con 0x7fcbec053cb0 2024-03-26T11:07:38.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.120+0000 7fcbf3200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec007b70 con 0x7fcbec03c0a0 2024-03-26T11:07:38.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.120+0000 7fcbf3200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec058810 con 0x7fcbec0e3160 2024-03-26T11:07:38.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.121+0000 7fcbf1400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcbec03c0a0 0x7fcbec058050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:38.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.121+0000 7fcbf1400640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcbec03c0a0 0x7fcbec058050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:46626/0 (socket says 172.21.15.63:46626) 2024-03-26T11:07:38.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.121+0000 7fcbf1400640 1 -- 172.21.15.63:0/3759973795 learned_addr learned my addr 172.21.15.63:0/3759973795 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T11:07:38.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.121+0000 7fcbf1400640 1 -- 172.21.15.63:0/3759973795 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbec0e3160 msgr2=0x7fcbec0e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T11:07:38.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.121+0000 7fcbf1400640 1 --2- 172.21.15.63:0/3759973795 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbec0e3160 0x7fcbec0e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.121+0000 7fcbf1400640 1 -- 172.21.15.63:0/3759973795 >> v1:172.21.15.204:6789/0 conn(0x7fcbec053cb0 legacy=0x7fcbec054120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-26T11:07:38.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.121+0000 7fcbf1400640 1 -- 172.21.15.63:0/3759973795 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec058af0 con 0x7fcbec03c0a0 2024-03-26T11:07:38.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.123+0000 7fcbf1400640 1 --2- 172.21.15.63:0/3759973795 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 0x7fcbec058050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009870 tx=0x7fcbe002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96a348341927e117 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:38.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.123+0000 7fcbf0a00640 1 -- 172.21.15.63:0/3759973795 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0035020 con 0x7fcbec03c0a0 2024-03-26T11:07:38.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.123+0000 7fcbf0a00640 1 -- 172.21.15.63:0/3759973795 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe0031640 con 0x7fcbec03c0a0 2024-03-26T11:07:38.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.123+0000 7fcbf0a00640 1 -- 172.21.15.63:0/3759973795 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe002d040 con 0x7fcbec03c0a0 2024-03-26T11:07:38.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.124+0000 7fcbf3200640 1 -- 172.21.15.63:0/3759973795 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 msgr2=0x7fcbec058050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:38.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.124+0000 7fcbf3200640 1 --2- 172.21.15.63:0/3759973795 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 0x7fcbec058050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009870 tx=0x7fcbe002b8f0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.126+0000 7fcbf3200640 1 -- 172.21.15.63:0/3759973795 shutdown_connections 2024-03-26T11:07:38.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.126+0000 7fcbf3200640 1 --2- 172.21.15.63:0/3759973795 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 0x7fcbec058050 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.126+0000 7fcbf3200640 1 --2- 172.21.15.63:0/3759973795 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbec0e3160 0x7fcbec0e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.126+0000 7fcbf3200640 1 -- 172.21.15.63:0/3759973795 >> 172.21.15.63:0/3759973795 conn(0x7fcbec058ee0 msgr2=0x7fcbec0592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:38.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.127+0000 7fcbf3200640 1 -- 172.21.15.63:0/3759973795 shutdown_connections 2024-03-26T11:07:38.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.128+0000 7fcbf3200640 1 -- 172.21.15.63:0/3759973795 wait complete. 2024-03-26T11:07:38.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.132+0000 7fcbf3200640 1 Processor -- start 2024-03-26T11:07:38.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.132+0000 7fcbf3200640 1 -- start start 2024-03-26T11:07:38.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.140+0000 7fcbf3200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 0x7fcbec052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:38.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.140+0000 7fcbf3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbec053cb0 0x7fcbec04ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:38.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.140+0000 7fcbf3200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbec0e3160 0x7fcbec03d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:38.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.141+0000 7fcbf3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0e3540 con 0x7fcbec053cb0 2024-03-26T11:07:38.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.141+0000 7fcbf3200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec006640 con 0x7fcbec03c0a0 2024-03-26T11:07:38.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.141+0000 7fcbf3200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec006b60 con 0x7fcbec0e3160 2024-03-26T11:07:38.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.141+0000 7fcbf1e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 0x7fcbec052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.141+0000 7fcbf1e00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 0x7fcbec052160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.63:46642/0 (socket says 172.21.15.63:46642) 2024-03-26T11:07:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.141+0000 7fcbf1e00640 1 -- 172.21.15.63:0/1130906899 learned_addr learned my addr 172.21.15.63:0/1130906899 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-26T11:07:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.141+0000 7fcbf1400640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbec053cb0 0x7fcbec04ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.142+0000 7fcbf2800640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbec0e3160 0x7fcbec03d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.142+0000 7fcbf1e00640 1 -- 172.21.15.63:0/1130906899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbec0e3160 msgr2=0x7fcbec03d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.142+0000 7fcbf1e00640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbec0e3160 0x7fcbec03d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.142+0000 7fcbf1e00640 1 -- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbec053cb0 msgr2=0x7fcbec04ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.142+0000 7fcbf1e00640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbec053cb0 0x7fcbec04ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.142+0000 7fcbf1e00640 1 -- 172.21.15.63:0/1130906899 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec04d460 con 0x7fcbec03c0a0 2024-03-26T11:07:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.143+0000 7fcbf1e00640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 0x7fcbec052160 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400b440 tx=0x7fcbe400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:38.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.144+0000 7fcbea000640 1 -- 172.21.15.63:0/1130906899 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4015020 con 0x7fcbec03c0a0 2024-03-26T11:07:38.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.144+0000 7fcbea000640 1 -- 172.21.15.63:0/1130906899 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4011890 con 0x7fcbec03c0a0 2024-03-26T11:07:38.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.144+0000 7fcbea000640 1 -- 172.21.15.63:0/1130906899 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4011c80 con 0x7fcbec03c0a0 2024-03-26T11:07:38.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.145+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec04d740 con 0x7fcbec03c0a0 2024-03-26T11:07:38.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.145+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec04dd00 con 0x7fcbec03c0a0 2024-03-26T11:07:38.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.149+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec005390 con 0x7fcbec03c0a0 2024-03-26T11:07:38.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.152+0000 7fcbea000640 1 -- 172.21.15.63:0/1130906899 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fcbe4018020 con 0x7fcbec03c0a0 2024-03-26T11:07:38.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.154+0000 7fcbea000640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcbd406bbd0 0x7fcbd406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-26T11:07:38.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.155+0000 7fcbea000640 1 -- 172.21.15.63:0/1130906899 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fcbe408ad60 con 0x7fcbec03c0a0 2024-03-26T11:07:38.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.155+0000 7fcbf1400640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcbd406bbd0 0x7fcbd406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-26T11:07:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.157+0000 7fcbf1400640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcbd406bbd0 0x7fcbd406e090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0036000 tx=0x7fcbe003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-26T11:07:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.159+0000 7fcbea000640 1 -- 172.21.15.63:0/1130906899 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fcbe401f020 con 0x7fcbec03c0a0 2024-03-26T11:07:38.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.513+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcbec04e020 con 0x7fcbec03c0a0 2024-03-26T11:07:38.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.514+0000 7fcbea000640 1 -- 172.21.15.63:0/1130906899 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcbec04e020 con 0x7fcbec03c0a0 2024-03-26T11:07:38.515 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-03-26T11:07:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.519+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcbd406bbd0 msgr2=0x7fcbd406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.519+0000 7fcbf3200640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcbd406bbd0 0x7fcbd406e090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0036000 tx=0x7fcbe003c040 comp rx=0 tx=0).stop 2024-03-26T11:07:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.519+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 msgr2=0x7fcbec052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-26T11:07:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.519+0000 7fcbf3200640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 0x7fcbec052160 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400b440 tx=0x7fcbe400b900 comp rx=0 tx=0).stop 2024-03-26T11:07:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.520+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 shutdown_connections 2024-03-26T11:07:38.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.520+0000 7fcbf3200640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:6832/3591189670,v1:172.21.15.63:6833/3591189670] conn(0x7fcbd406bbd0 0x7fcbd406e090 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.520+0000 7fcbf3200640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbec0e3160 0x7fcbec03d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.520+0000 7fcbf3200640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbec053cb0 0x7fcbec04ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.520+0000 7fcbf3200640 1 --2- 172.21.15.63:0/1130906899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbec03c0a0 0x7fcbec052160 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-26T11:07:38.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.520+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 >> 172.21.15.63:0/1130906899 conn(0x7fcbec058ee0 msgr2=0x7fcbec004c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-26T11:07:38.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.520+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 shutdown_connections 2024-03-26T11:07:38.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-26T11:07:38.520+0000 7fcbf3200640 1 -- 172.21.15.63:0/1130906899 wait complete. 2024-03-26T11:07:38.546 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-26T11:07:38.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T11:07:38.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-26T11:07:38.674 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T11:07:38.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T11:07:38.675 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-26T11:07:38.745 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T11:07:38.745 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T11:07:38.804 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053434,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498372k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249184k,nr_inodes=812296,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498372k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.63:6789:/test /tmp/tmp.LsIyRsPUXptest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=82863fce-9065-4f8e-a61f-944fd870ef74,acl 0 0 172.21.15.63:6789:/scratch /tmp/tmp.IruX4MVgMUscratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=82863fce-9065-4f8e-a61f-944fd870ef74,acl 0 0 2024-03-26T11:07:38.805 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T11:07:38.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T11:07:38.805 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-26T11:07:38.865 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-03-26T11:07:38.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T11:07:38.867 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T11:07:38.867 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T11:07:38.927 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498332k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249164k,nr_inodes=812291,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498332k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-26T11:07:38.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T11:07:38.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T11:07:38.928 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-26T11:07:38.985 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-03-26T11:07:38.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T11:07:38.986 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T11:07:38.986 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T11:07:39.035 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498332k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249164k,nr_inodes=812291,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498332k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-26T11:07:39.035 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T11:07:39.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T11:07:39.036 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-26T11:07:39.124 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-26T11:07:39.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T11:07:40.735 INFO:tasks.ceph.osd.0:Sent signal 15 2024-03-26T11:07:40.736 INFO:tasks.ceph.osd.1:Sent signal 15 2024-03-26T11:07:40.736 INFO:tasks.ceph.osd.2:Sent signal 15 2024-03-26T11:07:40.736 INFO:tasks.ceph.osd.3:Sent signal 15 2024-03-26T11:07:40.737 INFO:tasks.ceph.osd.4:Sent signal 15 2024-03-26T11:07:40.737 INFO:tasks.ceph.osd.6:Sent signal 15 2024-03-26T11:07:40.737 INFO:tasks.ceph.osd.7:Sent signal 15 2024-03-26T11:07:40.737 INFO:tasks.ceph.mds.a:Sent signal 15 2024-03-26T11:07:40.737 INFO:tasks.ceph.mds.c:Sent signal 15 2024-03-26T11:07:40.738 INFO:tasks.ceph.mds.b:Sent signal 15 2024-03-26T11:07:40.738 INFO:tasks.ceph.mds.d:Sent signal 15 2024-03-26T11:07:40.738 INFO:tasks.ceph.mon.a:Sent signal 15 2024-03-26T11:07:40.739 INFO:tasks.ceph.mon.b:Sent signal 15 2024-03-26T11:07:40.739 INFO:tasks.ceph.mon.c:Sent signal 15 2024-03-26T11:07:40.739 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-03-26T11:07:40.739 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-03-26T11:07:40.740 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T11:07:40.738+0000 7fe857200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 37223) UID: 0 2024-03-26T11:07:40.740 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T11:07:40.738+0000 7fe857200640 -1 osd.3 43 *** Got signal Terminated *** 2024-03-26T11:07:40.740 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-26T11:07:40.738+0000 7fe857200640 -1 osd.3 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T11:07:40.741 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T11:07:40.736+0000 7f7600800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 37213) UID: 0 2024-03-26T11:07:40.741 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T11:07:40.736+0000 7f7600800640 -1 osd.0 43 *** Got signal Terminated *** 2024-03-26T11:07:40.741 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-03-26T11:07:40.736+0000 7f7600800640 -1 osd.0 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T11:07:40.741 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T11:07:40.739+0000 7fdb1c600640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 50864) UID: 0 2024-03-26T11:07:40.741 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-03-26T11:07:40.739+0000 7fdb1c600640 -1 mds.a *** got signal Terminated *** 2024-03-26T11:07:40.742 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-03-26T11:07:40.739+0000 7f8bcd400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 36958) UID: 0 2024-03-26T11:07:40.742 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-03-26T11:07:40.739+0000 7f8bcd400640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-26T11:07:40.742 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T11:07:40.740+0000 7f4916600640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 50865) UID: 0 2024-03-26T11:07:40.742 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-03-26T11:07:40.740+0000 7f4916600640 -1 mds.c *** got signal Terminated *** 2024-03-26T11:07:40.743 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T11:07:40.738+0000 7f55b2400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 37216) UID: 0 2024-03-26T11:07:40.743 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T11:07:40.742+0000 7f5505a00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 36961) UID: 0 2024-03-26T11:07:40.743 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-03-26T11:07:40.742+0000 7f5505a00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-26T11:07:40.744 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-03-26T11:07:40.739+0000 7f301d200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 43423) UID: 0 2024-03-26T11:07:40.744 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-03-26T11:07:40.739+0000 7f301d200640 -1 mds.b *** got signal Terminated *** 2024-03-26T11:07:40.744 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T11:07:40.739+0000 7f7a19800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 37328) UID: 0 2024-03-26T11:07:40.744 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T11:07:40.739+0000 7f7a19800640 -1 osd.6 43 *** Got signal Terminated *** 2024-03-26T11:07:40.744 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-26T11:07:40.739+0000 7f7a19800640 -1 osd.6 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T11:07:40.745 INFO:tasks.ceph.mon.b.smithi204.stderr:2024-03-26T11:07:40.741+0000 7f9d1c400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 36745) UID: 0 2024-03-26T11:07:40.745 INFO:tasks.ceph.mon.b.smithi204.stderr:2024-03-26T11:07:40.741+0000 7f9d1c400640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-03-26T11:07:40.745 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T11:07:40.740+0000 7f7b93200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 37331) UID: 0 2024-03-26T11:07:40.745 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T11:07:40.740+0000 7f7b93200640 -1 osd.7 43 *** Got signal Terminated *** 2024-03-26T11:07:40.745 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-26T11:07:40.740+0000 7f7b93200640 -1 osd.7 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T11:07:40.750 INFO:tasks.ceph.mon.c.smithi204.stderr:2024-03-26T11:07:40.747+0000 7f4df5c00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 36746) UID: 0 2024-03-26T11:07:40.750 INFO:tasks.ceph.mon.c.smithi204.stderr:2024-03-26T11:07:40.747+0000 7f4df5c00640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-03-26T11:07:40.750 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T11:07:40.744+0000 7fadfe000640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 37327) UID: 0 2024-03-26T11:07:40.750 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T11:07:40.744+0000 7fadfe000640 -1 osd.4 43 *** Got signal Terminated *** 2024-03-26T11:07:40.751 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-26T11:07:40.744+0000 7fadfe000640 -1 osd.4 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T11:07:40.751 INFO:tasks.ceph.mds.d.smithi204.stderr:2024-03-26T11:07:40.750+0000 7fd277a00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 43422) UID: 0 2024-03-26T11:07:40.751 INFO:tasks.ceph.mds.d.smithi204.stderr:2024-03-26T11:07:40.750+0000 7fd277a00640 -1 mds.d *** got signal Terminated *** 2024-03-26T11:07:40.754 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T11:07:40.752+0000 7f55b2400640 -1 osd.1 43 *** Got signal Terminated *** 2024-03-26T11:07:40.754 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-03-26T11:07:40.752+0000 7f55b2400640 -1 osd.1 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T11:07:40.755 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T11:07:40.750+0000 7f2851400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 37221) UID: 0 2024-03-26T11:07:40.755 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T11:07:40.750+0000 7f2851400640 -1 osd.2 43 *** Got signal Terminated *** 2024-03-26T11:07:40.755 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-03-26T11:07:40.750+0000 7f2851400640 -1 osd.2 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T11:07:40.943 INFO:tasks.ceph.mgr.x.smithi204.stderr:daemon-helper: command crashed with signal 15 2024-03-26T11:07:45.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:07:45.701 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:10:08.155 INFO:teuthology.orchestra.run.smithi063.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.2.log.1: 2024-03-26T11:10:08.156 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: stdin: file size changed while zipping 2024-03-26T11:10:41.023 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:10:41.032 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:11:11.169 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:11:11.177 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:11:41.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:11:41.399 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:12:11.570 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:12:11.578 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:12:41.767 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:12:41.775 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:13:11.989 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:13:11.997 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:13:42.202 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:13:42.211 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:14:12.457 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:14:12.466 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:14:42.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:14:42.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:15:12.866 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:15:12.875 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:15:43.055 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:15:43.064 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:16:13.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:16:13.284 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:16:43.473 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:16:43.481 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:17:13.687 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:17:13.695 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:17:43.917 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:17:43.926 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:18:14.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:18:14.147 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:18:44.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:18:44.344 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:19:14.559 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:19:14.567 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:19:44.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:19:44.754 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:20:14.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:20:14.977 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:20:45.164 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:20:45.173 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:21:15.377 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:21:15.385 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:21:45.600 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:21:45.609 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:22:15.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:22:15.823 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:22:46.043 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:22:46.051 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:23:16.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:23:16.265 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:23:46.453 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:23:46.461 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:24:16.683 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:24:16.691 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:24:46.896 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:24:46.904 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:25:17.100 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:25:17.109 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:25:47.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:25:47.324 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:26:17.529 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:26:17.537 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:26:47.733 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:26:47.741 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:27:17.921 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:27:17.929 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:27:48.126 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:27:48.135 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:28:18.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:28:18.339 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:28:48.544 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:28:48.552 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:29:18.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:29:18.748 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:29:48.954 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:29:48.962 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:30:19.160 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:30:19.169 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:30:49.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:30:49.373 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:31:19.595 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:31:19.603 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:31:49.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:31:49.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:32:19.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:32:19.971 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:32:50.176 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:32:50.184 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:33:20.364 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:33:20.372 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:33:50.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:33:50.587 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:34:20.741 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:34:20.750 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:34:50.946 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:34:50.954 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:35:21.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:35:21.159 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:35:51.355 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:35:51.363 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:36:21.576 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:36:21.585 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:36:51.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:36:51.789 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:37:21.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:37:21.977 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:37:52.199 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:37:52.208 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:38:22.395 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:38:22.403 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:38:52.599 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:38:52.607 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:39:22.747 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:39:22.756 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:39:52.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:39:52.967 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:40:23.174 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:40:23.182 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:40:53.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:40:53.339 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:41:23.523 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:41:23.533 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:41:53.727 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:41:53.735 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:42:23.957 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:42:23.965 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:42:54.103 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:42:54.111 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:43:24.324 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:43:24.333 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:43:54.553 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:43:54.561 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:44:24.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:44:24.750 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:44:54.946 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:44:54.954 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:45:25.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:45:25.151 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:45:55.347 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:45:55.356 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:46:25.535 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:46:25.544 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:46:55.722 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:46:55.730 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:47:25.874 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:47:25.905 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:47:56.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:47:56.099 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:48:26.313 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:48:26.322 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:48:56.508 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:48:56.517 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:49:26.738 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:49:26.747 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:49:56.944 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:49:56.952 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:50:27.164 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:50:27.173 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:50:57.387 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:50:57.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:51:27.608 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:51:27.615 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:51:57.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:51:57.821 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:52:28.025 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:52:28.034 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:52:58.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:52:58.239 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:53:28.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:53:28.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:53:58.590 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:53:58.598 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:54:28.803 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:54:28.812 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:54:59.009 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:54:59.018 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:55:29.239 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:55:29.248 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:55:59.452 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:55:59.460 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:56:29.665 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:56:29.674 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:56:59.894 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:56:59.903 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:57:30.133 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:57:30.143 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:58:00.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:58:00.344 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:58:30.481 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:58:30.489 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:59:00.689 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:59:00.697 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:59:30.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T11:59:30.917 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:00:01.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:00:01.132 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:00:31.270 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:00:31.278 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:01:01.466 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:01:01.473 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:01:31.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:01:31.630 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:02:01.826 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:02:01.835 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:02:32.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:02:32.031 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:03:02.228 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:03:02.236 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:03:32.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:03:32.449 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:04:02.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:04:02.680 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:04:32.900 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:04:32.908 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:05:03.113 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:05:03.121 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:05:33.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:05:33.334 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:06:03.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:06:03.564 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:06:33.769 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:06:33.777 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:07:03.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:07:03.983 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:07:34.180 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:07:34.188 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:08:04.402 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:08:04.411 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:08:34.632 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:08:34.641 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:09:04.844 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:09:04.853 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:09:35.024 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:09:35.032 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:10:05.220 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:10:05.229 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:10:35.417 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:10:35.426 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:11:05.573 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:11:05.581 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:11:35.794 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:11:35.803 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:12:06.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:12:06.026 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:12:36.222 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:12:36.231 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:13:06.444 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:13:06.453 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:13:36.602 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:13:36.611 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:14:06.797 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:14:06.806 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:14:37.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:14:37.037 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:15:07.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:15:07.249 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:15:37.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:15:37.457 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:16:07.615 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:16:07.624 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:16:37.824 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:16:37.860 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:17:08.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:17:08.080 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:17:38.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:17:38.297 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:18:08.508 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:18:08.517 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:18:38.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:18:38.662 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:19:08.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:19:08.874 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:19:39.080 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:19:39.089 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:20:09.301 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:20:09.309 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:20:39.516 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:20:39.525 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:21:09.711 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:21:09.719 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:21:39.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:21:39.946 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:22:10.131 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:22:10.139 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:22:40.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:22:40.336 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:23:10.541 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:23:10.549 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:23:40.763 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:23:40.772 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:24:10.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:24:10.967 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:24:41.163 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:24:41.171 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:25:11.369 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:25:11.378 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:25:41.599 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:25:41.607 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:26:11.751 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:26:11.759 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:26:41.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:26:41.984 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:27:12.206 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:27:12.214 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:27:42.411 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:27:42.420 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:28:12.590 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:28:12.599 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:28:42.796 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:28:42.805 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:29:13.001 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:29:13.009 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:29:43.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:29:43.231 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:30:13.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:30:13.445 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:30:43.658 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:30:43.667 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:31:13.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:31:13.889 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:31:44.093 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:31:44.101 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:32:14.306 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:32:14.314 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:32:44.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:32:44.519 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:33:14.741 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:33:14.750 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:33:44.956 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:33:44.964 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:34:15.160 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:34:15.169 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:34:45.374 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:34:45.383 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:35:15.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:35:15.595 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:35:45.775 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:35:45.783 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:36:15.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:36:15.989 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:36:46.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:36:46.201 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:37:16.406 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:37:16.414 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:37:46.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:37:46.646 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:38:16.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:38:16.859 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:38:47.056 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:38:47.065 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:39:17.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:39:17.285 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:39:47.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:39:47.508 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:40:17.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:40:17.720 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:40:47.934 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:40:47.943 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:41:18.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:41:18.155 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:41:48.351 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:41:48.359 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:42:18.548 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:42:18.557 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:42:48.752 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:42:48.761 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:43:18.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:43:18.983 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:43:49.250 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:43:49.259 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:44:19.459 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:44:19.468 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:44:49.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:44:49.681 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:45:19.885 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:45:19.894 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:45:50.116 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:45:50.125 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:46:20.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:46:20.336 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:46:50.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:46:50.558 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:47:20.737 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:47:20.745 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:47:50.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:47:50.984 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:48:21.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:48:21.230 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:48:51.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:48:51.450 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:49:21.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:49:21.680 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:49:51.892 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:49:51.901 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:50:22.096 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:50:22.105 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:50:52.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:50:52.339 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:51:22.479 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:51:22.488 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:51:52.711 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:51:52.719 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:52:22.915 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:52:22.924 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:52:53.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:52:53.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:53:23.350 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:53:23.359 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:53:53.548 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:53:53.557 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:54:23.759 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:54:23.767 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:54:53.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:54:53.980 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:55:24.167 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:55:24.175 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:55:54.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:55:54.382 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:56:24.594 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:56:24.602 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:56:54.807 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:56:54.815 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:57:25.002 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:57:25.011 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:57:55.225 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:57:55.234 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:58:25.448 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:58:25.456 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:58:55.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:58:55.651 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:59:25.864 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:59:25.873 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:59:56.077 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T12:59:56.086 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:00:26.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:00:26.290 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:00:56.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:00:56.449 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:01:26.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:01:26.675 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:01:56.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:01:56.888 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:02:27.084 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:02:27.093 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:02:57.290 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:02:57.299 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:03:27.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:03:27.453 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:03:57.640 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:03:57.648 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:04:27.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:04:27.854 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:04:58.058 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:04:58.067 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:05:28.280 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:05:28.288 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:05:58.429 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:05:58.437 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:06:28.631 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:06:28.639 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:06:58.844 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:06:58.852 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:07:29.049 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:07:29.057 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:07:59.253 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:07:59.260 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:08:29.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:08:29.418 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:08:59.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:08:59.615 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:09:29.826 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:09:29.834 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:10:00.048 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:10:00.056 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:10:30.246 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:10:30.254 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:11:00.392 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:11:00.400 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:11:30.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:11:30.605 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:12:00.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:12:00.826 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:12:31.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:12:31.049 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:13:01.236 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:13:01.245 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:13:31.423 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:13:31.433 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:14:01.629 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:14:01.637 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:14:31.833 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:14:31.843 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:15:02.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:15:02.030 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:15:32.234 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:15:32.243 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:16:02.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:16:02.451 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:16:32.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:16:32.662 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:17:02.858 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:17:02.867 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:17:33.054 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:17:33.062 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:18:03.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:18:03.285 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:18:33.480 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:18:33.489 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:19:03.677 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:19:03.685 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:19:33.882 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:19:33.890 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:20:04.079 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:20:04.087 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:20:34.284 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:20:34.293 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:21:04.488 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:21:04.497 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:21:34.685 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:21:34.694 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:22:04.899 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:22:04.907 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:22:35.086 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:22:35.095 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:23:05.292 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:23:05.300 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:23:35.438 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:23:35.446 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:24:05.650 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:24:05.659 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:24:35.848 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:24:35.856 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:25:06.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:25:06.053 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:25:36.275 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:25:36.283 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:26:06.470 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:26:06.478 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:26:36.693 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:26:36.702 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:27:06.908 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:27:06.938 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:27:37.143 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:27:37.152 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:28:07.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:28:07.373 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:28:37.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:28:37.596 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:28:41.457 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T13:28:41.458 INFO:teuthology.orchestra.run.smithi063.stdout:generic/551 2024-03-26T13:28:41.458 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-26T13:28:41.458 INFO:tasks.cephfs.xfstests_dev:Command return value: -1 2024-03-26T13:28:41.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T13:28:41.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T13:28:42.072 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-03-26T13:28:42.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T13:28:42.242 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.W8GLtFOA0Cxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-03-26T13:29:07.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:31:02.303 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-03-26T13:31:02.305 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T13:31:02.306 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-26T13:31:02.306 INFO:tasks.cephfs.xfstests_dev:Command return value: -1 2024-03-26T13:31:02.309 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2024-03-26T13:31:02.310 INFO:tasks.cephfs_test_runner:ERROR 2024-03-26T13:31:02.310 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.310 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-26T13:31:02.310 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-26T13:31:02.310 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 436, in run 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: return gp() 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 393, in run_testdir 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 383, in run_testfile 2024-03-26T13:31:02.311 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 357, in run_test 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/mount.py", line 784, in run_shell 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 440, in run 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi063 was lost: 'sudo env DIFF_LENGTH=0 ./check generic/553' 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 436, in run 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername 2024-03-26T13:31:02.312 INFO:tasks.cephfs_test_runner: return gp() 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 440, in run 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi063 was lost: 'sudo userdel --force --remove fsgqa' 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-26T13:31:02.313 INFO:tasks.cephfs_test_runner:Ran 1 test in 25983.588s 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 436, in run 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner: return gp() 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2024-03-26T13:31:02.314 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 393, in run_testdir 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 383, in run_testfile 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 357, in run_test 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/mount.py", line 784, in run_shell 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 440, in run 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi063 was lost: 'sudo env DIFF_LENGTH=0 ./check generic/553' 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-26T13:31:02.315 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 436, in run 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: return gp() 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-26T13:31:02.316 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 440, in run 2024-03-26T13:31:02.317 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2024-03-26T13:31:02.317 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi063 was lost: 'sudo userdel --force --remove fsgqa' 2024-03-26T13:31:02.317 INFO:tasks.cephfs_test_runner: 2024-03-26T13:31:02.317 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-26T13:31:02.541 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2f86334e26cf442e84910ccd47b07a27 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-26T13:31:02.543 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-26T13:31:02.552 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-26T13:31:02.617 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-26T13:31:02.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T13:31:02.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T13:31:02.621 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2024-03-26T13:31:02.746 ERROR:teuthology.orchestra.connection:Error authenticating with smithi063.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T13:31:06.873 ERROR:teuthology.orchestra.connection:Error authenticating with smithi063.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T13:31:14.002 ERROR:teuthology.orchestra.connection:Error authenticating with smithi063.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T13:31:24.129 ERROR:teuthology.orchestra.connection:Error authenticating with smithi063.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T13:31:32.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T13:31:32.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T13:31:32.917 ERROR:teuthology.orchestra.connection:Error authenticating with smithi063.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T13:32:36.923 DEBUG:teuthology.orchestra.remote:timed out 2024-03-26T13:32:37.133 DEBUG:teuthology.orchestra.remote:timed out 2024-03-26T13:32:45.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T13:32:45.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T13:32:46.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T13:32:46.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T13:33:19.927 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-03-26T13:33:19.928 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-03-26T13:33:20.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T13:33:20.280 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:33:20.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-26T13:33:20.312 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T13:33:20.313 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T13:33:20.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T13:33:20.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T13:33:20.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054624,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19904 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247648k,nr_inodes=811912,mode=700,uid=1000,gid=1301,inode64 0 0 2024-03-26T13:33:20.350 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-26T13:33:20.350 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T13:33:20.380 INFO:teuthology.orchestra.run.smithi063.stderr:error: cannot stat /etc/logrotate.d/ceph-test.conf: No such file or directory 2024-03-26T13:33:20.394 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054624,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19904 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247648k,nr_inodes=811912,mode=700,uid=1000,gid=1301,inode64 0 0 2024-03-26T13:33:20.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T13:33:20.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T13:33:35.933 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-26T13:33:35.934 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-26T13:33:36.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T13:33:36.110 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-26T13:33:36.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-26T13:33:36.110 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T13:33:36.110 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T13:33:36.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:36.153 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 189, in invoke_logrotate File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-26T13:33:36.200 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16251140k,nr_inodes=4062785,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17686 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253744k,mode=700,uid=1000,gid=1285 0 0 2024-03-26T13:33:36.201 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-26T13:33:36.201 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-26T13:33:36.223 INFO:teuthology.orchestra.run.smithi204.stderr:error: cannot stat /etc/logrotate.d/ceph-test.conf: No such file or directory 2024-03-26T13:33:36.240 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16251140k,nr_inodes=4062785,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17686 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253744k,mode=700,uid=1000,gid=1285 0 0 2024-03-26T13:33:36.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T13:33:36.240 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-03-26T13:33:36.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T13:33:36.287 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-03-26T13:33:36.326 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-03-26T13:33:36.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:36.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T13:33:36.328 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-03-26T13:33:36.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T13:33:36.385 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-03-26T13:33:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-03-26T13:33:36.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:36.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T13:33:36.462 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-26T13:33:36.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T13:33:36.502 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-03-26T13:33:36.571 INFO:teuthology.orchestra.run.smithi204.stderr:Cannot find device "ceph-brx" 2024-03-26T13:33:36.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:36.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T13:33:36.573 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-26T13:33:36.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-26T13:33:36.632 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-03-26T13:33:36.700 INFO:teuthology.orchestra.run.smithi204.stderr:Cannot find device "ceph-brx" 2024-03-26T13:33:36.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:36.701 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-26T13:33:36.715 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-26T13:33:36.715 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-26T13:33:36.745 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: adjust-ulimits: command not found 2024-03-26T13:33:36.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:36.746 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-03-26T13:33:36.753 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-26T13:33:36.753 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-26T13:33:36.753 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.755 INFO:tasks.ceph.mds.a:Stopped 2024-03-26T13:33:36.755 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-26T13:33:36.755 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.756 INFO:tasks.ceph.mds.c:Stopped 2024-03-26T13:33:36.756 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-26T13:33:36.756 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.756 INFO:tasks.ceph.mds.b:Stopped 2024-03-26T13:33:36.756 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-26T13:33:36.756 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.756 INFO:tasks.ceph.mds.d:Stopped 2024-03-26T13:33:36.757 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-26T13:33:36.757 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-26T13:33:36.757 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.757 INFO:tasks.ceph.osd.0:Stopped 2024-03-26T13:33:36.757 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-26T13:33:36.757 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.757 INFO:tasks.ceph.osd.1:Stopped 2024-03-26T13:33:36.758 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-26T13:33:36.758 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.758 INFO:tasks.ceph.osd.2:Stopped 2024-03-26T13:33:36.758 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-26T13:33:36.758 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.758 INFO:tasks.ceph.osd.3:Stopped 2024-03-26T13:33:36.758 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-26T13:33:36.759 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.759 INFO:tasks.ceph.osd.4:Stopped 2024-03-26T13:33:36.759 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-26T13:33:36.759 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.759 DEBUG:teuthology.orchestra.run:got remote process result: 5 2024-03-26T13:33:36.759 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1447, in run_daemon File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi204 with status 5: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2024-03-26T13:33:36.768 INFO:tasks.ceph.osd.5:Stopped 2024-03-26T13:33:36.768 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-26T13:33:36.768 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.768 INFO:tasks.ceph.osd.6:Stopped 2024-03-26T13:33:36.768 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-26T13:33:36.768 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.768 INFO:tasks.ceph.osd.7:Stopped 2024-03-26T13:33:36.769 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-26T13:33:36.769 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-26T13:33:36.769 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.769 INFO:tasks.ceph.mgr.y:Stopped 2024-03-26T13:33:36.769 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-26T13:33:36.769 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:36.770 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1447, in run_daemon File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi204 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2024-03-26T13:33:36.778 INFO:tasks.ceph.mgr.x:Stopped 2024-03-26T13:33:36.778 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-26T13:33:36.778 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-26T13:33:36.778 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.779 INFO:tasks.ceph.mon.a:Stopped 2024-03-26T13:33:36.779 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-26T13:33:36.779 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.779 INFO:tasks.ceph.mon.b:Stopped 2024-03-26T13:33:36.779 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-26T13:33:36.779 INFO:teuthology.orchestra.run:waiting for 300 2024-03-26T13:33:36.780 INFO:tasks.ceph.mon.c:Stopped 2024-03-26T13:33:36.780 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-26T13:33:36.780 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-26T13:33:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:grep: /var/log/ceph/ceph.log: No such file or directory 2024-03-26T13:33:36.832 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T13:33:36.832 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-26T13:33:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:umount: /var/lib/ceph/osd/ceph-0: no mount point specified. 2024-03-26T13:33:36.950 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-03-26T13:33:36.950 DEBUG:teuthology.orchestra.run.smithi063:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2024-03-26T13:33:37.073 INFO:teuthology.orchestra.run.smithi063.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-03-26T13:33:37.073 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.073 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.073 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2024-03-26T13:33:37.073 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-03-26T13:33:37.073 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.073 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.073 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.074 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.074 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.074 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.074 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-03-26T13:33:37.074 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.074 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.074 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.074 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.074 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-03-26T13:33:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-03-26T13:33:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.076 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.076 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2024-03-26T13:33:37.076 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-03-26T13:33:37.076 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.076 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.076 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-03-26T13:33:37.076 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.076 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-03-26T13:33:37.076 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2024-03-26T13:33:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 4u a_inode 0,14 0 2080 [eventpoll:5,6,8,9,11,15,16,17,18,19,24,28,29,30,31,33,38,40,41,44,45,52,56,57,68,69,72,73,74,76,77,81...] 2024-03-26T13:33:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 5u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 6r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2024-03-26T13:33:37.078 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 8u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.078 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 9u a_inode 0,14 0 2080 [eventpoll:10,13] 2024-03-26T13:33:37.078 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 10r REG 0,20 0 263 /proc/1/mountinfo 2024-03-26T13:33:37.078 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 11r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.078 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 12u netlink 0t0 16312 AUDIT 2024-03-26T13:33:37.078 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 13r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.078 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2024-03-26T13:33:37.078 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 15u netlink 0t0 16304 KOBJECT_UEVENT 2024-03-26T13:33:37.078 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 16u unix 0xffff917ee045d0c0 0t0 16306 /run/systemd/private type=STREAM (LISTEN) 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 17u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 18r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 19r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 20r FIFO 0,13 0t0 16309 pipe 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 21w FIFO 0,13 0t0 16309 pipe 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 22r FIFO 0,13 0t0 16310 pipe 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 23w FIFO 0,13 0t0 16310 pipe 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 24r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 25u unix 0xffff917ee01c4400 0t0 19963 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.079 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 26u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2024-03-26T13:33:37.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 28r FIFO 0,13 0t0 19904 pipe 2024-03-26T13:33:37.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 29u FIFO 0,24 0t0 433 /run/dmeventd-server 2024-03-26T13:33:37.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 30u FIFO 0,24 0t0 434 /run/dmeventd-client 2024-03-26T13:33:37.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 31u unix 0xffff917ee01bf2c0 0t0 19907 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2024-03-26T13:33:37.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 32u unix 0xffff917ee01b8000 0t0 19909 /run/rpcbind.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 33u unix 0xffff917ee01c4840 0t0 19919 /run/systemd/coredump type=SEQPACKET (LISTEN) 2024-03-26T13:33:37.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 34u IPv4 17580 0t0 TCP *:sunrpc (LISTEN) 2024-03-26T13:33:37.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 35u IPv4 17586 0t0 UDP *:sunrpc 2024-03-26T13:33:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 36u IPv6 17592 0t0 TCP *:sunrpc (LISTEN) 2024-03-26T13:33:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 37u IPv6 17598 0t0 UDP *:sunrpc 2024-03-26T13:33:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 38u FIFO 0,24 0t0 439 /run/initctl 2024-03-26T13:33:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 39u unix 0xffff917ee01c1dc0 0t0 19921 /run/udev/control type=SEQPACKET (LISTEN) 2024-03-26T13:33:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 40u unix 0xffff917ee01c2ec0 0t0 265 /run/systemd/notify type=DGRAM (CONNECTED) 2024-03-26T13:33:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 41u unix 0xffff917ee01c1980 0t0 266 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 42u unix 0xffff917ee01c1540 0t0 267 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 43u netlink 0t0 19923 KOBJECT_UEVENT 2024-03-26T13:33:37.081 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 44u unix 0xffff917ee01bd0c0 0t0 271 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2024-03-26T13:33:37.082 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 45u unix 0xffff917ee01ba200 0t0 270 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2024-03-26T13:33:37.082 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 46u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.082 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 47u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.082 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 48u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.082 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 49u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.082 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 50u unix 0xffff917ee01c7b40 0t0 280 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2024-03-26T13:33:37.082 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 51u unix 0xffff917ee01bbb80 0t0 282 /run/systemd/journal/stdout type=STREAM (LISTEN) 2024-03-26T13:33:37.082 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 52u unix 0xffff917ee0424400 0t0 18785 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.082 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 53u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 54u unix 0xffff917ee01c6e80 0t0 278 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 55u unix 0xffff917ee064fb40 0t0 18945 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 56u unix 0xffff917ee064c400 0t0 18947 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 57u unix 0xffff917ee0107700 0t0 20045 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 58u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 59u unix 0xffff917ec1cc8cc0 0t0 14873 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 60u unix 0xffff917ee0649540 0t0 18954 type=STREAM (CONNECTED) 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 61u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 62u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 63u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 64u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 65u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 68u unix 0xffff917ec1cc8000 0t0 15156 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 69u unix 0xffff917ee0422640 0t0 21262 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 70u a_inode 0,14 0 2080 bpf-prog 2024-03-26T13:33:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 71u unix 0xffff917ee042bb80 0t0 14998 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 72u unix 0xffff917ee0421100 0t0 16908 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 73u unix 0xffff917ee0100880 0t0 16909 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 74u unix 0xffff917ee049aec0 0t0 21263 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 75u unix 0xffff917ee0428880 0t0 14999 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 76u unix 0xffff917ee064b300 0t0 1813 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 77u CHR 10,242 0t0 165 /dev/rfkill 2024-03-26T13:33:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 80u unix 0xffff917ec1cc9980 0t0 20139 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 81u unix 0xffff917ee0103300 0t0 2326 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 82u unix 0xffff917ee045e600 0t0 20140 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 84u unix 0xffff917ec1ccbfc0 0t0 20141 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1 root 86u unix 0xffff917ee04cee80 0t0 20161 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.086 INFO:teuthology.orchestra.run.smithi063.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.086 INFO:teuthology.orchestra.run.smithi063.stdout:kthreadd 2 root txt unknown /proc/2/exe 2024-03-26T13:33:37.086 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.086 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.086 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2024-03-26T13:33:37.086 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.086 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.086 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2024-03-26T13:33:37.087 INFO:teuthology.orchestra.run.smithi063.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.087 INFO:teuthology.orchestra.run.smithi063.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.087 INFO:teuthology.orchestra.run.smithi063.stdout:slub_flus 5 root txt unknown /proc/5/exe 2024-03-26T13:33:37.087 INFO:teuthology.orchestra.run.smithi063.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.087 INFO:teuthology.orchestra.run.smithi063.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.087 INFO:teuthology.orchestra.run.smithi063.stdout:netns 6 root txt unknown /proc/6/exe 2024-03-26T13:33:37.087 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 7 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.087 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 7 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 7 root txt unknown /proc/7/exe 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 8 root txt unknown /proc/8/exe 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 9 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 9 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 9 root txt unknown /proc/9/exe 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.088 INFO:teuthology.orchestra.run.smithi063.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2024-03-26T13:33:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 11 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 11 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 11 root txt unknown /proc/11/exe 2024-03-26T13:33:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2024-03-26T13:33:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2024-03-26T13:33:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2024-03-26T13:33:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 15 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 15 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 15 root txt unknown /proc/15/exe 2024-03-26T13:33:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:pr/ttyS1 16 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:pr/ttyS1 16 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:pr/ttyS1 16 root txt unknown /proc/16/exe 2024-03-26T13:33:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_preem 17 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_preem 17 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:rcu_preem 17 root txt unknown /proc/17/exe 2024-03-26T13:33:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:migration 18 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:migration 18 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:migration 18 root txt unknown /proc/18/exe 2024-03-26T13:33:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 19 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 19 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 19 root txt unknown /proc/19/exe 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 20 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 20 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 20 root txt unknown /proc/20/exe 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2024-03-26T13:33:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 23 root txt unknown /proc/23/exe 2024-03-26T13:33:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:migration 24 root txt unknown /proc/24/exe 2024-03-26T13:33:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2024-03-26T13:33:37.093 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 26 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 26 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 26 root txt unknown /proc/26/exe 2024-03-26T13:33:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 27 root txt unknown /proc/27/exe 2024-03-26T13:33:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2024-03-26T13:33:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 29 root txt unknown /proc/29/exe 2024-03-26T13:33:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:migration 30 root txt unknown /proc/30/exe 2024-03-26T13:33:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2024-03-26T13:33:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 32 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.096 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 32 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.096 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 32 root txt unknown /proc/32/exe 2024-03-26T13:33:37.096 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.096 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.096 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 33 root txt unknown /proc/33/exe 2024-03-26T13:33:37.096 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.096 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.096 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2024-03-26T13:33:37.097 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.097 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.097 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 35 root txt unknown /proc/35/exe 2024-03-26T13:33:37.097 INFO:teuthology.orchestra.run.smithi063.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.097 INFO:teuthology.orchestra.run.smithi063.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.097 INFO:teuthology.orchestra.run.smithi063.stdout:migration 36 root txt unknown /proc/36/exe 2024-03-26T13:33:37.097 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.097 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.097 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2024-03-26T13:33:37.098 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 38 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.098 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 38 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.098 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 38 root txt unknown /proc/38/exe 2024-03-26T13:33:37.098 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.098 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.098 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 39 root txt unknown /proc/39/exe 2024-03-26T13:33:37.098 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.098 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.098 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2024-03-26T13:33:37.099 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.099 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.099 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 41 root txt unknown /proc/41/exe 2024-03-26T13:33:37.099 INFO:teuthology.orchestra.run.smithi063.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.099 INFO:teuthology.orchestra.run.smithi063.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.099 INFO:teuthology.orchestra.run.smithi063.stdout:migration 42 root txt unknown /proc/42/exe 2024-03-26T13:33:37.099 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.099 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.099 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2024-03-26T13:33:37.100 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 44 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.100 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 44 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.100 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 44 root txt unknown /proc/44/exe 2024-03-26T13:33:37.100 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.100 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.100 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 45 root txt unknown /proc/45/exe 2024-03-26T13:33:37.100 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.100 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.100 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 47 root txt unknown /proc/47/exe 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:migration 48 root txt unknown /proc/48/exe 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2024-03-26T13:33:37.101 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 50 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.102 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 50 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.102 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 50 root txt unknown /proc/50/exe 2024-03-26T13:33:37.102 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.102 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.102 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 51 root txt unknown /proc/51/exe 2024-03-26T13:33:37.102 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.102 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.102 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2024-03-26T13:33:37.102 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.103 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.103 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 53 root txt unknown /proc/53/exe 2024-03-26T13:33:37.103 INFO:teuthology.orchestra.run.smithi063.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.103 INFO:teuthology.orchestra.run.smithi063.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.103 INFO:teuthology.orchestra.run.smithi063.stdout:migration 54 root txt unknown /proc/54/exe 2024-03-26T13:33:37.103 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.103 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.103 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2024-03-26T13:33:37.103 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 56 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 56 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 56 root txt unknown /proc/56/exe 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 57 root txt unknown /proc/57/exe 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.104 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.105 INFO:teuthology.orchestra.run.smithi063.stdout:idle_inje 59 root txt unknown /proc/59/exe 2024-03-26T13:33:37.105 INFO:teuthology.orchestra.run.smithi063.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.105 INFO:teuthology.orchestra.run.smithi063.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.105 INFO:teuthology.orchestra.run.smithi063.stdout:migration 60 root txt unknown /proc/60/exe 2024-03-26T13:33:37.105 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.105 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.105 INFO:teuthology.orchestra.run.smithi063.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2024-03-26T13:33:37.105 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 62 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.105 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 62 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 62 root txt unknown /proc/62/exe 2024-03-26T13:33:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 63 root txt unknown /proc/63/exe 2024-03-26T13:33:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 65 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 65 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 65 root txt unknown /proc/65/exe 2024-03-26T13:33:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 66 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 66 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 66 root txt unknown /proc/66/exe 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 67 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 67 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 67 root txt unknown /proc/67/exe 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 68 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 68 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 68 root txt unknown /proc/68/exe 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 69 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 69 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.107 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 69 root txt unknown /proc/69/exe 2024-03-26T13:33:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 70 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 70 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 70 root txt unknown /proc/70/exe 2024-03-26T13:33:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:kdevtmpfs 71 root cwd DIR 0,5 3360 1 / 2024-03-26T13:33:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:kdevtmpfs 71 root rtd DIR 0,5 3360 1 / 2024-03-26T13:33:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2024-03-26T13:33:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:inet_frag 72 root txt unknown /proc/72/exe 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:kauditd 73 root txt unknown /proc/73/exe 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 74 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 74 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 74 root txt unknown /proc/74/exe 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:khungtask 75 root txt unknown /proc/75/exe 2024-03-26T13:33:37.109 INFO:teuthology.orchestra.run.smithi063.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.110 INFO:teuthology.orchestra.run.smithi063.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.110 INFO:teuthology.orchestra.run.smithi063.stdout:oom_reape 76 root txt unknown /proc/76/exe 2024-03-26T13:33:37.110 INFO:teuthology.orchestra.run.smithi063.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.110 INFO:teuthology.orchestra.run.smithi063.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.110 INFO:teuthology.orchestra.run.smithi063.stdout:writeback 77 root txt unknown /proc/77/exe 2024-03-26T13:33:37.110 INFO:teuthology.orchestra.run.smithi063.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.110 INFO:teuthology.orchestra.run.smithi063.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.110 INFO:teuthology.orchestra.run.smithi063.stdout:kcompactd 78 root txt unknown /proc/78/exe 2024-03-26T13:33:37.110 INFO:teuthology.orchestra.run.smithi063.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:ksmd 79 root txt unknown /proc/79/exe 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 80 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 80 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 80 root txt unknown /proc/80/exe 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:khugepage 81 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:khugepage 81 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:khugepage 81 root txt unknown /proc/81/exe 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:cryptd 82 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.111 INFO:teuthology.orchestra.run.smithi063.stdout:cryptd 82 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:cryptd 82 root txt unknown /proc/82/exe 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:kintegrit 83 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:kintegrit 83 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:kintegrit 83 root txt unknown /proc/83/exe 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:kblockd 84 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:kblockd 84 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:kblockd 84 root txt unknown /proc/84/exe 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:blkcg_pun 85 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:blkcg_pun 85 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.112 INFO:teuthology.orchestra.run.smithi063.stdout:blkcg_pun 85 root txt unknown /proc/85/exe 2024-03-26T13:33:37.113 INFO:teuthology.orchestra.run.smithi063.stdout:tpm_dev_w 86 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.113 INFO:teuthology.orchestra.run.smithi063.stdout:tpm_dev_w 86 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.113 INFO:teuthology.orchestra.run.smithi063.stdout:tpm_dev_w 86 root txt unknown /proc/86/exe 2024-03-26T13:33:37.113 INFO:teuthology.orchestra.run.smithi063.stdout:md 87 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.113 INFO:teuthology.orchestra.run.smithi063.stdout:md 87 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.113 INFO:teuthology.orchestra.run.smithi063.stdout:md 87 root txt unknown /proc/87/exe 2024-03-26T13:33:37.113 INFO:teuthology.orchestra.run.smithi063.stdout:edac-poll 88 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.113 INFO:teuthology.orchestra.run.smithi063.stdout:edac-poll 88 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.113 INFO:teuthology.orchestra.run.smithi063.stdout:edac-poll 88 root txt unknown /proc/88/exe 2024-03-26T13:33:37.114 INFO:teuthology.orchestra.run.smithi063.stdout:watchdogd 89 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.114 INFO:teuthology.orchestra.run.smithi063.stdout:watchdogd 89 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.114 INFO:teuthology.orchestra.run.smithi063.stdout:watchdogd 89 root txt unknown /proc/89/exe 2024-03-26T13:33:37.114 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 90 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.114 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 90 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.114 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 90 root txt unknown /proc/90/exe 2024-03-26T13:33:37.114 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 91 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.114 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 91 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.114 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 91 root txt unknown /proc/91/exe 2024-03-26T13:33:37.115 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 92 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.115 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 92 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.115 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 92 root txt unknown /proc/92/exe 2024-03-26T13:33:37.115 INFO:teuthology.orchestra.run.smithi063.stdout:kswapd0 93 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.115 INFO:teuthology.orchestra.run.smithi063.stdout:kswapd0 93 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.115 INFO:teuthology.orchestra.run.smithi063.stdout:kswapd0 93 root txt unknown /proc/93/exe 2024-03-26T13:33:37.115 INFO:teuthology.orchestra.run.smithi063.stdout:kthrotld 98 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.115 INFO:teuthology.orchestra.run.smithi063.stdout:kthrotld 98 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.115 INFO:teuthology.orchestra.run.smithi063.stdout:kthrotld 98 root txt unknown /proc/98/exe 2024-03-26T13:33:37.116 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 99 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.116 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 99 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.116 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/2 99 root txt unknown /proc/99/exe 2024-03-26T13:33:37.116 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 101 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.116 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 101 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.116 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 101 root txt unknown /proc/101/exe 2024-03-26T13:33:37.116 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 103 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.116 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 103 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.116 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 103 root txt unknown /proc/103/exe 2024-03-26T13:33:37.117 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 105 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.117 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 105 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.117 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 105 root txt unknown /proc/105/exe 2024-03-26T13:33:37.117 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 106 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.117 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 106 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.117 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 106 root txt unknown /proc/106/exe 2024-03-26T13:33:37.117 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 107 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.117 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 107 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.117 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 107 root txt unknown /proc/107/exe 2024-03-26T13:33:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:acpi_ther 108 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:acpi_ther 108 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:acpi_ther 108 root txt unknown /proc/108/exe 2024-03-26T13:33:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:kmpath_rd 109 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:kmpath_rd 109 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:kmpath_rd 109 root txt unknown /proc/109/exe 2024-03-26T13:33:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:kaluad 110 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:kaluad 110 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:kaluad 110 root txt unknown /proc/110/exe 2024-03-26T13:33:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:mld 111 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:mld 111 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:mld 111 root txt unknown /proc/111/exe 2024-03-26T13:33:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 112 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 112 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 112 root txt unknown /proc/112/exe 2024-03-26T13:33:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:ipv6_addr 113 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:ipv6_addr 113 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:ipv6_addr 113 root txt unknown /proc/113/exe 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kstrp 122 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kstrp 122 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kstrp 122 root txt unknown /proc/122/exe 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 123 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 123 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/4 123 root txt unknown /proc/123/exe 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 131 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 131 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 131 root txt unknown /proc/131/exe 2024-03-26T13:33:37.120 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 132 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.121 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 132 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.121 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 132 root txt unknown /proc/132/exe 2024-03-26T13:33:37.121 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 133 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.121 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 133 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.121 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 133 root txt unknown /proc/133/exe 2024-03-26T13:33:37.121 INFO:teuthology.orchestra.run.smithi063.stdout:zswap-shr 138 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.121 INFO:teuthology.orchestra.run.smithi063.stdout:zswap-shr 138 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.121 INFO:teuthology.orchestra.run.smithi063.stdout:zswap-shr 138 root txt unknown /proc/138/exe 2024-03-26T13:33:37.121 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 252 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.122 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 252 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.122 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 252 root txt unknown /proc/252/exe 2024-03-26T13:33:37.122 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 253 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.122 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 253 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.122 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 253 root txt unknown /proc/253/exe 2024-03-26T13:33:37.122 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 292 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.122 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 292 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.122 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/0 292 root txt unknown /proc/292/exe 2024-03-26T13:33:37.122 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 308 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 308 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/7 308 root txt unknown /proc/308/exe 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 372 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 372 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 372 root txt unknown /proc/372/exe 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 387 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 387 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 387 root txt unknown /proc/387/exe 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 421 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.123 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 421 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 421 root txt unknown /proc/421/exe 2024-03-26T13:33:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root txt REG 0,2 156280 16101 /usr/sbin/plymouthd (deleted) 2024-03-26T13:33:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.125 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.125 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.125 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.125 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.125 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.125 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root DEL REG 0,2 15936 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.125 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root DEL REG 0,2 16057 /usr/lib64/libudev.so.1.7.5 2024-03-26T13:33:37.125 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root DEL REG 0,2 15981 /usr/lib64/libm.so.6 2024-03-26T13:33:37.125 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root DEL REG 0,2 15901 /usr/lib64/libc.so.6 2024-03-26T13:33:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root DEL REG 0,2 16022 /usr/lib64/libply-splash-core.so.4.0.0 2024-03-26T13:33:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root DEL REG 0,2 16024 /usr/lib64/libply.so.4.0.0 2024-03-26T13:33:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root DEL REG 0,2 15885 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 3u a_inode 0,14 0 2080 [eventpoll:4,6,7,8] 2024-03-26T13:33:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 4r FIFO 0,13 0t0 17489 pipe 2024-03-26T13:33:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 5w FIFO 0,13 0t0 17489 pipe 2024-03-26T13:33:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 6u unix 0xffff917ec1cce600 0t0 2120 @/org/freedesktop/plymouthd type=STREAM (LISTEN) 2024-03-26T13:33:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 7u CHR 4,65 0t0 114 /dev/ttyS1 2024-03-26T13:33:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 8u CHR 5,2 0t0 112 /dev/ptmx 2024-03-26T13:33:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:plymouthd 423 root 10w REG 8,1 180836 1203 /var/log/boot.log 2024-03-26T13:33:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 427 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 427 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/3 427 root txt unknown /proc/427/exe 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-wq 438 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-wq 438 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-wq 438 root txt unknown /proc/438/exe 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-rese 439 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-rese 439 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-rese 439 root txt unknown /proc/439/exe 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-dele 441 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.128 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-dele 441 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.129 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-dele 441 root txt unknown /proc/441/exe 2024-03-26T13:33:37.129 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-auth 444 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.129 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-auth 444 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.129 INFO:teuthology.orchestra.run.smithi063.stdout:nvme-auth 444 root txt unknown /proc/444/exe 2024-03-26T13:33:37.129 INFO:teuthology.orchestra.run.smithi063.stdout:ata_sff 451 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.129 INFO:teuthology.orchestra.run.smithi063.stdout:ata_sff 451 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.129 INFO:teuthology.orchestra.run.smithi063.stdout:ata_sff 451 root txt unknown /proc/451/exe 2024-03-26T13:33:37.129 INFO:teuthology.orchestra.run.smithi063.stdout:ixgbe 452 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.129 INFO:teuthology.orchestra.run.smithi063.stdout:ixgbe 452 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.130 INFO:teuthology.orchestra.run.smithi063.stdout:ixgbe 452 root txt unknown /proc/452/exe 2024-03-26T13:33:37.130 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_0 461 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.130 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_0 461 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.130 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_0 461 root txt unknown /proc/461/exe 2024-03-26T13:33:37.130 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 462 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.130 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 462 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.130 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 462 root txt unknown /proc/462/exe 2024-03-26T13:33:37.130 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_1 463 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.130 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_1 463 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_1 463 root txt unknown /proc/463/exe 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 464 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 464 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 464 root txt unknown /proc/464/exe 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_2 465 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_2 465 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_2 465 root txt unknown /proc/465/exe 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 466 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 466 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.131 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 466 root txt unknown /proc/466/exe 2024-03-26T13:33:37.132 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_3 467 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.132 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_3 467 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.132 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_3 467 root txt unknown /proc/467/exe 2024-03-26T13:33:37.132 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 468 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.132 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 468 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.132 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 468 root txt unknown /proc/468/exe 2024-03-26T13:33:37.132 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_4 469 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.132 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_4 469 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_4 469 root txt unknown /proc/469/exe 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 470 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 470 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 470 root txt unknown /proc/470/exe 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_5 471 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_5 471 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_5 471 root txt unknown /proc/471/exe 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 472 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 472 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 472 root txt unknown /proc/472/exe 2024-03-26T13:33:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_6 473 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_6 473 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_6 473 root txt unknown /proc/473/exe 2024-03-26T13:33:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 474 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 474 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 474 root txt unknown /proc/474/exe 2024-03-26T13:33:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_7 475 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_7 475 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_7 475 root txt unknown /proc/475/exe 2024-03-26T13:33:37.135 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 476 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.135 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 476 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.135 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 476 root txt unknown /proc/476/exe 2024-03-26T13:33:37.135 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_8 477 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.135 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_8 477 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.135 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_8 477 root txt unknown /proc/477/exe 2024-03-26T13:33:37.135 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 478 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.135 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 478 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.135 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 478 root txt unknown /proc/478/exe 2024-03-26T13:33:37.136 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_9 479 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.136 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_9 479 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.136 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_eh_9 479 root txt unknown /proc/479/exe 2024-03-26T13:33:37.136 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 480 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.136 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 480 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.136 INFO:teuthology.orchestra.run.smithi063.stdout:scsi_tmf_ 480 root txt unknown /proc/480/exe 2024-03-26T13:33:37.136 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 481 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.136 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 481 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.136 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 481 root txt unknown /proc/481/exe 2024-03-26T13:33:37.137 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 482 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.137 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 482 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.137 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 482 root txt unknown /proc/482/exe 2024-03-26T13:33:37.137 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 483 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.137 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 483 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.137 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 483 root txt unknown /proc/483/exe 2024-03-26T13:33:37.137 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 484 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.137 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 484 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.138 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/u 484 root txt unknown /proc/484/exe 2024-03-26T13:33:37.138 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 489 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.138 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 489 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.138 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 489 root txt unknown /proc/489/exe 2024-03-26T13:33:37.138 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 494 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.138 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 494 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.138 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/6 494 root txt unknown /proc/494/exe 2024-03-26T13:33:37.138 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 502 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.138 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 502 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/1 502 root txt unknown /proc/502/exe 2024-03-26T13:33:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 506 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 506 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:kworker/5 506 root txt unknown /proc/506/exe 2024-03-26T13:33:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:jbd2/sda1 507 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:jbd2/sda1 507 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:jbd2/sda1 507 root txt unknown /proc/507/exe 2024-03-26T13:33:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:ext4-rsv- 508 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.139 INFO:teuthology.orchestra.run.smithi063.stdout:ext4-rsv- 508 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:ext4-rsv- 508 root txt unknown /proc/508/exe 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.140 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.141 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-03-26T13:33:37.142 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.142 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-03-26T13:33:37.142 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.142 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.142 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.142 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-03-26T13:33:37.142 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.142 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.142 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.143 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-03-26T13:33:37.143 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.143 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.143 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-03-26T13:33:37.143 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.143 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2024-03-26T13:33:37.143 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.143 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 1w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.143 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 2w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 3u unix 0xffff917ee01c6e80 0t0 278 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2024-03-26T13:33:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 4u unix 0xffff917ee01c7b40 0t0 280 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2024-03-26T13:33:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 5u unix 0xffff917ee01bbb80 0t0 282 /run/systemd/journal/stdout type=STREAM (LISTEN) 2024-03-26T13:33:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 6w CHR 1,11 0t0 10 /dev/kmsg 2024-03-26T13:33:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 7u a_inode 0,14 0 2080 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,23,24,25,27,28,29,31,32,33] 2024-03-26T13:33:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 8u CHR 1,11 0t0 10 /dev/kmsg 2024-03-26T13:33:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 9u unix 0xffff917ee04cb740 0t0 17640 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2024-03-26T13:33:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 10r REG 0,20 0 16167 /proc/sys/kernel/hostname 2024-03-26T13:33:37.144 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 11u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.145 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 12u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.145 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 13u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.145 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 14u unix 0xffff917ee04d0cc0 0t0 17641 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.145 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 15u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.145 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-03-26T13:33:37.145 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 17u unix 0xffff917ee0424400 0t0 18785 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.145 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 18u unix 0xffff917ec1cc8cc0 0t0 14873 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.145 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 19u unix 0xffff917ee0422640 0t0 21262 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.145 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 20u unix 0xffff917ee064b300 0t0 1813 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.146 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 21u unix 0xffff917ee0107700 0t0 20045 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.146 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 23u unix 0xffff917ee0421100 0t0 16908 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.146 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 24u unix 0xffff917ee0100880 0t0 16909 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.146 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 25u unix 0xffff917ee049aec0 0t0 21263 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.146 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 27u unix 0xffff917ec1cc9980 0t0 20139 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.146 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 28u unix 0xffff917ee045e600 0t0 20140 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.146 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 29u unix 0xffff917ec1ccbfc0 0t0 20141 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.146 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 31u unix 0xffff917ee0103300 0t0 2326 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 32u unix 0xffff917ee04cee80 0t0 20161 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-j 583 root 33u unix 0xffff917ec1cc8000 0t0 15156 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:ext4lazyi 589 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:ext4lazyi 589 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:ext4lazyi 589 root txt unknown /proc/589/exe 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 561841 62217 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.symbols.bin 2024-03-26T13:33:37.147 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2024-03-26T13:33:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 815256 59736 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.alias.bin 2024-03-26T13:33:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 380439 62222 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.dep.bin 2024-03-26T13:33:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-03-26T13:33:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 11772 62218 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.builtin.bin 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-03-26T13:33:37.149 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.150 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.150 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.150 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-03-26T13:33:37.150 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.150 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.150 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.150 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.150 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.150 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-03-26T13:33:37.151 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.151 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.151 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-03-26T13:33:37.151 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-03-26T13:33:37.151 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.151 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.151 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.151 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 1u unix 0xffff917ee0421980 0t0 14624 type=STREAM (CONNECTED) 2024-03-26T13:33:37.151 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 2u unix 0xffff917ee0421980 0t0 14624 type=STREAM (CONNECTED) 2024-03-26T13:33:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 3u netlink 0t0 19923 KOBJECT_UEVENT 2024-03-26T13:33:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 4u unix 0xffff917ee01c1dc0 0t0 19921 /run/udev/control type=SEQPACKET (LISTEN) 2024-03-26T13:33:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 5u unix 0xffff917ee042dd80 0t0 14636 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 6u unix 0xffff917ee042b300 0t0 14640 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 7u unix 0xffff917ee042b740 0t0 14641 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 9u a_inode 0,14 0 2080 [eventpoll:3,4,6,8,10,11,13,14] 2024-03-26T13:33:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 10u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 11u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 13u a_inode 0,14 0 2080 [pidfd:5094] 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 601 root 14u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:ipmi-msgh 643 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:ipmi-msgh 643 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:ipmi-msgh 643 root txt unknown /proc/643/exe 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:kipmi0 660 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:kipmi0 660 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:kipmi0 660 root txt unknown /proc/660/exe 2024-03-26T13:33:37.153 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2024-03-26T13:33:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.154 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.155 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.156 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.156 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.156 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.156 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2024-03-26T13:33:37.156 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.156 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.156 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc 1u unix 0xffff917ee0107b40 0t0 1662 type=STREAM (CONNECTED) 2024-03-26T13:33:37.156 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc 2u unix 0xffff917ee0107b40 0t0 1662 type=STREAM (CONNECTED) 2024-03-26T13:33:37.156 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc 3u unix 0xffff917ee01b8000 0t0 19909 /run/rpcbind.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc 4u IPv4 17580 0t0 TCP *:sunrpc (LISTEN) 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc 5u IPv4 17586 0t0 UDP *:sunrpc 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc 6u IPv6 17592 0t0 TCP *:sunrpc (LISTEN) 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc 7u IPv6 17598 0t0 UDP *:sunrpc 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:rpcbind 673 rpc 8rW REG 0,24 0 1040 /run/rpcbind/rpcbind.lock 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:rpciod 679 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:rpciod 679 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:rpciod 679 root txt unknown /proc/679/exe 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:xprtiod 680 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:xprtiod 680 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:xprtiod 680 root txt unknown /proc/680/exe 2024-03-26T13:33:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2024-03-26T13:33:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-03-26T13:33:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 3u netlink 0t0 18903 AUDIT 2024-03-26T13:33:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 5w REG 8,1 2852040 1205 /var/log/audit/audit.log 2024-03-26T13:33:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 6u unix 0xffff917ee042e1c0 0t0 14849 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 7u unix 0xffff917ee0425500 0t0 14848 type=STREAM (CONNECTED) 2024-03-26T13:33:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 8u unix 0xffff917ee0426600 0t0 14850 type=STREAM (CONNECTED) 2024-03-26T13:33:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 9u unix 0xffff917ee0420440 0t0 14851 type=STREAM (CONNECTED) 2024-03-26T13:33:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 root 10u a_inode 0,14 0 2080 [eventfd:0] 2024-03-26T13:33:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2024-03-26T13:33:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 3u netlink 0t0 18903 AUDIT 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 5w REG 8,1 2852040 1205 /var/log/audit/audit.log 2024-03-26T13:33:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 6u unix 0xffff917ee042e1c0 0t0 14849 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.164 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 7u unix 0xffff917ee0425500 0t0 14848 type=STREAM (CONNECTED) 2024-03-26T13:33:37.164 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 8u unix 0xffff917ee0426600 0t0 14850 type=STREAM (CONNECTED) 2024-03-26T13:33:37.164 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 9u unix 0xffff917ee0420440 0t0 14851 type=STREAM (CONNECTED) 2024-03-26T13:33:37.164 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 684 auditd root 10u a_inode 0,14 0 2080 [eventfd:0] 2024-03-26T13:33:37.164 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.164 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.164 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2024-03-26T13:33:37.164 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.164 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.166 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.166 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-03-26T13:33:37.166 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.166 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.166 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.166 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.166 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.166 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 3u netlink 0t0 18903 AUDIT 2024-03-26T13:33:37.166 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 5w REG 8,1 2852040 1205 /var/log/audit/audit.log 2024-03-26T13:33:37.167 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 6u unix 0xffff917ee042e1c0 0t0 14849 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.167 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 7u unix 0xffff917ee0425500 0t0 14848 type=STREAM (CONNECTED) 2024-03-26T13:33:37.167 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 8u unix 0xffff917ee0426600 0t0 14850 type=STREAM (CONNECTED) 2024-03-26T13:33:37.167 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 9u unix 0xffff917ee0420440 0t0 14851 type=STREAM (CONNECTED) 2024-03-26T13:33:37.167 INFO:teuthology.orchestra.run.smithi063.stdout:auditd 683 686 auditd root 10u a_inode 0,14 0 2080 [eventfd:0] 2024-03-26T13:33:37.167 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.167 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.167 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2024-03-26T13:33:37.167 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.168 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.169 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.169 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-03-26T13:33:37.169 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-03-26T13:33:37.169 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.169 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.169 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root 0u unix 0xffff917ee0420cc0 0t0 14847 type=STREAM (CONNECTED) 2024-03-26T13:33:37.169 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.169 INFO:teuthology.orchestra.run.smithi063.stdout:sedispatc 685 root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.169 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2024-03-26T13:33:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus DEL REG 0,1 3072 /memfd:dbus-broker-log 2024-03-26T13:33:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.171 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 1u unix 0xffff917ec1ccd500 0t0 2296 type=STREAM (CONNECTED) 2024-03-26T13:33:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 2u unix 0xffff917ec1ccd500 0t0 2296 type=STREAM (CONNECTED) 2024-03-26T13:33:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 3u unix 0xffff917ee064fb40 0t0 18945 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-03-26T13:33:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 4u unix 0xffff917ec92bea40 0t0 2306 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 5u a_inode 0,14 0 2080 [eventpoll:6,7,8,9,10,11] 2024-03-26T13:33:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 6u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 7r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 8u unix 0xffff917ec1cccc80 0t0 2308 type=STREAM (CONNECTED) 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 9u unix 0xffff917ec1cce1c0 0t0 2310 type=STREAM (CONNECTED) 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 10u a_inode 0,14 0 2080 [pidfd:724] 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 11u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 723 dbus 12u REG 0,1 2097152 3072 /memfd:dbus-broker-log (deleted) 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.173 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 1u unix 0xffff917ec1ccd500 0t0 2296 type=STREAM (CONNECTED) 2024-03-26T13:33:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 2u unix 0xffff917ec1ccd500 0t0 2296 type=STREAM (CONNECTED) 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 3u sock 0,8 0t0 1707 protocol: NETLINK 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 4u unix 0xffff917ec92bea40 0t0 2306 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 5u a_inode 0,14 0 2080 [eventpoll:6,7,8,9,10,11,12,13,14,15,18,20] 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 6u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 7u unix 0xffff917ee064fb40 0t0 18945 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 8u unix 0xffff917ee064f700 0t0 1708 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 9u unix 0xffff917ec1cc9100 0t0 2309 type=STREAM (CONNECTED) 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 10u unix 0xffff917ec1cc9540 0t0 1710 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 11u unix 0xffff917ee0102a80 0t0 21270 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-03-26T13:33:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 12u unix 0xffff917ee0424840 0t0 2344 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-03-26T13:33:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 13u sock 0,8 0t0 21288 protocol: UNIX-STREAM 2024-03-26T13:33:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 14u unix 0xffff917ee01be1c0 0t0 16942 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-03-26T13:33:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 15u unix 0xffff917ee0422a80 0t0 21291 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-03-26T13:33:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 18u unix 0xffff917ee04caa80 0t0 2370 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-03-26T13:33:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:dbus-brok 724 dbus 20u unix 0xffff917ec1cc8880 0t0 22013 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-03-26T13:33:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.177 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.178 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.178 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-03-26T13:33:37.178 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-03-26T13:33:37.178 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-03-26T13:33:37.178 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.178 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.178 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.178 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.178 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-03-26T13:33:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-03-26T13:33:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-03-26T13:33:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.180 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.181 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-03-26T13:33:37.181 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-03-26T13:33:37.181 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-03-26T13:33:37.181 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.181 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.181 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.181 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.181 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.181 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.182 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-03-26T13:33:37.182 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-03-26T13:33:37.182 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.182 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.182 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.182 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.182 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.182 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-03-26T13:33:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2024-03-26T13:33:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-03-26T13:33:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-03-26T13:33:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 1u unix 0xffff917ee0425940 0t0 14874 type=STREAM (CONNECTED) 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 2u unix 0xffff917ee0425940 0t0 14874 type=STREAM (CONNECTED) 2024-03-26T13:33:37.184 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 3u a_inode 0,14 0 2080 [eventfd:3] 2024-03-26T13:33:37.185 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 4u a_inode 0,14 0 2080 [eventfd:4] 2024-03-26T13:33:37.185 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 5u unix 0xffff917ee042d940 0t0 14952 type=DGRAM (UNCONNECTED) 2024-03-26T13:33:37.185 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 6u unix 0xffff917ee0420000 0t0 14953 type=STREAM (CONNECTED) 2024-03-26T13:33:37.185 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 7u a_inode 0,14 0 2080 [eventfd:5] 2024-03-26T13:33:37.185 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 8r REG 0,4 0 4026531840 net 2024-03-26T13:33:37.185 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 9r REG 0,4 0 4026532494 mnt 2024-03-26T13:33:37.185 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 10u netlink 0t0 14957 KOBJECT_UEVENT 2024-03-26T13:33:37.185 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 11u netlink 0t0 14958 GENERIC 2024-03-26T13:33:37.185 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 12u netlink 0t0 14959 GENERIC 2024-03-26T13:33:37.186 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 13u netlink 0t0 14960 ROUTE 2024-03-26T13:33:37.186 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 14r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.186 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 15r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.186 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 16u netlink 0t0 19085 KOBJECT_UEVENT 2024-03-26T13:33:37.186 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 17u a_inode 0,14 0 2080 [eventpoll] 2024-03-26T13:33:37.186 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 18u unix 0xffff917ee0423740 0t0 15006 type=STREAM (CONNECTED) 2024-03-26T13:33:37.186 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 19u a_inode 0,14 0 2080 [eventpoll:21,27] 2024-03-26T13:33:37.186 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 20w FIFO 0,24 0t0 1174 /run/systemd/inhibit/1.ref 2024-03-26T13:33:37.187 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 21u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.187 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 23u raw6 0t0 19216 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2024-03-26T13:33:37.187 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 root 27u IPv4 19309 0t0 UDP smithi063.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-03-26T13:33:37.187 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.187 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.187 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2024-03-26T13:33:37.187 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.187 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2024-03-26T13:33:37.187 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-03-26T13:33:37.188 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2024-03-26T13:33:37.188 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2024-03-26T13:33:37.188 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2024-03-26T13:33:37.188 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.188 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.188 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.188 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.188 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.188 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-03-26T13:33:37.189 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-03-26T13:33:37.189 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-03-26T13:33:37.189 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.189 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.189 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.189 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.189 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.189 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.189 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.190 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.190 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.190 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-03-26T13:33:37.190 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-03-26T13:33:37.190 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-03-26T13:33:37.190 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.190 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.190 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-03-26T13:33:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-03-26T13:33:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-03-26T13:33:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-03-26T13:33:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.192 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-03-26T13:33:37.193 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-03-26T13:33:37.193 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.193 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.193 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.193 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.193 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.193 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-03-26T13:33:37.193 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.193 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.194 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2024-03-26T13:33:37.194 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.194 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-03-26T13:33:37.194 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-03-26T13:33:37.194 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.194 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.194 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.194 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.195 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.195 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.195 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.195 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.195 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.195 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.195 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 1u unix 0xffff917ee0425940 0t0 14874 type=STREAM (CONNECTED) 2024-03-26T13:33:37.195 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 2u unix 0xffff917ee0425940 0t0 14874 type=STREAM (CONNECTED) 2024-03-26T13:33:37.195 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 3u a_inode 0,14 0 2080 [eventfd:3] 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 4u a_inode 0,14 0 2080 [eventfd:4] 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 5u unix 0xffff917ee042d940 0t0 14952 type=DGRAM (UNCONNECTED) 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 6u unix 0xffff917ee0420000 0t0 14953 type=STREAM (CONNECTED) 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 7u a_inode 0,14 0 2080 [eventfd:5] 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 8r REG 0,4 0 4026531840 net 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 9r REG 0,4 0 4026532494 mnt 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 10u netlink 0t0 14957 KOBJECT_UEVENT 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 11u netlink 0t0 14958 GENERIC 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 12u netlink 0t0 14959 GENERIC 2024-03-26T13:33:37.196 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 13u netlink 0t0 14960 ROUTE 2024-03-26T13:33:37.197 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 14r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.197 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 15r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.197 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 16u netlink 0t0 19085 KOBJECT_UEVENT 2024-03-26T13:33:37.197 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 17u a_inode 0,14 0 2080 [eventpoll] 2024-03-26T13:33:37.197 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 18u unix 0xffff917ee0423740 0t0 15006 type=STREAM (CONNECTED) 2024-03-26T13:33:37.197 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 19u a_inode 0,14 0 2080 [eventpoll:21,27] 2024-03-26T13:33:37.197 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 20w FIFO 0,24 0t0 1174 /run/systemd/inhibit/1.ref 2024-03-26T13:33:37.197 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 21u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.197 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 23u raw6 0t0 19216 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2024-03-26T13:33:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 772 gmain root 27u IPv4 19309 0t0 UDP smithi063.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-03-26T13:33:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2024-03-26T13:33:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2024-03-26T13:33:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-03-26T13:33:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2024-03-26T13:33:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2024-03-26T13:33:37.199 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2024-03-26T13:33:37.199 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.199 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.199 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.199 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.199 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.199 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-03-26T13:33:37.199 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-03-26T13:33:37.200 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-03-26T13:33:37.200 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.200 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.200 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.200 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.200 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.200 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.200 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.200 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-03-26T13:33:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-03-26T13:33:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-03-26T13:33:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-03-26T13:33:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-03-26T13:33:37.202 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-03-26T13:33:37.202 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-03-26T13:33:37.202 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.202 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.202 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.202 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.202 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.202 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-03-26T13:33:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-03-26T13:33:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-03-26T13:33:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-03-26T13:33:37.204 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-03-26T13:33:37.204 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.204 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.204 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.204 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.204 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.204 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-03-26T13:33:37.204 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.205 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.205 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2024-03-26T13:33:37.205 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.205 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-03-26T13:33:37.205 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-03-26T13:33:37.205 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.205 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.205 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.205 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.206 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.206 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.206 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.206 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.206 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.206 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.206 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 1u unix 0xffff917ee0425940 0t0 14874 type=STREAM (CONNECTED) 2024-03-26T13:33:37.206 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 2u unix 0xffff917ee0425940 0t0 14874 type=STREAM (CONNECTED) 2024-03-26T13:33:37.207 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 3u a_inode 0,14 0 2080 [eventfd:3] 2024-03-26T13:33:37.207 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 4u a_inode 0,14 0 2080 [eventfd:4] 2024-03-26T13:33:37.207 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 5u unix 0xffff917ee042d940 0t0 14952 type=DGRAM (UNCONNECTED) 2024-03-26T13:33:37.207 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 6u unix 0xffff917ee0420000 0t0 14953 type=STREAM (CONNECTED) 2024-03-26T13:33:37.207 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 7u a_inode 0,14 0 2080 [eventfd:5] 2024-03-26T13:33:37.207 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 8r REG 0,4 0 4026531840 net 2024-03-26T13:33:37.207 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 9r REG 0,4 0 4026532494 mnt 2024-03-26T13:33:37.207 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 10u netlink 0t0 14957 KOBJECT_UEVENT 2024-03-26T13:33:37.207 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 11u netlink 0t0 14958 GENERIC 2024-03-26T13:33:37.208 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 12u netlink 0t0 14959 GENERIC 2024-03-26T13:33:37.208 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 13u netlink 0t0 14960 ROUTE 2024-03-26T13:33:37.208 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 14r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.208 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 15r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.208 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 16u netlink 0t0 19085 KOBJECT_UEVENT 2024-03-26T13:33:37.208 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 17u a_inode 0,14 0 2080 [eventpoll] 2024-03-26T13:33:37.208 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 18u unix 0xffff917ee0423740 0t0 15006 type=STREAM (CONNECTED) 2024-03-26T13:33:37.208 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 19u a_inode 0,14 0 2080 [eventpoll:21,27] 2024-03-26T13:33:37.208 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 20w FIFO 0,24 0t0 1174 /run/systemd/inhibit/1.ref 2024-03-26T13:33:37.209 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 21u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.209 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 23u raw6 0t0 19216 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2024-03-26T13:33:37.209 INFO:teuthology.orchestra.run.smithi063.stdout:NetworkMa 725 773 gdbus root 27u IPv4 19309 0t0 UDP smithi063.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-03-26T13:33:37.209 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.209 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.209 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2024-03-26T13:33:37.209 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.209 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root mem REG 8,1 54392 9998 /usr/lib64/libnuma.so.1.0.0 2024-03-26T13:33:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root 1u unix 0xffff917ee0424c80 0t0 14883 type=STREAM (CONNECTED) 2024-03-26T13:33:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root 2u unix 0xffff917ee0424c80 0t0 14883 type=STREAM (CONNECTED) 2024-03-26T13:33:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root 3u a_inode 0,14 0 2080 [eventfd:1] 2024-03-26T13:33:37.211 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root 4u a_inode 0,14 0 2080 [eventfd:2] 2024-03-26T13:33:37.211 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root 5u unix 0xffff917ee04250c0 0t0 14910 /run/irqbalance/irqbalance728.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.211 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 root 6u unix 0xffff917ee042e600 0t0 15198 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.211 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.211 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.211 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2024-03-26T13:33:37.211 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.211 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.212 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.212 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root mem REG 8,1 54392 9998 /usr/lib64/libnuma.so.1.0.0 2024-03-26T13:33:37.212 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.212 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.212 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.212 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.212 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root 1u unix 0xffff917ee0424c80 0t0 14883 type=STREAM (CONNECTED) 2024-03-26T13:33:37.212 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root 2u unix 0xffff917ee0424c80 0t0 14883 type=STREAM (CONNECTED) 2024-03-26T13:33:37.212 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root 3u a_inode 0,14 0 2080 [eventfd:1] 2024-03-26T13:33:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root 4u a_inode 0,14 0 2080 [eventfd:2] 2024-03-26T13:33:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root 5u unix 0xffff917ee04250c0 0t0 14910 /run/irqbalance/irqbalance728.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:irqbalanc 728 750 gmain root 6u unix 0xffff917ee042e600 0t0 15198 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2024-03-26T13:33:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2024-03-26T13:33:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.214 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.214 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt 1u unix 0xffff917ee0101dc0 0t0 1715 type=STREAM (CONNECTED) 2024-03-26T13:33:37.214 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt 2u unix 0xffff917ee0101dc0 0t0 1715 type=STREAM (CONNECTED) 2024-03-26T13:33:37.214 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt 3uW REG 0,24 0 1109 /run/lsm/ipc/.lsmd-ipc-lock 2024-03-26T13:33:37.214 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt 5u unix 0xffff917ee049dd80 0t0 16919 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2024-03-26T13:33:37.214 INFO:teuthology.orchestra.run.smithi063.stdout:lsmd 729 libstoragemgmt 6u unix 0xffff917ee049ee80 0t0 16920 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2024-03-26T13:33:37.214 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.214 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.214 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2024-03-26T13:33:37.215 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.215 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.215 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.215 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root 1u unix 0xffff917ee049c840 0t0 16910 type=STREAM (CONNECTED) 2024-03-26T13:33:37.215 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root 2u unix 0xffff917ee049c840 0t0 16910 type=STREAM (CONNECTED) 2024-03-26T13:33:37.215 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root 3r CHR 10,227 0t0 142 /dev/mcelog 2024-03-26T13:33:37.215 INFO:teuthology.orchestra.run.smithi063.stdout:mcelog 730 root 4u unix 0xffff917ee0458cc0 0t0 21269 /var/run/mcelog-client type=STREAM (LISTEN) 2024-03-26T13:33:37.215 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.216 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.216 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.216 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.216 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.216 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.216 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.216 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.216 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.216 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.218 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.218 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.218 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.218 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.218 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.218 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.218 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.218 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.219 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.219 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.219 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.219 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.219 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.219 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.219 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.219 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.219 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.222 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.222 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.222 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.222 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.222 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.222 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.222 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.222 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.225 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.225 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 781 gmain polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.225 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.225 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.225 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.225 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.225 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.225 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.227 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.227 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.227 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.227 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.227 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.227 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.227 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.227 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.228 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.228 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.228 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.228 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.228 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.228 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.228 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.228 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.228 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.229 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.229 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.229 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.229 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.229 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.229 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.229 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.229 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.229 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 782 gdbus polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.230 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.230 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.230 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.230 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.230 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.230 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.230 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.230 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.230 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.231 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.231 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.231 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.231 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.231 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.231 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.231 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.231 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.231 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.232 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.232 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.232 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.232 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.232 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.232 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.232 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.232 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.233 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.233 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.233 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.233 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.233 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.233 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.233 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.233 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.233 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.234 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.234 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.234 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.234 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.234 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.234 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 783 JS\x20Hel polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.234 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.235 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.235 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.235 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.235 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.235 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.235 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.235 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.235 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.236 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.236 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.236 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.236 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.236 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.236 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.236 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.236 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.239 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.239 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.239 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.239 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.239 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.239 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.239 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 784 JS\x20Hel polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.239 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.240 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.240 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.240 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.240 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.240 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.240 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.240 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.240 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.240 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.242 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.242 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.242 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.242 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.242 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.242 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.242 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.242 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.243 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.243 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.243 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.243 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.243 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.243 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.243 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.243 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.244 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.244 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.244 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.244 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.244 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.244 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 785 JS\x20Hel polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.244 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.244 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.244 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.245 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.245 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.245 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.245 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.245 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.245 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.245 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.245 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.245 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.246 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.246 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.246 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.246 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.246 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.246 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.246 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.246 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.247 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.247 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.247 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.247 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.247 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.247 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.247 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.247 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.247 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.248 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.248 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.248 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.248 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.248 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.248 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.248 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.248 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.248 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 786 JS\x20Hel polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.249 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.250 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.250 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.250 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.250 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.250 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.250 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.250 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.250 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.251 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.252 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 787 JS\x20Hel polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.253 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.255 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.255 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.255 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.255 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.255 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.255 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.255 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.255 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.255 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.256 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 788 JS\x20Hel polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.258 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.259 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.259 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.259 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.259 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.259 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.259 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.259 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.259 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.259 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.260 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.260 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.260 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.260 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.260 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.260 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.260 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.260 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.260 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.261 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.261 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.261 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.261 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.261 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.261 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.261 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.261 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.261 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.262 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.262 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.262 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.262 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.262 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.262 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 789 JS\x20Hel polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.262 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.262 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.262 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.264 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.265 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.265 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.265 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.265 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.265 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.265 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.265 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.265 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.265 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.266 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.266 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.266 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.266 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.266 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.266 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.266 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.266 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.266 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.267 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.267 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 790 JS\x20Hel polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.267 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.267 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.267 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-03-26T13:33:37.267 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.267 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.267 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.267 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.268 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-03-26T13:33:37.269 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.269 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.269 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.269 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.269 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.269 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.269 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.269 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.269 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.270 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.270 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.270 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-03-26T13:33:37.270 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.270 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.270 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.270 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.270 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 3r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.270 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 4u a_inode 0,14 0 2080 [eventfd:6] 2024-03-26T13:33:37.271 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 5u a_inode 0,14 0 2080 [eventfd:7] 2024-03-26T13:33:37.271 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 6u unix 0xffff917ee01b9980 0t0 20126 type=STREAM (CONNECTED) 2024-03-26T13:33:37.271 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 7u a_inode 0,14 0 2080 [eventfd:8] 2024-03-26T13:33:37.271 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.271 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 9u a_inode 0,14 0 2080 [eventfd:9] 2024-03-26T13:33:37.271 INFO:teuthology.orchestra.run.smithi063.stdout:polkitd 731 792 polkitd polkitd 10u unix 0xffff917ee01c5d80 0t0 20127 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.271 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.271 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.271 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2024-03-26T13:33:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-03-26T13:33:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:smartd 732 root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.273 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.274 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.274 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2024-03-26T13:33:37.274 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-03-26T13:33:37.274 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.274 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.274 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.274 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.274 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-03-26T13:33:37.274 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.275 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.275 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.275 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.275 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.275 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.275 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.275 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.275 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-03-26T13:33:37.275 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.276 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.276 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.276 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-03-26T13:33:37.276 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-03-26T13:33:37.276 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.276 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.276 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.276 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-03-26T13:33:37.276 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 1u unix 0xffff917ee0103740 0t0 1722 type=STREAM (CONNECTED) 2024-03-26T13:33:37.277 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 2u unix 0xffff917ee0103740 0t0 1722 type=STREAM (CONNECTED) 2024-03-26T13:33:37.278 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 3u unix 0xffff917ecaed8440 0t0 1751 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.278 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 4u a_inode 0,14 0 2080 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20,21] 2024-03-26T13:33:37.278 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 5u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.278 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 6u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.278 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 7r REG 0,21 4096 22796 /sys/devices/virtual/tty/tty0/active 2024-03-26T13:33:37.278 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 8u netlink 0t0 1762 KOBJECT_UEVENT 2024-03-26T13:33:37.278 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 9r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.278 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 10r FIFO 0,24 0t0 1174 /run/systemd/inhibit/1.ref 2024-03-26T13:33:37.278 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 11u netlink 0t0 1763 KOBJECT_UEVENT 2024-03-26T13:33:37.279 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 12u netlink 0t0 1764 KOBJECT_UEVENT 2024-03-26T13:33:37.279 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 13u netlink 0t0 1765 KOBJECT_UEVENT 2024-03-26T13:33:37.279 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 14u unix 0xffff917ee0106a40 0t0 1766 type=STREAM (CONNECTED) 2024-03-26T13:33:37.279 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 15u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.279 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 16u CHR 13,65 0t0 138 /dev/input/event1 2024-03-26T13:33:37.279 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 17u CHR 13,64 0t0 137 /dev/input/event0 2024-03-26T13:33:37.279 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 18u CHR 13,66 0t0 148 /dev/input/event2 2024-03-26T13:33:37.279 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 19u CHR 4,6 0t0 25 /dev/tty6 2024-03-26T13:33:37.279 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 20r FIFO 0,24 0t0 1250 /run/systemd/sessions/1.ref 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-l 737 root 21r FIFO 0,24 0t0 1254 /run/systemd/sessions/2.ref 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 157072 13149 /usr/lib64/libnss_myhostname.so.2 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.280 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-03-26T13:33:37.281 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.281 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-03-26T13:33:37.281 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-03-26T13:33:37.281 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-03-26T13:33:37.281 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-03-26T13:33:37.281 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-03-26T13:33:37.281 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.281 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.281 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.282 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.282 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony 1w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.282 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.282 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony 3u unix 0xffff917ee32572c0 0t0 19007 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.282 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony 5u IPv4 19012 0t0 UDP localhost:323 2024-03-26T13:33:37.282 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony 6u IPv6 19013 0t0 UDP localhost:323 2024-03-26T13:33:37.282 INFO:teuthology.orchestra.run.smithi063.stdout:chronyd 760 chrony 7u unix 0xffff917ee32550c0 0t0 19014 /run/chrony/chronyd.sock type=DGRAM (CONNECTED) 2024-03-26T13:33:37.282 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.282 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.283 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root txt REG 8,1 53128 20358 /usr/lib/systemd/systemd-hostnamed 2024-03-26T13:33:37.283 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-03-26T13:33:37.283 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.283 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.283 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.283 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.283 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.283 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.283 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-03-26T13:33:37.284 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.285 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.285 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.285 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.285 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-03-26T13:33:37.285 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.285 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-03-26T13:33:37.285 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.285 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.285 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-03-26T13:33:37.286 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.286 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-03-26T13:33:37.286 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.286 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.286 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.286 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root 1u unix 0xffff917ee064ea40 0t0 19025 type=STREAM (CONNECTED) 2024-03-26T13:33:37.286 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root 2u unix 0xffff917ee064ea40 0t0 19025 type=STREAM (CONNECTED) 2024-03-26T13:33:37.286 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root 3u sock 0,8 0t0 19079 protocol: UNIX 2024-03-26T13:33:37.287 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root 4u a_inode 0,14 0 2080 [eventpoll:5,6,7,8] 2024-03-26T13:33:37.287 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root 5u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.287 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root 6u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.287 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root 7u sock 0,8 0t0 19083 protocol: UNIX-STREAM 2024-03-26T13:33:37.287 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-h 779 root 8u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.287 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.287 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.287 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-03-26T13:33:37.287 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.289 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.290 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.290 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.290 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.290 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.290 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.290 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.290 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.290 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.291 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.291 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root 1u unix 0xffff917ee045d500 0t0 21309 type=STREAM (CONNECTED) 2024-03-26T13:33:37.291 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root 2u unix 0xffff917ee045d500 0t0 21309 type=STREAM (CONNECTED) 2024-03-26T13:33:37.291 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root 3u IPv4 21328 0t0 TCP *:ssh (LISTEN) 2024-03-26T13:33:37.291 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 829 root 4u IPv6 21330 0t0 TCP *:ssh (LISTEN) 2024-03-26T13:33:37.291 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.291 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.291 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-03-26T13:33:37.291 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.292 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.293 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.293 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2024-03-26T13:33:37.293 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.293 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.293 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.293 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2024-03-26T13:33:37.293 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.293 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.293 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.294 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.294 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.294 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.294 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.294 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.294 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.294 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-03-26T13:33:37.294 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2024-03-26T13:33:37.294 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-03-26T13:33:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.295 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.296 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.296 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.296 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.296 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.296 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.296 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.296 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.296 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.296 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-03-26T13:33:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.298 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.298 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.298 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root 1u unix 0xffff917ec1ccbb80 0t0 2361 type=STREAM (CONNECTED) 2024-03-26T13:33:37.298 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root 2u unix 0xffff917ec1ccbb80 0t0 2361 type=STREAM (CONNECTED) 2024-03-26T13:33:37.298 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root 3w REG 8,1 9346 1216 /var/log/tuned/tuned.log 2024-03-26T13:33:37.298 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root 4u sock 0,8 0t0 21855 protocol: NETLINK 2024-03-26T13:33:37.298 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root 5u unix 0xffff917ee04c8000 0t0 21870 type=STREAM (CONNECTED) 2024-03-26T13:33:37.298 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root 6u a_inode 0,14 0 2080 [eventfd:17] 2024-03-26T13:33:37.298 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root 7u unix 0xffff917ee0499dc0 0t0 16994 type=STREAM (CONNECTED) 2024-03-26T13:33:37.299 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 root 8u unix 0xffff917ee049d940 0t0 16995 type=STREAM (CONNECTED) 2024-03-26T13:33:37.299 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.299 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.299 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-03-26T13:33:37.299 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-03-26T13:33:37.299 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.299 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.299 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2024-03-26T13:33:37.299 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.300 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-03-26T13:33:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-03-26T13:33:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2024-03-26T13:33:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-03-26T13:33:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-03-26T13:33:37.302 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.303 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.303 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.303 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.303 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.303 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.303 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.303 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.303 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.303 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.304 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.304 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.304 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.304 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.304 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.304 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.304 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.304 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.304 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-03-26T13:33:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-03-26T13:33:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root 1u unix 0xffff917ec1ccbb80 0t0 2361 type=STREAM (CONNECTED) 2024-03-26T13:33:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root 2u unix 0xffff917ec1ccbb80 0t0 2361 type=STREAM (CONNECTED) 2024-03-26T13:33:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root 3w REG 8,1 9346 1216 /var/log/tuned/tuned.log 2024-03-26T13:33:37.306 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root 4u sock 0,8 0t0 21855 protocol: NETLINK 2024-03-26T13:33:37.306 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root 5u unix 0xffff917ee04c8000 0t0 21870 type=STREAM (CONNECTED) 2024-03-26T13:33:37.306 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root 6u a_inode 0,14 0 2080 [eventfd:17] 2024-03-26T13:33:37.306 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root 7u unix 0xffff917ee0499dc0 0t0 16994 type=STREAM (CONNECTED) 2024-03-26T13:33:37.306 INFO:teuthology.orchestra.run.smithi063.stdout:tuned 832 924 tuned root 8u unix 0xffff917ee049d940 0t0 16995 type=STREAM (CONNECTED) 2024-03-26T13:33:37.306 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.306 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.306 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-03-26T13:33:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-03-26T13:33:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-03-26T13:33:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.309 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.309 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.309 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-03-26T13:33:37.309 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.309 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-03-26T13:33:37.309 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-03-26T13:33:37.309 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-03-26T13:33:37.309 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.309 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-03-26T13:33:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 1u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 2u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 3u unix 0xffff917ee042aa80 0t0 15036 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 4r FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 5u a_inode 0,14 0 2080 [eventpoll:4,6,7,8] 2024-03-26T13:33:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 6u a_inode 0,14 0 2080 [eventfd:16] 2024-03-26T13:33:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 7u unix 0xffff917ee0422ec0 0t0 15037 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.311 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 8u unix 0xffff917ee0421540 0t0 15038 /run/gssproxy.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.312 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 root 9w FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.312 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.312 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.312 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-03-26T13:33:37.312 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.312 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.312 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.312 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-03-26T13:33:37.312 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-03-26T13:33:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-03-26T13:33:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-03-26T13:33:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-03-26T13:33:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-03-26T13:33:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-03-26T13:33:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-03-26T13:33:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-03-26T13:33:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.316 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.316 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.316 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.316 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.316 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.316 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 1u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.316 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 2u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.316 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 3u unix 0xffff917ee042aa80 0t0 15036 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.316 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 4r FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.317 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 5u a_inode 0,14 0 2080 [eventpoll:4,6,7,8] 2024-03-26T13:33:37.317 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 6u a_inode 0,14 0 2080 [eventfd:16] 2024-03-26T13:33:37.317 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 7u unix 0xffff917ee0422ec0 0t0 15037 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.317 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 8u unix 0xffff917ee0421540 0t0 15038 /run/gssproxy.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.317 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 844 gssproxy root 9w FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.317 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.317 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.317 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-03-26T13:33:37.317 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-03-26T13:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-03-26T13:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.319 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.319 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.319 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.319 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-03-26T13:33:37.319 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-03-26T13:33:37.319 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-03-26T13:33:37.319 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.319 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.319 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.320 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.320 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.320 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-03-26T13:33:37.320 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.320 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-03-26T13:33:37.320 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-03-26T13:33:37.320 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-03-26T13:33:37.320 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.320 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.321 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.322 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 1u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.322 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 2u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.322 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 3u unix 0xffff917ee042aa80 0t0 15036 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.322 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 4r FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.322 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 5u a_inode 0,14 0 2080 [eventpoll:4,6,7,8] 2024-03-26T13:33:37.322 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 6u a_inode 0,14 0 2080 [eventfd:16] 2024-03-26T13:33:37.322 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 7u unix 0xffff917ee0422ec0 0t0 15037 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.322 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 8u unix 0xffff917ee0421540 0t0 15038 /run/gssproxy.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.322 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 845 gssproxy root 9w FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.323 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.323 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.323 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-03-26T13:33:37.323 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.323 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.323 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.323 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-03-26T13:33:37.323 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-03-26T13:33:37.323 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-03-26T13:33:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-03-26T13:33:37.325 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.325 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.325 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.325 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.325 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.325 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-03-26T13:33:37.325 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.325 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-03-26T13:33:37.325 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-03-26T13:33:37.326 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-03-26T13:33:37.326 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.326 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.326 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-03-26T13:33:37.326 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.326 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.326 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.326 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.327 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.327 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.327 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.327 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.327 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.327 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 1u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.327 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 2u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.327 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 3u unix 0xffff917ee042aa80 0t0 15036 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.327 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 4r FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 5u a_inode 0,14 0 2080 [eventpoll:4,6,7,8] 2024-03-26T13:33:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 6u a_inode 0,14 0 2080 [eventfd:16] 2024-03-26T13:33:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 7u unix 0xffff917ee0422ec0 0t0 15037 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 8u unix 0xffff917ee0421540 0t0 15038 /run/gssproxy.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 846 gssproxy root 9w FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-03-26T13:33:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.330 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.330 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.330 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-03-26T13:33:37.330 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-03-26T13:33:37.330 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-03-26T13:33:37.330 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.330 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.330 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.330 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-03-26T13:33:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-03-26T13:33:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-03-26T13:33:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-03-26T13:33:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 1u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.333 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 2u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.333 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 3u unix 0xffff917ee042aa80 0t0 15036 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.333 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 4r FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.333 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 5u a_inode 0,14 0 2080 [eventpoll:4,6,7,8] 2024-03-26T13:33:37.333 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 6u a_inode 0,14 0 2080 [eventfd:16] 2024-03-26T13:33:37.333 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 7u unix 0xffff917ee0422ec0 0t0 15037 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.333 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 8u unix 0xffff917ee0421540 0t0 15038 /run/gssproxy.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.333 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 847 gssproxy root 9w FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.335 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.335 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.335 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.335 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.335 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.335 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.335 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-03-26T13:33:37.335 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-03-26T13:33:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-03-26T13:33:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-03-26T13:33:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-03-26T13:33:37.337 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-03-26T13:33:37.337 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-03-26T13:33:37.337 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.337 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.337 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-03-26T13:33:37.337 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.337 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.337 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.337 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 1u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 2u unix 0xffff917ec1ccc400 0t0 2357 type=STREAM (CONNECTED) 2024-03-26T13:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 3u unix 0xffff917ee042aa80 0t0 15036 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 4r FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 5u a_inode 0,14 0 2080 [eventpoll:4,6,7,8] 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 6u a_inode 0,14 0 2080 [eventfd:16] 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 7u unix 0xffff917ee0422ec0 0t0 15037 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 8u unix 0xffff917ee0421540 0t0 15038 /run/gssproxy.sock type=STREAM (LISTEN) 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:gssproxy 843 848 gssproxy root 9w FIFO 0,13 0t0 15041 pipe 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root cwd DIR 8,1 4096 1657 /var/spool/at 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root txt REG 8,1 32680 12473 /usr/sbin/atd 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.339 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.341 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.341 INFO:teuthology.orchestra.run.smithi063.stdout:atd 850 root 3uW REG 0,24 4 1196 /run/atd.pid 2024-03-26T13:33:37.341 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.341 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.341 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root txt REG 8,1 74552 11234 /usr/sbin/crond 2024-03-26T13:33:37.341 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.341 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.341 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.341 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.342 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.342 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.342 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.342 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.342 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.342 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.342 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.342 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.342 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.343 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.343 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.343 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.343 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.343 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.343 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.343 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.343 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.343 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root 1u unix 0xffff917ee04cdd80 0t0 21843 type=STREAM (CONNECTED) 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root 2u unix 0xffff917ee04cdd80 0t0 21843 type=STREAM (CONNECTED) 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root 3uW REG 0,24 4 1195 /run/crond.pid 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root 4u unix 0xffff917ee04d5d80 0t0 21846 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:crond 851 root 5r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2024-03-26T13:33:37.344 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-03-26T13:33:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe 1w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe 2w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe 3u IPv4 15102 0t0 TCP *:nrpe (LISTEN) 2024-03-26T13:33:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe 4u unix 0xffff917ee042d500 0t0 15094 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.346 INFO:teuthology.orchestra.run.smithi063.stdout:nrpe 946 nrpe 5u IPv6 15103 0t0 TCP *:nrpe (LISTEN) 2024-03-26T13:33:37.346 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.346 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.346 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root txt REG 8,1 1388920 9667 /usr/bin/bash 2024-03-26T13:33:37.346 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.346 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.346 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.346 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.346 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.347 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.348 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.348 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.348 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root 1w CHR 4,65 0t0 114 /dev/ttyS1 2024-03-26T13:33:37.348 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root 2w CHR 4,65 0t0 114 /dev/ttyS1 2024-03-26T13:33:37.348 INFO:teuthology.orchestra.run.smithi063.stdout:rc.local 947 root 255r REG 8,1 4545 63567 /etc/rc.d/rc.local 2024-03-26T13:33:37.348 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.348 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.348 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2024-03-26T13:33:37.348 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.349 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.350 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.350 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.350 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2024-03-26T13:33:37.350 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.350 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2024-03-26T13:33:37.350 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2024-03-26T13:33:37.350 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.350 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.350 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.351 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 1w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.351 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 2w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.351 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 3r CHR 1,9 0t0 9 /dev/urandom 2024-03-26T13:33:37.351 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 4w REG 8,1 751082 1641 /var/log/messages 2024-03-26T13:33:37.351 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 5u unix 0xffff917ee04d3740 0t0 21906 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.351 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 6w REG 8,1 680 1220 /var/log/cron 2024-03-26T13:33:37.351 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 7w REG 8,1 324686 1642 /var/log/secure 2024-03-26T13:33:37.351 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.351 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 root 10r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.352 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2024-03-26T13:33:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2024-03-26T13:33:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2024-03-26T13:33:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 4w REG 8,1 751082 1641 /var/log/messages 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 5u unix 0xffff917ee04d3740 0t0 21906 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.354 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 6w REG 8,1 680 1220 /var/log/cron 2024-03-26T13:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 7w REG 8,1 324686 1642 /var/log/secure 2024-03-26T13:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 971 in:imjour root 10r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-03-26T13:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2024-03-26T13:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-03-26T13:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2024-03-26T13:33:37.355 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.356 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.356 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.356 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.356 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2024-03-26T13:33:37.356 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2024-03-26T13:33:37.356 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.356 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.356 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.356 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.358 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2024-03-26T13:33:37.358 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 4w REG 8,1 751082 1641 /var/log/messages 2024-03-26T13:33:37.358 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 5u unix 0xffff917ee04d3740 0t0 21906 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.358 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 6w REG 8,1 680 1220 /var/log/cron 2024-03-26T13:33:37.358 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 7w REG 8,1 324686 1642 /var/log/secure 2024-03-26T13:33:37.358 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.358 INFO:teuthology.orchestra.run.smithi063.stdout:rsyslogd 952 977 rs:main root 10r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-03-26T13:33:37.358 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.358 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-03-26T13:33:37.359 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-03-26T13:33:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2024-03-26T13:33:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-03-26T13:33:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-03-26T13:33:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-03-26T13:33:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-03-26T13:33:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-03-26T13:33:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-03-26T13:33:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-03-26T13:33:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-03-26T13:33:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-03-26T13:33:37.362 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.362 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.362 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.362 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.362 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.362 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.362 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.362 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.362 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.363 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.363 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.363 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.363 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.363 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.363 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.363 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.363 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.363 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root 3u unix 0xffff917ee0483740 0t0 21483 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.364 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root 4u IPv4 21426 0t0 TCP smithi063.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:54666 (ESTABLISHED) 2024-03-26T13:33:37.365 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root 6u unix 0xffff917ee0426e80 0t0 15148 type=STREAM (CONNECTED) 2024-03-26T13:33:37.365 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root 7w FIFO 0,24 0t0 1250 /run/systemd/sessions/1.ref 2024-03-26T13:33:37.365 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1302 root 8u unix 0xffff917ee0420880 0t0 15171 type=STREAM (CONNECTED) 2024-03-26T13:33:37.365 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.365 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.365 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-03-26T13:33:37.365 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-03-26T13:33:37.365 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2024-03-26T13:33:37.365 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-03-26T13:33:37.366 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.366 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.366 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-03-26T13:33:37.366 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-03-26T13:33:37.366 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-03-26T13:33:37.366 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-03-26T13:33:37.366 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2024-03-26T13:33:37.366 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-03-26T13:33:37.367 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-03-26T13:33:37.367 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-03-26T13:33:37.367 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-03-26T13:33:37.367 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-03-26T13:33:37.367 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-03-26T13:33:37.367 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-03-26T13:33:37.367 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2024-03-26T13:33:37.367 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2024-03-26T13:33:37.367 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.368 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.369 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.369 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.369 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.369 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.369 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.372 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.372 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.373 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.374 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.374 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.374 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-03-26T13:33:37.374 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.374 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.374 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.374 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.374 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.374 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root 3u unix 0xffff917ee0482640 0t0 21484 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root 4u IPv4 21430 0t0 TCP smithi063.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:54654 (ESTABLISHED) 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root 6u unix 0xffff917ee0649100 0t0 19321 type=STREAM (CONNECTED) 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root 7w FIFO 0,24 0t0 1254 /run/systemd/sessions/2.ref 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1303 root 8u unix 0xffff917ee04ca200 0t0 22029 type=STREAM (CONNECTED) 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.375 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.376 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.376 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.376 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.376 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.376 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-03-26T13:33:37.376 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.376 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.376 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.376 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.377 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.377 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.377 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.377 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.377 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.377 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.377 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.377 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.377 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-03-26T13:33:37.378 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.379 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.379 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.379 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 1u unix 0xffff917ec1ccee80 0t0 2490 type=STREAM (CONNECTED) 2024-03-26T13:33:37.379 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 2u unix 0xffff917ec1ccee80 0t0 2490 type=STREAM (CONNECTED) 2024-03-26T13:33:37.379 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 3u unix 0xffff917ec92bb300 0t0 2518 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.379 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 4u a_inode 0,14 0 2080 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-03-26T13:33:37.379 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 5u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.379 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 6r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.379 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 7r DIR 0,25 0 3403 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-03-26T13:33:37.380 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 8u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.380 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 9u a_inode 0,14 0 2080 [eventpoll:10,13] 2024-03-26T13:33:37.380 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 10r REG 0,20 0 2507 /proc/1382/mountinfo 2024-03-26T13:33:37.380 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 11r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.380 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 12u unix 0xffff917ec1cc9dc0 0t0 2540 /run/user/1000/bus type=STREAM (LISTEN) 2024-03-26T13:33:37.380 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 13r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.380 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2024-03-26T13:33:37.380 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 15u netlink 0t0 2522 KOBJECT_UEVENT 2024-03-26T13:33:37.380 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 16u unix 0xffff917ec92bb740 0t0 2527 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-03-26T13:33:37.381 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 17u unix 0xffff917ec92ba640 0t0 2528 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.381 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 18u unix 0xffff917ec92b9100 0t0 2529 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.381 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 19u unix 0xffff917ec1ccb300 0t0 2530 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-03-26T13:33:37.381 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 20u unix 0xffff917ec1ccb740 0t0 2532 type=STREAM (CONNECTED) 2024-03-26T13:33:37.381 INFO:teuthology.orchestra.run.smithi063.stdout:systemd 1382 ubuntu 21u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.381 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.381 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.381 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2024-03-26T13:33:37.381 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-03-26T13:33:37.382 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-03-26T13:33:37.382 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-03-26T13:33:37.382 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-03-26T13:33:37.382 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-03-26T13:33:37.382 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-03-26T13:33:37.382 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-03-26T13:33:37.382 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-03-26T13:33:37.382 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.382 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.383 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.383 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.383 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-03-26T13:33:37.383 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-03-26T13:33:37.383 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-03-26T13:33:37.383 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-03-26T13:33:37.383 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-03-26T13:33:37.383 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.383 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.384 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-03-26T13:33:37.384 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.384 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.384 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.384 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.384 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.384 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.384 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.384 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.385 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.385 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-03-26T13:33:37.385 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.385 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.385 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-03-26T13:33:37.385 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.385 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.385 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2024-03-26T13:33:37.385 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-03-26T13:33:37.386 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.386 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.386 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-03-26T13:33:37.386 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.386 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-03-26T13:33:37.386 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.386 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.386 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.387 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu 1u unix 0xffff917ec1ccee80 0t0 2490 type=STREAM (CONNECTED) 2024-03-26T13:33:37.387 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu 2u unix 0xffff917ec1ccee80 0t0 2490 type=STREAM (CONNECTED) 2024-03-26T13:33:37.387 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu 3u a_inode 0,14 0 2080 [eventfd:13] 2024-03-26T13:33:37.387 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu 4u a_inode 0,14 0 2080 [eventfd:14] 2024-03-26T13:33:37.387 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu 6w FIFO 0,13 0t0 2494 pipe 2024-03-26T13:33:37.387 INFO:teuthology.orchestra.run.smithi063.stdout:(sd-pam) 1384 ubuntu 7u unix 0xffff917ec92bdd80 0t0 2510 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.387 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.387 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.387 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-03-26T13:33:37.388 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-03-26T13:33:37.388 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2024-03-26T13:33:37.388 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-03-26T13:33:37.388 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.388 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.388 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-03-26T13:33:37.388 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-03-26T13:33:37.388 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-03-26T13:33:37.388 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-03-26T13:33:37.389 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2024-03-26T13:33:37.389 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-03-26T13:33:37.389 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-03-26T13:33:37.389 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-03-26T13:33:37.389 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-03-26T13:33:37.389 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-03-26T13:33:37.389 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-03-26T13:33:37.389 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-03-26T13:33:37.389 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2024-03-26T13:33:37.390 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2024-03-26T13:33:37.390 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-03-26T13:33:37.390 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-03-26T13:33:37.390 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-03-26T13:33:37.390 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.390 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.390 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.390 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-03-26T13:33:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.394 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.394 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 3u unix 0xffff917ee0482640 0t0 21484 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.394 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 4u IPv4 21430 0t0 TCP smithi063.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:54654 (ESTABLISHED) 2024-03-26T13:33:37.394 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 5u unix 0xffff917ee04cbfc0 0t0 22028 type=STREAM (CONNECTED) 2024-03-26T13:33:37.394 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 6u unix 0xffff917ee0649100 0t0 19321 type=STREAM (CONNECTED) 2024-03-26T13:33:37.394 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 7w FIFO 0,24 0t0 1254 /run/systemd/sessions/2.ref 2024-03-26T13:33:37.394 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 12r FIFO 0,13 0t0 24959 pipe 2024-03-26T13:33:37.394 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1400 ubuntu 14r FIFO 0,13 0t0 24960 pipe 2024-03-26T13:33:37.394 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.395 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.395 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-03-26T13:33:37.395 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-03-26T13:33:37.395 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2024-03-26T13:33:37.395 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-03-26T13:33:37.395 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.395 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.395 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-03-26T13:33:37.395 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-03-26T13:33:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-03-26T13:33:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-03-26T13:33:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2024-03-26T13:33:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-03-26T13:33:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-03-26T13:33:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-03-26T13:33:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-03-26T13:33:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-03-26T13:33:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2024-03-26T13:33:37.397 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2024-03-26T13:33:37.398 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-03-26T13:33:37.398 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-03-26T13:33:37.398 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.398 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.398 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.398 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.398 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.398 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.398 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.399 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.400 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-03-26T13:33:37.400 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.400 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.400 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-03-26T13:33:37.400 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.400 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.400 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.400 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.400 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.401 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu 3u unix 0xffff917ee0483740 0t0 21483 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.401 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu 4u IPv4 21426 0t0 TCP smithi063.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:54666 (ESTABLISHED) 2024-03-26T13:33:37.401 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu 5u unix 0xffff917ee0426a40 0t0 15170 type=STREAM (CONNECTED) 2024-03-26T13:33:37.401 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu 6u unix 0xffff917ee0426e80 0t0 15148 type=STREAM (CONNECTED) 2024-03-26T13:33:37.401 INFO:teuthology.orchestra.run.smithi063.stdout:sshd 1401 ubuntu 7w FIFO 0,24 0t0 1250 /run/systemd/sessions/1.ref 2024-03-26T13:33:37.401 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.401 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.401 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2024-03-26T13:33:37.401 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 561841 62217 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.symbols.bin 2024-03-26T13:33:37.402 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2024-03-26T13:33:37.402 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 815256 59736 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.alias.bin 2024-03-26T13:33:37.402 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 380439 62222 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.dep.bin 2024-03-26T13:33:37.402 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.402 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.402 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-03-26T13:33:37.402 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.402 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-03-26T13:33:37.402 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.403 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.403 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 11772 62218 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.builtin.bin 2024-03-26T13:33:37.403 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.403 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.403 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-03-26T13:33:37.403 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-03-26T13:33:37.404 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-03-26T13:33:37.404 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.404 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.404 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-03-26T13:33:37.404 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.404 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-03-26T13:33:37.404 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.404 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-03-26T13:33:37.405 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-03-26T13:33:37.406 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.406 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-03-26T13:33:37.406 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.406 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 1u unix 0xffff917ee0421980 0t0 14624 type=STREAM (CONNECTED) 2024-03-26T13:33:37.406 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 2u unix 0xffff917ee0421980 0t0 14624 type=STREAM (CONNECTED) 2024-03-26T13:33:37.406 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 3u a_inode 0,14 0 2080 [eventpoll:4,13] 2024-03-26T13:33:37.406 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 4u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 5u unix 0xffff917ee042dd80 0t0 14636 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 7u unix 0xffff917ee042b740 0t0 14641 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 8r a_inode 0,14 0 2080 inotify 2024-03-26T13:33:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 9u a_inode 0,14 0 2080 [eventpoll:3,4,6,8,10,11,13,14] 2024-03-26T13:33:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 10u a_inode 0,14 0 2080 [signalfd] 2024-03-26T13:33:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 11u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2024-03-26T13:33:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 13u netlink 0t0 22372 KOBJECT_UEVENT 2024-03-26T13:33:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:systemd-u 5094 root 14u a_inode 0,14 0 2080 [timerfd] 2024-03-26T13:33:37.408 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root cwd DIR 8,1 4096 2 / 2024-03-26T13:33:37.408 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.408 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root txt REG 8,1 36312 10086 /usr/bin/sleep 2024-03-26T13:33:37.408 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.408 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.408 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.408 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.408 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.408 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.410 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root 0r CHR 1,3 0t0 4 /dev/null 2024-03-26T13:33:37.410 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root 1w CHR 4,65 0t0 114 /dev/ttyS1 2024-03-26T13:33:37.410 INFO:teuthology.orchestra.run.smithi063.stdout:sleep 5098 root 2w CHR 4,65 0t0 114 /dev/ttyS1 2024-03-26T13:33:37.410 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2024-03-26T13:33:37.410 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.410 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2024-03-26T13:33:37.410 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.410 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.410 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2024-03-26T13:33:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.412 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.412 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.412 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.412 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.412 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu 0r FIFO 0,13 0t0 24958 pipe 2024-03-26T13:33:37.412 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu 1w FIFO 0,13 0t0 24959 pipe 2024-03-26T13:33:37.412 INFO:teuthology.orchestra.run.smithi063.stdout:bash 5248 ubuntu 2w FIFO 0,13 0t0 24960 pipe 2024-03-26T13:33:37.412 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root cwd DIR 8,1 4096 1026 /home/ubuntu 2024-03-26T13:33:37.412 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.413 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root txt REG 8,1 185296 11759 /usr/bin/sudo 2024-03-26T13:33:37.413 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-03-26T13:33:37.413 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-03-26T13:33:37.413 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-03-26T13:33:37.413 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-03-26T13:33:37.413 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-03-26T13:33:37.413 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-03-26T13:33:37.413 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-03-26T13:33:37.413 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-03-26T13:33:37.414 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-03-26T13:33:37.414 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-03-26T13:33:37.414 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-03-26T13:33:37.414 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-03-26T13:33:37.414 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.414 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.414 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.414 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-03-26T13:33:37.414 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-03-26T13:33:37.415 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-03-26T13:33:37.415 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.415 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.415 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-03-26T13:33:37.415 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-03-26T13:33:37.415 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-03-26T13:33:37.415 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-03-26T13:33:37.415 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.415 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.416 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-03-26T13:33:37.416 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-03-26T13:33:37.416 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-03-26T13:33:37.416 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-03-26T13:33:37.416 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.416 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-03-26T13:33:37.416 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-03-26T13:33:37.416 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-03-26T13:33:37.416 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.417 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-03-26T13:33:37.418 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-03-26T13:33:37.418 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.418 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-03-26T13:33:37.418 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-03-26T13:33:37.418 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-03-26T13:33:37.418 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-03-26T13:33:37.418 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-03-26T13:33:37.418 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-03-26T13:33:37.418 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-03-26T13:33:37.419 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.419 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-03-26T13:33:37.419 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root 0r FIFO 0,13 0t0 24958 pipe 2024-03-26T13:33:37.419 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root 1w FIFO 0,13 0t0 24959 pipe 2024-03-26T13:33:37.419 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root 2w FIFO 0,13 0t0 24960 pipe 2024-03-26T13:33:37.419 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root 3r FIFO 0,13 0t0 26791 pipe 2024-03-26T13:33:37.419 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root 4w FIFO 0,13 0t0 26791 pipe 2024-03-26T13:33:37.419 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root 5u netlink 0t0 26797 AUDIT 2024-03-26T13:33:37.419 INFO:teuthology.orchestra.run.smithi063.stdout:sudo 5264 root 6u unix 0xffff917ee01c3300 0t0 26798 type=DGRAM (CONNECTED) 2024-03-26T13:33:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root cwd DIR 8,1 4096 1026 /home/ubuntu 2024-03-26T13:33:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root txt REG 8,1 179232 12343 /usr/bin/lsof 2024-03-26T13:33:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.421 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.421 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.421 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.421 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.421 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.421 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.421 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.421 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2024-03-26T13:33:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root 0r FIFO 0,13 0t0 24958 pipe 2024-03-26T13:33:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root 1w FIFO 0,13 0t0 24959 pipe 2024-03-26T13:33:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root 2w FIFO 0,13 0t0 24960 pipe 2024-03-26T13:33:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root 3r DIR 0,20 0 1 /proc 2024-03-26T13:33:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root 4r DIR 0,20 0 23140 /proc/5266/fd 2024-03-26T13:33:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root 5w FIFO 0,13 0t0 23145 pipe 2024-03-26T13:33:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5266 root 6r FIFO 0,13 0t0 23146 pipe 2024-03-26T13:33:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root cwd DIR 8,1 4096 1026 /home/ubuntu 2024-03-26T13:33:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root rtd DIR 8,1 4096 2 / 2024-03-26T13:33:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root txt REG 8,1 179232 12343 /usr/bin/lsof 2024-03-26T13:33:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-03-26T13:33:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-03-26T13:33:37.424 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-03-26T13:33:37.424 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-03-26T13:33:37.424 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-03-26T13:33:37.424 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-03-26T13:33:37.424 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-03-26T13:33:37.424 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-03-26T13:33:37.424 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-03-26T13:33:37.424 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-03-26T13:33:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-03-26T13:33:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-03-26T13:33:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-03-26T13:33:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2024-03-26T13:33:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-03-26T13:33:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-03-26T13:33:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root 4r FIFO 0,13 0t0 23145 pipe 2024-03-26T13:33:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:lsof 5267 root 7w FIFO 0,13 0t0 23146 pipe 2024-03-26T13:33:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2024-03-26T13:33:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:root 2 0.0 0.0 0 0 ? S 13:32 0:00 [kthreadd] 2024-03-26T13:33:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:root 3 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [rcu_gp] 2024-03-26T13:33:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:root 4 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [rcu_par_gp] 2024-03-26T13:33:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:root 5 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [slub_flushwq] 2024-03-26T13:33:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:root 6 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [netns] 2024-03-26T13:33:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:root 7 0.2 0.0 0 0 ? I 13:32 0:00 \_ [kworker/0:0-events] 2024-03-26T13:33:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:root 8 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/0:0H-events_highpri] 2024-03-26T13:33:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:root 9 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:0-events_unbound] 2024-03-26T13:33:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:root 10 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [mm_percpu_wq] 2024-03-26T13:33:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:root 11 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:1-flush-8:0] 2024-03-26T13:33:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:root 12 0.0 0.0 0 0 ? I 13:32 0:00 \_ [rcu_tasks_kthre] 2024-03-26T13:33:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:root 13 0.0 0.0 0 0 ? I 13:32 0:00 \_ [rcu_tasks_rude_] 2024-03-26T13:33:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:root 14 0.0 0.0 0 0 ? I 13:32 0:00 \_ [rcu_tasks_trace] 2024-03-26T13:33:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:root 15 0.0 0.0 0 0 ? S 13:32 0:00 \_ [ksoftirqd/0] 2024-03-26T13:33:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:root 16 11.2 0.0 0 0 ? S 13:32 0:04 \_ [pr/ttyS1] 2024-03-26T13:33:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:root 17 0.0 0.0 0 0 ? I 13:32 0:00 \_ [rcu_preempt] 2024-03-26T13:33:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:root 18 0.0 0.0 0 0 ? S 13:32 0:00 \_ [migration/0] 2024-03-26T13:33:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:root 19 0.0 0.0 0 0 ? S 13:32 0:00 \_ [idle_inject/0] 2024-03-26T13:33:37.428 INFO:teuthology.orchestra.run.smithi063.stdout:root 20 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/0:1-cgroup_destroy] 2024-03-26T13:33:37.428 INFO:teuthology.orchestra.run.smithi063.stdout:root 21 0.0 0.0 0 0 ? S 13:32 0:00 \_ [cpuhp/0] 2024-03-26T13:33:37.428 INFO:teuthology.orchestra.run.smithi063.stdout:root 22 0.0 0.0 0 0 ? S 13:32 0:00 \_ [cpuhp/1] 2024-03-26T13:33:37.428 INFO:teuthology.orchestra.run.smithi063.stdout:root 23 0.0 0.0 0 0 ? S 13:32 0:00 \_ [idle_inject/1] 2024-03-26T13:33:37.428 INFO:teuthology.orchestra.run.smithi063.stdout:root 24 0.3 0.0 0 0 ? S 13:32 0:00 \_ [migration/1] 2024-03-26T13:33:37.428 INFO:teuthology.orchestra.run.smithi063.stdout:root 25 0.0 0.0 0 0 ? S 13:32 0:00 \_ [ksoftirqd/1] 2024-03-26T13:33:37.428 INFO:teuthology.orchestra.run.smithi063.stdout:root 26 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/1:0-cgroup_destroy] 2024-03-26T13:33:37.428 INFO:teuthology.orchestra.run.smithi063.stdout:root 27 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/1:0H-events_highpri] 2024-03-26T13:33:37.428 INFO:teuthology.orchestra.run.smithi063.stdout:root 28 0.0 0.0 0 0 ? S 13:32 0:00 \_ [cpuhp/2] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 29 0.0 0.0 0 0 ? S 13:32 0:00 \_ [idle_inject/2] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 30 0.3 0.0 0 0 ? S 13:32 0:00 \_ [migration/2] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 31 0.0 0.0 0 0 ? S 13:32 0:00 \_ [ksoftirqd/2] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 32 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/2:0-cgroup_destroy] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 33 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/2:0H-events_highpri] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 34 0.0 0.0 0 0 ? S 13:32 0:00 \_ [cpuhp/3] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 35 0.0 0.0 0 0 ? S 13:32 0:00 \_ [idle_inject/3] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 36 0.3 0.0 0 0 ? S 13:32 0:00 \_ [migration/3] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 37 0.0 0.0 0 0 ? S 13:32 0:00 \_ [ksoftirqd/3] 2024-03-26T13:33:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:root 38 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/3:0-rcu_gp] 2024-03-26T13:33:37.430 INFO:teuthology.orchestra.run.smithi063.stdout:root 39 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/3:0H-events_highpri] 2024-03-26T13:33:37.430 INFO:teuthology.orchestra.run.smithi063.stdout:root 40 0.0 0.0 0 0 ? S 13:32 0:00 \_ [cpuhp/4] 2024-03-26T13:33:37.430 INFO:teuthology.orchestra.run.smithi063.stdout:root 41 0.0 0.0 0 0 ? S 13:32 0:00 \_ [idle_inject/4] 2024-03-26T13:33:37.430 INFO:teuthology.orchestra.run.smithi063.stdout:root 42 0.3 0.0 0 0 ? S 13:32 0:00 \_ [migration/4] 2024-03-26T13:33:37.430 INFO:teuthology.orchestra.run.smithi063.stdout:root 43 0.0 0.0 0 0 ? S 13:32 0:00 \_ [ksoftirqd/4] 2024-03-26T13:33:37.430 INFO:teuthology.orchestra.run.smithi063.stdout:root 44 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/4:0-events] 2024-03-26T13:33:37.430 INFO:teuthology.orchestra.run.smithi063.stdout:root 45 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/4:0H-events_highpri] 2024-03-26T13:33:37.430 INFO:teuthology.orchestra.run.smithi063.stdout:root 46 0.0 0.0 0 0 ? S 13:32 0:00 \_ [cpuhp/5] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 47 0.0 0.0 0 0 ? S 13:32 0:00 \_ [idle_inject/5] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 48 0.3 0.0 0 0 ? S 13:32 0:00 \_ [migration/5] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 49 0.0 0.0 0 0 ? S 13:32 0:00 \_ [ksoftirqd/5] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 50 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/5:0-cgroup_destroy] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 51 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/5:0H-events_highpri] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 52 0.0 0.0 0 0 ? S 13:32 0:00 \_ [cpuhp/6] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 53 0.0 0.0 0 0 ? S 13:32 0:00 \_ [idle_inject/6] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 54 0.3 0.0 0 0 ? S 13:32 0:00 \_ [migration/6] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 55 0.0 0.0 0 0 ? S 13:32 0:00 \_ [ksoftirqd/6] 2024-03-26T13:33:37.431 INFO:teuthology.orchestra.run.smithi063.stdout:root 56 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/6:0-pm] 2024-03-26T13:33:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:root 57 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/6:0H-events_highpri] 2024-03-26T13:33:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:root 58 0.0 0.0 0 0 ? S 13:32 0:00 \_ [cpuhp/7] 2024-03-26T13:33:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:root 59 0.0 0.0 0 0 ? S 13:32 0:00 \_ [idle_inject/7] 2024-03-26T13:33:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:root 60 0.3 0.0 0 0 ? S 13:32 0:00 \_ [migration/7] 2024-03-26T13:33:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:root 61 0.0 0.0 0 0 ? S 13:32 0:00 \_ [ksoftirqd/7] 2024-03-26T13:33:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:root 62 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/7:0-events] 2024-03-26T13:33:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:root 63 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/7:0H-events_highpri] 2024-03-26T13:33:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:root 65 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:2-flush-8:0] 2024-03-26T13:33:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:root 66 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:3-flush-8:0] 2024-03-26T13:33:37.433 INFO:teuthology.orchestra.run.smithi063.stdout:root 67 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:4-flush-8:0] 2024-03-26T13:33:37.433 INFO:teuthology.orchestra.run.smithi063.stdout:root 68 0.9 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:5-events_unbound] 2024-03-26T13:33:37.433 INFO:teuthology.orchestra.run.smithi063.stdout:root 69 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:6-flush-8:0] 2024-03-26T13:33:37.433 INFO:teuthology.orchestra.run.smithi063.stdout:root 70 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:7-flush-8:0] 2024-03-26T13:33:37.433 INFO:teuthology.orchestra.run.smithi063.stdout:root 71 0.0 0.0 0 0 ? S 13:32 0:00 \_ [kdevtmpfs] 2024-03-26T13:33:37.433 INFO:teuthology.orchestra.run.smithi063.stdout:root 72 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [inet_frag_wq] 2024-03-26T13:33:37.433 INFO:teuthology.orchestra.run.smithi063.stdout:root 73 0.0 0.0 0 0 ? S 13:32 0:00 \_ [kauditd] 2024-03-26T13:33:37.433 INFO:teuthology.orchestra.run.smithi063.stdout:root 74 0.3 0.0 0 0 ? I 13:32 0:00 \_ [kworker/2:1-events] 2024-03-26T13:33:37.433 INFO:teuthology.orchestra.run.smithi063.stdout:root 75 0.0 0.0 0 0 ? S 13:32 0:00 \_ [khungtaskd] 2024-03-26T13:33:37.434 INFO:teuthology.orchestra.run.smithi063.stdout:root 76 0.0 0.0 0 0 ? S 13:32 0:00 \_ [oom_reaper] 2024-03-26T13:33:37.434 INFO:teuthology.orchestra.run.smithi063.stdout:root 77 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [writeback] 2024-03-26T13:33:37.434 INFO:teuthology.orchestra.run.smithi063.stdout:root 78 0.0 0.0 0 0 ? S 13:32 0:00 \_ [kcompactd0] 2024-03-26T13:33:37.434 INFO:teuthology.orchestra.run.smithi063.stdout:root 79 0.0 0.0 0 0 ? SN 13:32 0:00 \_ [ksmd] 2024-03-26T13:33:37.434 INFO:teuthology.orchestra.run.smithi063.stdout:root 80 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/3:1-events] 2024-03-26T13:33:37.434 INFO:teuthology.orchestra.run.smithi063.stdout:root 81 0.0 0.0 0 0 ? SN 13:32 0:00 \_ [khugepaged] 2024-03-26T13:33:37.434 INFO:teuthology.orchestra.run.smithi063.stdout:root 82 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [cryptd] 2024-03-26T13:33:37.435 INFO:teuthology.orchestra.run.smithi063.stdout:root 83 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kintegrityd] 2024-03-26T13:33:37.435 INFO:teuthology.orchestra.run.smithi063.stdout:root 84 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kblockd] 2024-03-26T13:33:37.435 INFO:teuthology.orchestra.run.smithi063.stdout:root 85 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [blkcg_punt_bio] 2024-03-26T13:33:37.435 INFO:teuthology.orchestra.run.smithi063.stdout:root 86 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [tpm_dev_wq] 2024-03-26T13:33:37.435 INFO:teuthology.orchestra.run.smithi063.stdout:root 87 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [md] 2024-03-26T13:33:37.435 INFO:teuthology.orchestra.run.smithi063.stdout:root 88 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [edac-poller] 2024-03-26T13:33:37.435 INFO:teuthology.orchestra.run.smithi063.stdout:root 89 0.0 0.0 0 0 ? S 13:32 0:00 \_ [watchdogd] 2024-03-26T13:33:37.435 INFO:teuthology.orchestra.run.smithi063.stdout:root 90 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/4:1-events] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 91 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/2:1H-kblockd] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 92 0.1 0.0 0 0 ? I 13:32 0:00 \_ [kworker/5:1-events] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 93 0.0 0.0 0 0 ? S 13:32 0:00 \_ [kswapd0] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 98 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kthrotld] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 99 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/2:2] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 101 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/4:2-cgroup_destroy] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 103 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/0:2] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 105 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/1:1-events] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 106 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/6:1-pm] 2024-03-26T13:33:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:root 107 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/7:1-events] 2024-03-26T13:33:37.437 INFO:teuthology.orchestra.run.smithi063.stdout:root 108 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [acpi_thermal_pm] 2024-03-26T13:33:37.437 INFO:teuthology.orchestra.run.smithi063.stdout:root 109 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kmpath_rdacd] 2024-03-26T13:33:37.437 INFO:teuthology.orchestra.run.smithi063.stdout:root 110 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kaluad] 2024-03-26T13:33:37.437 INFO:teuthology.orchestra.run.smithi063.stdout:root 111 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [mld] 2024-03-26T13:33:37.437 INFO:teuthology.orchestra.run.smithi063.stdout:root 112 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/4:1H-kblockd] 2024-03-26T13:33:37.437 INFO:teuthology.orchestra.run.smithi063.stdout:root 113 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [ipv6_addrconf] 2024-03-26T13:33:37.437 INFO:teuthology.orchestra.run.smithi063.stdout:root 122 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kstrp] 2024-03-26T13:33:37.437 INFO:teuthology.orchestra.run.smithi063.stdout:root 123 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/4:3] 2024-03-26T13:33:37.437 INFO:teuthology.orchestra.run.smithi063.stdout:root 131 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/6:2-cgroup_destroy] 2024-03-26T13:33:37.438 INFO:teuthology.orchestra.run.smithi063.stdout:root 132 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/6:3-events] 2024-03-26T13:33:37.438 INFO:teuthology.orchestra.run.smithi063.stdout:root 133 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/7:2-events] 2024-03-26T13:33:37.438 INFO:teuthology.orchestra.run.smithi063.stdout:root 138 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [zswap-shrink] 2024-03-26T13:33:37.438 INFO:teuthology.orchestra.run.smithi063.stdout:root 252 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/6:4] 2024-03-26T13:33:37.438 INFO:teuthology.orchestra.run.smithi063.stdout:root 253 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/u17:0] 2024-03-26T13:33:37.438 INFO:teuthology.orchestra.run.smithi063.stdout:root 292 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/0:1H-kblockd] 2024-03-26T13:33:37.438 INFO:teuthology.orchestra.run.smithi063.stdout:root 308 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/7:1H-kblockd] 2024-03-26T13:33:37.438 INFO:teuthology.orchestra.run.smithi063.stdout:root 372 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/3:1H-kblockd] 2024-03-26T13:33:37.438 INFO:teuthology.orchestra.run.smithi063.stdout:root 387 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/5:1H-kblockd] 2024-03-26T13:33:37.439 INFO:teuthology.orchestra.run.smithi063.stdout:root 421 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/5:2-cgroup_destroy] 2024-03-26T13:33:37.439 INFO:teuthology.orchestra.run.smithi063.stdout:root 427 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/3:2-cgroup_destroy] 2024-03-26T13:33:37.439 INFO:teuthology.orchestra.run.smithi063.stdout:root 438 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [nvme-wq] 2024-03-26T13:33:37.439 INFO:teuthology.orchestra.run.smithi063.stdout:root 439 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [nvme-reset-wq] 2024-03-26T13:33:37.439 INFO:teuthology.orchestra.run.smithi063.stdout:root 441 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [nvme-delete-wq] 2024-03-26T13:33:37.439 INFO:teuthology.orchestra.run.smithi063.stdout:root 444 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [nvme-auth-wq] 2024-03-26T13:33:37.439 INFO:teuthology.orchestra.run.smithi063.stdout:root 451 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [ata_sff] 2024-03-26T13:33:37.439 INFO:teuthology.orchestra.run.smithi063.stdout:root 452 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [ixgbe] 2024-03-26T13:33:37.439 INFO:teuthology.orchestra.run.smithi063.stdout:root 461 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_0] 2024-03-26T13:33:37.440 INFO:teuthology.orchestra.run.smithi063.stdout:root 462 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_0] 2024-03-26T13:33:37.440 INFO:teuthology.orchestra.run.smithi063.stdout:root 463 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_1] 2024-03-26T13:33:37.440 INFO:teuthology.orchestra.run.smithi063.stdout:root 464 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_1] 2024-03-26T13:33:37.440 INFO:teuthology.orchestra.run.smithi063.stdout:root 465 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_2] 2024-03-26T13:33:37.440 INFO:teuthology.orchestra.run.smithi063.stdout:root 466 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_2] 2024-03-26T13:33:37.440 INFO:teuthology.orchestra.run.smithi063.stdout:root 467 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_3] 2024-03-26T13:33:37.440 INFO:teuthology.orchestra.run.smithi063.stdout:root 468 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_3] 2024-03-26T13:33:37.440 INFO:teuthology.orchestra.run.smithi063.stdout:root 469 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_4] 2024-03-26T13:33:37.440 INFO:teuthology.orchestra.run.smithi063.stdout:root 470 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_4] 2024-03-26T13:33:37.441 INFO:teuthology.orchestra.run.smithi063.stdout:root 471 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_5] 2024-03-26T13:33:37.441 INFO:teuthology.orchestra.run.smithi063.stdout:root 472 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_5] 2024-03-26T13:33:37.441 INFO:teuthology.orchestra.run.smithi063.stdout:root 473 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_6] 2024-03-26T13:33:37.441 INFO:teuthology.orchestra.run.smithi063.stdout:root 474 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_6] 2024-03-26T13:33:37.441 INFO:teuthology.orchestra.run.smithi063.stdout:root 475 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_7] 2024-03-26T13:33:37.441 INFO:teuthology.orchestra.run.smithi063.stdout:root 476 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_7] 2024-03-26T13:33:37.441 INFO:teuthology.orchestra.run.smithi063.stdout:root 477 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_8] 2024-03-26T13:33:37.441 INFO:teuthology.orchestra.run.smithi063.stdout:root 478 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_8] 2024-03-26T13:33:37.442 INFO:teuthology.orchestra.run.smithi063.stdout:root 479 0.0 0.0 0 0 ? S 13:32 0:00 \_ [scsi_eh_9] 2024-03-26T13:33:37.442 INFO:teuthology.orchestra.run.smithi063.stdout:root 480 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [scsi_tmf_9] 2024-03-26T13:33:37.442 INFO:teuthology.orchestra.run.smithi063.stdout:root 481 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:8-flush-8:0] 2024-03-26T13:33:37.442 INFO:teuthology.orchestra.run.smithi063.stdout:root 482 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:9-events_unbound] 2024-03-26T13:33:37.442 INFO:teuthology.orchestra.run.smithi063.stdout:root 483 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:10-events_unbound] 2024-03-26T13:33:37.442 INFO:teuthology.orchestra.run.smithi063.stdout:root 484 0.0 0.0 0 0 ? I 13:32 0:00 \_ [kworker/u16:11-events_unbound] 2024-03-26T13:33:37.442 INFO:teuthology.orchestra.run.smithi063.stdout:root 489 0.0 0.0 0 0 ? I< 13:32 0:00 \_ [kworker/1:1H-kblockd] 2024-03-26T13:33:37.442 INFO:teuthology.orchestra.run.smithi063.stdout:root 494 0.0 0.0 0 0 ? I< 13:33 0:00 \_ [kworker/6:1H-kblockd] 2024-03-26T13:33:37.443 INFO:teuthology.orchestra.run.smithi063.stdout:root 502 0.0 0.0 0 0 ? I 13:33 0:00 \_ [kworker/1:2-cgroup_destroy] 2024-03-26T13:33:37.443 INFO:teuthology.orchestra.run.smithi063.stdout:root 506 0.0 0.0 0 0 ? I 13:33 0:00 \_ [kworker/5:3-events] 2024-03-26T13:33:37.443 INFO:teuthology.orchestra.run.smithi063.stdout:root 507 0.0 0.0 0 0 ? S 13:33 0:00 \_ [jbd2/sda1-8] 2024-03-26T13:33:37.443 INFO:teuthology.orchestra.run.smithi063.stdout:root 508 0.0 0.0 0 0 ? I< 13:33 0:00 \_ [ext4-rsv-conver] 2024-03-26T13:33:37.443 INFO:teuthology.orchestra.run.smithi063.stdout:root 589 0.0 0.0 0 0 ? S 13:33 0:00 \_ [ext4lazyinit] 2024-03-26T13:33:37.443 INFO:teuthology.orchestra.run.smithi063.stdout:root 643 0.0 0.0 0 0 ? I< 13:33 0:00 \_ [ipmi-msghandler] 2024-03-26T13:33:37.443 INFO:teuthology.orchestra.run.smithi063.stdout:root 660 0.0 0.0 0 0 ? SN 13:33 0:00 \_ [kipmi0] 2024-03-26T13:33:37.443 INFO:teuthology.orchestra.run.smithi063.stdout:root 679 0.0 0.0 0 0 ? I< 13:33 0:00 \_ [rpciod] 2024-03-26T13:33:37.443 INFO:teuthology.orchestra.run.smithi063.stdout:root 680 0.0 0.0 0 0 ? I< 13:33 0:00 \_ [xprtiod] 2024-03-26T13:33:37.444 INFO:teuthology.orchestra.run.smithi063.stdout:root 1 3.8 0.0 172628 16888 ? Ss 13:32 0:01 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2024-03-26T13:33:37.444 INFO:teuthology.orchestra.run.smithi063.stdout:root 423 0.3 0.0 7296 2436 ? S 13:32 0:00 @usr/sbin/plymouthd --mode=boot --pid-file=/run/plymouth/pid --attach-to-session 2024-03-26T13:33:37.444 INFO:teuthology.orchestra.run.smithi063.stdout:root 583 0.2 0.0 26268 11568 ? Ss 13:33 0:00 /usr/lib/systemd/systemd-journald 2024-03-26T13:33:37.444 INFO:teuthology.orchestra.run.smithi063.stdout:root 601 0.4 0.0 34612 12808 ? Ss 13:33 0:00 /usr/lib/systemd/systemd-udevd 2024-03-26T13:33:37.444 INFO:teuthology.orchestra.run.smithi063.stdout:root 5094 0.0 0.0 34612 6332 ? S 13:33 0:00 \_ /usr/lib/systemd/systemd-udevd 2024-03-26T13:33:37.444 INFO:teuthology.orchestra.run.smithi063.stdout:rpc 673 0.0 0.0 13244 5560 ? Ss 13:33 0:00 /usr/bin/rpcbind -w -f 2024-03-26T13:33:37.444 INFO:teuthology.orchestra.run.smithi063.stdout:root 683 0.0 0.0 91824 4436 ? S sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-26T13:33:37.550 INFO:teuthology.orchestra.run.smithi063.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2024-03-26T13:33:37.550 INFO:teuthology.orchestra.run.smithi063.stderr:tar: Error is not recoverable: exiting now 2024-03-26T13:33:37.552 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi/7622744/remote/smithi204/crash 2024-03-26T13:33:37.553 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-26T13:33:37.615 INFO:teuthology.orchestra.run.smithi204.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2024-03-26T13:33:37.615 INFO:teuthology.orchestra.run.smithi204.stderr:tar: Error is not recoverable: exiting now 2024-03-26T13:33:37.616 INFO:tasks.ceph:Shutting down logrotate 2024-03-26T13:33:37.617 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1112, in cluster File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1935, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 257, in ceph_log File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 222, in end File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 189, in invoke_logrotate File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-26T13:33:37.633 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-26T13:33:37.643 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1112, in cluster File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1935, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 257, in ceph_log File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 222, in end File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 189, in invoke_logrotate File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-26T13:33:37.647 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-26T13:33:37.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-26T13:33:37.654 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-26T13:33:37.724 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-26T13:33:37.732 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-26T13:33:37.733 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T13:33:37.735 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T13:33:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-03-26T13:33:37.750 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T13:33:37.750 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-03-26T13:33:37.751 INFO:teuthology.orchestra.run.smithi204.stderr:bash: ntpq: command not found 2024-03-26T13:33:37.756 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T13:33:37.756 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-03-26T13:33:37.756 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv01.front.sepia.ceph.com 2 6 7 0 +779us[ +131ms] +/- 71ms 2024-03-26T13:33:37.756 INFO:teuthology.orchestra.run.smithi204.stdout:^* hv02.front.sepia.ceph.com 3 6 7 0 -815us[ +129ms] +/- 54ms 2024-03-26T13:33:37.756 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv03.front.sepia.ceph.com 3 6 7 0 +389us[ +130ms] +/- 90ms 2024-03-26T13:33:37.756 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T13:33:37.757 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-26T13:33:37.784 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-26T13:33:37.784 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-26T13:33:37.868 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-26T13:33:37.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:37.885 INFO:teuthology.orchestra.run.smithi063.stderr:mkdir: cannot create directory ‘/home/ubuntu/cephtest/archive/audit’: No such file or directory 2024-03-26T13:33:37.885 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 165, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 195, in archive_log self.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2024-03-26T13:33:37.892 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-26T13:33:37.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-26T13:33:38.049 INFO:teuthology.task.internal:Duration was 26813.974572 seconds 2024-03-26T13:33:38.049 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-26T13:33:38.058 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-26T13:33:38.058 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-26T13:33:38.063 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-26T13:33:38.119 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T13:33:38.124 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T13:33:38.457 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-26T13:33:38.457 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-03-26T13:33:38.457 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-26T13:33:38.476 INFO:teuthology.orchestra.run.smithi063.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2024-03-26T13:33:38.479 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-03-26T13:33:38.479 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-26T13:33:38.498 INFO:teuthology.orchestra.run.smithi204.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2024-03-26T13:33:38.501 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-26T13:33:38.501 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-26T13:33:38.522 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-26T13:33:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:find: ‘/home/ubuntu/cephtest/archive/syslog’: No such file or directory 2024-03-26T13:33:38.563 INFO:teuthology.orchestra.run.smithi204.stderr:find: ‘/home/ubuntu/cephtest/archive/syslog’: No such file or directory 2024-03-26T13:33:38.573 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-26T13:33:38.573 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-26T13:33:38.596 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-26T13:33:38.608 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz: No such file or directory 2024-03-26T13:33:38.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:38.629 ERROR:teuthology.run_tasks:Manager failed: internal.syslog Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1112, in cluster File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/syslog.py", line 76, in syslog yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1935, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 257, in ceph_log File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 222, in end File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 189, in invoke_logrotate File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/syslog.py", line 185, in syslog run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz' 2024-03-26T13:33:38.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-26T13:33:38.667 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-26T13:33:38.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-26T13:33:38.673 INFO:teuthology.orchestra.run.smithi204.stderr:bash: /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz: No such file or directory 2024-03-26T13:33:38.701 INFO:teuthology.orchestra.run.smithi063.stderr:mv: cannot stat '/etc/sudoers.orig.teuthology': No such file or directory 2024-03-26T13:33:38.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:38.703 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1112, in cluster File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 452, in sudo yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1935, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 257, in ceph_log File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 222, in end File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 189, in invoke_logrotate File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 455, in sudo ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers' 2024-03-26T13:33:38.720 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-26T13:33:38.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-26T13:33:38.746 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-26T13:33:38.779 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-03-26T13:33:38.782 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-03-26T13:33:38.790 INFO:teuthology.orchestra.run.smithi204.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2024-03-26T13:33:38.799 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2024-03-26T13:33:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2024-03-26T13:33:38.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:38.804 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2024-03-26T13:33:38.804 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1112, in cluster File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 488, in coredump yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1935, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 257, in ceph_log File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 222, in end File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 189, in invoke_logrotate File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 491, in coredump run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: "sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump" 2024-03-26T13:33:38.820 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-26T13:33:38.830 INFO:teuthology.task.internal:Transferring archived files... 2024-03-26T13:33:38.831 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi/7622744/remote/smithi063 2024-03-26T13:33:38.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-26T13:33:38.874 INFO:teuthology.orchestra.run.smithi063.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2024-03-26T13:33:38.874 INFO:teuthology.orchestra.run.smithi063.stderr:tar: Error is not recoverable: exiting now 2024-03-26T13:33:38.875 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1112, in cluster File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1935, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 257, in ceph_log File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 222, in end File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 189, in invoke_logrotate File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/tarfile.py", line 2318, in next tarinfo = self.tarinfo.fromtarfile(self) File "/usr/lib/python3.8/tarfile.py", line 1105, in fromtarfile obj = cls.frombuf(buf, tarfile.encoding, tarfile.errors) File "/usr/lib/python3.8/tarfile.py", line 1041, in frombuf raise EmptyHeaderError("empty header") tarfile.EmptyHeaderError: empty header During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 418, in archive misc.pull_directory(rem, archive_dir, path, maybe_compress) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/misc.py", line 749, in pull_directory tar = tarfile.open(mode='r|', fileobj=r.stdout) File "/usr/lib/python3.8/tarfile.py", line 1633, in open t = cls(name, filemode, stream, **kwargs) File "/usr/lib/python3.8/tarfile.py", line 1514, in __init__ self.firstmember = self.next() File "/usr/lib/python3.8/tarfile.py", line 2333, in next raise ReadError("empty file") tarfile.ReadError: empty file 2024-03-26T13:33:38.895 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-26T13:33:38.905 INFO:teuthology.task.internal:Not uploading archives. 2024-03-26T13:33:38.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-26T13:33:38.916 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-26T13:33:38.917 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-26T13:33:38.924 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-26T13:33:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:find: ‘/home/ubuntu/cephtest’: No such file or directory 2024-03-26T13:33:38.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T13:33:38.937 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': No such file or directory 2024-03-26T13:33:38.937 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1112, in cluster File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2785, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2617, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 2383, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 1935, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 257, in ceph_log File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 222, in end File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_7e98f5f6b535defc7fa715b456904ffc0500aa9f/qa/tasks/ceph.py", line 189, in invoke_logrotate File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-26T13:33:38.954 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-26T13:33:38.963 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-26T13:33:39.073 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi063 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-26T13:33:39.073 INFO:teuthology.nuke:Checking targets against current locks 2024-03-26T13:33:39.083 INFO:teuthology.orchestra.run.smithi204.stderr:find: ‘/home/ubuntu/cephtest’: No such file or directory 2024-03-26T13:33:39.083 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': No such file or directory 2024-03-26T13:33:39.109 INFO:teuthology.nuke:Not nuking smithi063.front.sepia.ceph.com because description doesn't match: rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi != /home/teuthworker/archive/mchangir-2024-03-26_07:59:35-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7622939 2024-03-26T13:33:39.129 INFO:teuthology.nuke:Not nuking smithi204.front.sepia.ceph.com because description doesn't match: rishabh-2024-03-26_05:47:39-fs-rishabh-2024mar8-2-testing-default-smithi != /home/teuthworker/archive/mchangir-2024-03-26_07:59:35-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7622938 2024-03-26T13:33:39.130 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3015ah+uS/GErHoW8pWDjsu0nZqjp03VNveGmFnF7o/acjBvnzYr0lW/QVToeCMrmQfqfDhbXR+2Ok4F5BV3o= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHhmeHk6Fn3xkDkzVCnMhzCOWRt2U88GoUWBUTHmSPtekX/MihhFYoOL1xZGXkZEM94XjMHYy2QkVdFllqy8atw= 2024-03-26T13:33:39.138 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 client.1-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 26813.9745721817 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=2f86334e26cf442e84910ccd47b07a27 status: fail success: false 2024-03-26T13:33:39.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T13:33:39.225 INFO:teuthology.run:FAIL